-- Logs begin at Mon 2022-07-11 13:52:40 UTC, end at Mon 2022-07-11 15:08:15 UTC. -- Jul 11 14:25:04.163802 dv-cinder-master-3-smb systemd[1]: Starting Devstack devstack@keystone.service... Jul 11 14:25:04.174018 dv-cinder-master-3-smb devstack@keystone.service[80480]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 11 14:25:04.176131 dv-cinder-master-3-smb devstack@keystone.service[80480]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jul 11 14:25:04 2022] *** Jul 11 14:25:04.176131 dv-cinder-master-3-smb devstack@keystone.service[80480]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 11 14:25:04.176131 dv-cinder-master-3-smb devstack@keystone.service[80480]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 11 14:25:04.176131 dv-cinder-master-3-smb devstack@keystone.service[80480]: nodename: dv-cinder-master-3-smb Jul 11 14:25:04.176131 dv-cinder-master-3-smb devstack@keystone.service[80480]: machine: x86_64 Jul 11 14:25:04.176131 dv-cinder-master-3-smb devstack@keystone.service[80480]: clock source: unix Jul 11 14:25:04.176131 dv-cinder-master-3-smb devstack@keystone.service[80480]: pcre jit disabled Jul 11 14:25:04.176131 dv-cinder-master-3-smb devstack@keystone.service[80480]: detected number of CPU cores: 4 Jul 11 14:25:04.176131 dv-cinder-master-3-smb devstack@keystone.service[80480]: current working directory: / Jul 11 14:25:04.176131 dv-cinder-master-3-smb devstack@keystone.service[80480]: detected binary path: /usr/bin/uwsgi-core Jul 11 14:25:04.176131 dv-cinder-master-3-smb devstack@keystone.service[80480]: your processes number limit is 47680 Jul 11 14:25:04.176131 dv-cinder-master-3-smb devstack@keystone.service[80480]: your memory page size is 4096 bytes Jul 11 14:25:04.176847 dv-cinder-master-3-smb devstack@keystone.service[80480]: detected max file descriptor number: 2048 Jul 11 14:25:04.176847 dv-cinder-master-3-smb devstack@keystone.service[80480]: lock engine: pthread robust mutexes Jul 11 14:25:04.176847 dv-cinder-master-3-smb devstack@keystone.service[80480]: thunder lock: enabled Jul 11 14:25:04.176847 dv-cinder-master-3-smb devstack@keystone.service[80480]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 11 14:25:04.176847 dv-cinder-master-3-smb devstack@keystone.service[80480]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jul 11 14:25:04.222440 dv-cinder-master-3-smb devstack@keystone.service[80480]: Python main interpreter initialized at 0x55b78fe609c0 Jul 11 14:25:04.222440 dv-cinder-master-3-smb devstack@keystone.service[80480]: python threads support enabled Jul 11 14:25:04.222440 dv-cinder-master-3-smb devstack@keystone.service[80480]: your server socket listen backlog is limited to 100 connections Jul 11 14:25:04.222440 dv-cinder-master-3-smb devstack@keystone.service[80480]: your mercy for graceful operations on workers is 90 seconds Jul 11 14:25:04.222834 dv-cinder-master-3-smb devstack@keystone.service[80480]: mapped 403077 bytes (393 KB) for 2 cores Jul 11 14:25:04.222909 dv-cinder-master-3-smb devstack@keystone.service[80480]: *** Operational MODE: preforking *** Jul 11 14:25:04.223202 dv-cinder-master-3-smb devstack@keystone.service[80480]: *** uWSGI is running in multiple interpreter mode *** Jul 11 14:25:04.223202 dv-cinder-master-3-smb devstack@keystone.service[80480]: spawned uWSGI master process (pid: 80480) Jul 11 14:25:04.223415 dv-cinder-master-3-smb systemd[1]: Started Devstack devstack@keystone.service. Jul 11 14:25:04.225256 dv-cinder-master-3-smb devstack@keystone.service[80480]: spawned uWSGI worker 1 (pid: 80534, cores: 1) Jul 11 14:25:04.225256 dv-cinder-master-3-smb devstack@keystone.service[80480]: spawned uWSGI worker 2 (pid: 80535, cores: 1) Jul 11 14:25:04.225256 dv-cinder-master-3-smb devstack@keystone.service[80480]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 11 14:25:09.744115 dv-cinder-master-3-smb devstack@keystone.service[80534]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 11 14:25:09.744115 dv-cinder-master-3-smb devstack@keystone.service[80534]: from cryptography.utils import int_from_bytes Jul 11 14:25:09.744959 dv-cinder-master-3-smb devstack@keystone.service[80534]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 11 14:25:09.744959 dv-cinder-master-3-smb devstack@keystone.service[80534]: from cryptography.utils import int_from_bytes Jul 11 14:25:09.745596 dv-cinder-master-3-smb devstack@keystone.service[80535]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 11 14:25:09.745596 dv-cinder-master-3-smb devstack@keystone.service[80535]: from cryptography.utils import int_from_bytes Jul 11 14:25:09.746305 dv-cinder-master-3-smb devstack@keystone.service[80535]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 11 14:25:09.746305 dv-cinder-master-3-smb devstack@keystone.service[80535]: from cryptography.utils import int_from_bytes Jul 11 14:25:09.794515 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 11 14:25:09.794704 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 11 14:25:09.794933 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] command line args: [] {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 11 14:25:09.795274 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 11 14:25:09.795455 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] ================================================================================ {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 11 14:25:09.795721 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] admin_token = **** {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:25:09.795967 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] config_dir = [] {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:25:09.796153 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:25:09.796278 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 11 14:25:09.796363 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] config_source = [] {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:25:09.796477 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 11 14:25:09.796558 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] debug = True {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:25:09.796671 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] command line args: [] {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 11 14:25:09.796762 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:25:09.797003 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 11 14:25:09.797112 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:25:09.797217 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] ================================================================================ {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 11 14:25:09.797319 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:25:09.797420 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] admin_token = **** {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:25:09.797531 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:25:09.797627 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] config_dir = [] {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:25:09.797729 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:25:09.797826 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:25:09.797921 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] list_limit = None {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:25:09.798028 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] config_source = [] {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:25:09.798123 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] log_config_append = None {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:25:09.798229 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] debug = True {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:25:09.798327 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:25:09.798427 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:25:09.798553 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] log_dir = None {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:25:09.798656 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:25:09.798762 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] log_file = None {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:25:09.798871 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:25:09.798968 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:25:09.799068 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:25:09.799175 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:25:09.799270 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:25:09.799375 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:25:09.799472 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] list_limit = None {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:25:09.799580 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:25:09.799688 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] log_config_append = None {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:25:09.799790 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:25:09.799888 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:25:09.799990 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:25:09.800094 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] log_dir = None {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:25:09.800247 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:25:09.800368 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] log_file = None {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:25:09.800475 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:25:09.800575 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:25:09.800745 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:25:09.800861 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:25:09.800964 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:25:09.801066 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:25:09.801162 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:25:09.801268 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:25:09.801376 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:25:09.801473 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:25:09.801473 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:25:09.801669 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:25:09.801766 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:25:09.801869 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:25:09.801964 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:25:09.802071 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:25:09.802175 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:25:09.802271 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:25:09.802416 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.70/identity {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:25:09.802614 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:25:09.802735 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] publish_errors = False {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:25:09.802845 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:25:09.802947 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:25:09.803054 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:25:09.803157 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:25:09.803157 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:25:09.803347 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:25:09.803450 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:25:09.803554 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:25:09.803668 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:25:09.803835 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] standard_threads = False {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:25:09.803944 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.70/identity {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:25:09.804057 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:25:09.804178 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] publish_errors = False {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:25:09.804354 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:25:09.804471 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:25:09.804591 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:25:09.804705 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:25:09.804883 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] use_journal = False {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:25:09.804999 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:25:09.805111 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] use_json = False {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:25:09.805111 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] use_stderr = False {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:25:09.805328 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:25:09.805448 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] use_syslog = False {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:25:09.805571 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:25:09.805692 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:25:09.805811 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] standard_threads = False {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:25:09.805925 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.806561 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:25:09.806676 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.806798 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:25:09.806798 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:25:09.807018 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.807115 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] use_journal = False {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:25:09.807115 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] use_json = False {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:25:09.807298 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.807401 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] use_stderr = False {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:25:09.807505 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.807654 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] use_syslog = False {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:25:09.807774 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.808136 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.808318 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:25:09.808446 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.808446 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.808667 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.808746 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.808914 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.809259 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.809403 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.809648 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.809766 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.809881 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.810044 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.810174 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.810346 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.810469 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.810583 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.810819 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.810936 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.811057 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.811257 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.811367 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.811520 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.811637 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.811770 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.812085 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.812226 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.812424 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.812552 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.812668 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.812889 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.813015 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.813136 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.813338 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.813455 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.813567 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.813799 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.813929 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.814042 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.814154 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.814267 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.814380 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.814499 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.814621 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.814742 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.814936 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.815053 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.815166 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.815403 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.815531 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.815646 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.815780 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.815898 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.816070 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.816187 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.816388 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.816503 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.816623 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.816738 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.816850 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.816983 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.817109 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.817224 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.817389 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.817506 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.817673 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.817825 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.817944 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.818125 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.818249 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.818364 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.818548 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.818744 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.818867 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.818977 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.819090 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.819204 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.819317 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.819474 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.819592 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.819704 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.819930 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.820046 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.820159 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.820334 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.820454 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.820568 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.820680 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.820841 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.820944 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.821086 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.821197 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.821316 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.821428 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.821600 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.821738 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.822472 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.822591 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.822713 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.822931 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.823100 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.823302 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.823431 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.823538 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.823636 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.823732 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.823828 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.823923 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.824059 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.824167 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.824313 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.824507 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.824628 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.824777 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.824942 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.825079 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.825224 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.825355 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.825471 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.825586 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.825699 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.825821 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.825928 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.826041 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.826161 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.826267 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.826380 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.826502 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.826618 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.826732 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.826845 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.826957 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.827071 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.827196 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.827319 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.827441 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.827556 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.827677 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.827792 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.827918 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.828025 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.828139 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.828301 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.828420 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.828534 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.828657 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.828773 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.828887 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.829000 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.829113 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.829236 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.829351 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.829474 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.829589 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.829694 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.829807 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.829911 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.830031 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.830147 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.830261 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.830375 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.830488 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.830602 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.830723 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.830840 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.830953 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.831068 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.831182 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.831299 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.831493 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.831612 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.831726 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.831841 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.831955 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.832076 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] auth.external = None {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.832221 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.832344 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.832474 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.832596 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.832716 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.832831 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.832946 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.833060 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] auth.password = None {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.833060 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] auth.token = None {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.833285 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.833405 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.833520 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.833644 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.833788 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.833919 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.834035 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.834150 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.834264 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.834393 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.834517 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.834639 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.834755 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.834869 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.834984 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.835097 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] credential.caching = True {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.835220 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.835336 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.835457 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.835572 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.835693 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.835810 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.835932 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.836049 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.836190 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.836384 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.836503 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.836618 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.836734 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.836849 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.836964 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.837088 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.837268 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.837486 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.837663 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.837823 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.837942 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.838042 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.838141 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.838264 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.838390 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.838507 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.838630 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.838747 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.838871 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.838988 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.839103 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.839219 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] federation.caching = True {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.839346 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.839470 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.839587 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] auth.external = None {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.839702 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.839816 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.839931 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.840054 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.840174 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.840306 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.840422 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.840538 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] auth.password = None {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.840664 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.840791 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] auth.token = None {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.840908 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.841024 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.841143 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.841259 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.841374 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.841501 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.841619 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.841734 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.841849 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.841973 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.842090 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] identity.caching = True {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.842218 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.842337 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.842453 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.842567 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.842682 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] credential.caching = True {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.842796 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.842919 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.843037 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.843037 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.843253 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.843375 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.843754 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.843886 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.844005 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.844120 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.844311 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.844442 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.844560 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.844684 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.844808 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.844925 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.845057 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.845189 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.845304 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.845429 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.845546 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.845661 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.845775 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.845890 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.846005 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.846198 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.846318 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.846433 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.846549 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.846669 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.846786 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.846908 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.847031 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] federation.caching = True {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.847148 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.847269 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.847386 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.847509 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.847626 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.847626 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.847841 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.847955 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.848070 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.848192 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.848329 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.848430 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.848543 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.848659 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.848781 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.848909 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.849027 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.849141 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.849255 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.849369 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.849484 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.849607 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.849725 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.849839 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.849953 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] identity.caching = True {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.850068 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.850183 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.850310 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.850433 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.850550 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.850666 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.850781 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.850900 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.851022 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.851139 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.851254 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.851369 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.851483 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.851598 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.851722 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.851839 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.851953 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.852068 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.852184 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.852331 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.852456 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.852574 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.852689 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.852809 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.853436 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.853561 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.853670 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.853768 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.853865 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.853865 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.854044 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.854113 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.854197 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.854272 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.854342 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.854413 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] ldap.user = None {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.854482 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.854552 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.854630 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.854703 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.854772 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.854842 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.854912 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.854982 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.855060 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.855132 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.855201 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.855270 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.855340 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.855409 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.855486 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.855559 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.855628 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.855698 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.855767 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.855837 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.855914 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.855986 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.856109 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.856189 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.856402 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.856483 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.856641 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.856722 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.856891 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.856970 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.857138 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.857216 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.857370 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.857450 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.857596 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.857674 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.857830 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.857907 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.858063 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.858142 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.858297 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.858376 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.858529 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.858608 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.858762 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.858842 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.859004 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.859083 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.859247 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.859333 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.859483 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.859562 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.859716 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.859793 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.859948 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.860035 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.860187 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.860294 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.860445 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.860524 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.860678 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.860769 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.860911 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.860992 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.861154 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.861233 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.861389 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] ldap.user = None {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.861476 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.861662 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.861753 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.861852 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.861932 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.862089 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] resource.caching = True {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.862179 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.862335 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.862418 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.862580 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.862659 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.862813 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.862901 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.863057 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.863136 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.863303 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.863382 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.863534 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.863624 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.863800 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.863880 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.864034 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.864115 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.864302 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.864428 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.864849 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] role.caching = True {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.864930 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.865001 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] role.driver = sql {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.865072 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.865143 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.865224 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.865297 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.865405 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.865486 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.865675 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.865753 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.865921 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.866000 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.866171 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.866250 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.866414 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.866492 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.866656 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.866737 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.866900 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.866979 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.867130 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.867210 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.867371 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.867453 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.867613 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.867693 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.867855 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.867934 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.868090 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.868166 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.868372 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.869203 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.869293 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.869532 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.869637 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.869734 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.869816 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.869993 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.870071 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.870240 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.870320 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.870484 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.870562 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.870718 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.870805 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.870955 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.871113 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.871241 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] resource.caching = True {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.871367 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.871497 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.871608 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.871750 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.871832 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.871991 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.872078 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.872267 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.872351 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.872522 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.872604 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.872760 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.872840 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.873007 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.873087 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.873241 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.873321 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.873476 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.873555 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.873706 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.873786 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] role.caching = True {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.873938 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] token.caching = True {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.874019 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] role.driver = sql {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.874172 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.874252 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.874415 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.874495 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.874649 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.874730 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.874901 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.874979 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.875144 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.875224 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.875391 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.875470 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.875639 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.875718 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.875878 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.875956 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.876125 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.876293 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.876370 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.876440 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.876607 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.876687 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.876840 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.876922 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.877081 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.877160 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.877325 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.877403 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.877551 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.877755 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.877835 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.878042 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.878140 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.878246 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.878336 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] database.connection = **** {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.878498 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.878587 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.878748 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.878828 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.878997 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.879076 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.879237 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.879318 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.879471 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.879551 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.879707 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.879788 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.879941 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.880023 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.880173 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.880348 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.880421 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.880521 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.880653 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.880756 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.880908 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.880988 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.881165 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.881245 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.881457 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.881547 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.881664 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.881745 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.881902 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.881982 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.882130 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.882209 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.882366 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] token.caching = True {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.882444 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.882596 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.882675 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.882754 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 11 14:25:09.882828 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.883070 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.883329 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.883580 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.883819 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.884085 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.884378 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.884612 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.884851 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.885091 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.885343 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.885573 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.885821 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.886095 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.886299 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.886606 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.886881 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] database.connection = **** {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.887131 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.887380 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.887624 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.887865 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.888103 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.888372 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.888612 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.888852 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.889108 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.889344 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.889591 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.889862 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.890079 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.890317 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.890564 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.890797 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.891038 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.891275 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:09.891448 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 11 14:25:09.913903 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80534) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:25:09.914124 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80534) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:25:09.914344 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80534) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:25:09.918983 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80535) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:25:09.919219 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80535) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:25:09.919447 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80535) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:25:09.924079 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80534) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:25:09.928250 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80535) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:25:09.953737 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80534) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:25:09.953962 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80534) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:25:09.955234 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80535) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:25:09.955469 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80535) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:25:10.099621 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80535) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:25:10.100755 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80534) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:25:10.150864 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80534) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:25:10.151098 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80535) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:25:10.151188 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80534) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:25:10.151267 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80535) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:25:10.217298 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80534) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:25:10.217523 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80534) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:25:10.217743 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80534) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:25:10.217957 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80534) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:25:10.218170 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80534) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:25:10.218382 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80534) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:25:10.218833 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80535) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:25:10.219072 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80535) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:25:10.219298 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80535) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:25:10.219520 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80535) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:25:10.219738 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80535) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:25:10.219955 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80535) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:25:10.244324 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80534) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:25:10.244549 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80534) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:25:10.244953 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80534) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:25:10.245179 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80534) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:25:10.245394 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80534) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:25:10.245479 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80535) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:25:10.245606 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80534) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:25:10.245700 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80535) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:25:10.245826 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80534) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:25:10.245959 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80535) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:25:10.246117 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80535) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:25:10.246340 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80535) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:25:10.246555 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80535) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:25:10.246767 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80535) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:25:10.257034 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80534) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:25:10.257802 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80535) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:25:10.270615 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80534) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:25:10.270807 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80535) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:25:10.270890 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80534) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:25:10.271028 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80535) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:25:10.271112 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80534) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:25:10.271240 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80534) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:25:10.271332 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80535) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:25:10.271453 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80534) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:25:10.271536 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80535) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:25:10.271662 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80534) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:25:10.271744 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80535) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:25:10.271871 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80534) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:25:10.271963 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80535) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:25:10.272083 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80535) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:25:10.290060 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:10.290273 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 11 14:25:10.290759 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:10.290961 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 11 14:25:10.291229 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:10.291312 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:10.291489 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:10.291582 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 11 14:25:10.291743 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:10.291837 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:10.291998 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:10.292081 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 11 14:25:10.292319 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:10.292582 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:10.292842 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:10.293100 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:10.302904 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:10.303184 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:10.303448 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:10.303724 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:10.304083 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:10.304394 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:10.304662 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:10.304943 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:10.313033 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80534) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 14:25:10.314791 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80535) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 14:25:10.316293 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80534) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 14:25:10.316569 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:10.316848 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:10.317125 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:10.317404 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:10.317941 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:10.317941 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:10.318085 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80535) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 14:25:10.318222 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:10.318338 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:10.318496 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:10.318628 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:10.318765 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:10.318917 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:10.319029 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:10.319202 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:10.319467 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:10.319738 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:10.320010 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:10.320306 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:10.320579 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:10.320842 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:10.346194 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:10.347806 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80534) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 14:25:10.348085 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:10.350007 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:10.351613 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80535) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 14:25:10.351896 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:10.353469 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80534) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 14:25:10.353747 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:10.354152 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:10.357920 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80535) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 14:25:10.358204 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:10.358606 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:10.361380 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80534) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 14:25:10.361662 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:10.365885 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80535) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 14:25:10.366104 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80534) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 14:25:10.366191 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:10.366390 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:10.366669 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:10.366947 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:10.367219 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:10.367486 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:10.367748 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:10.368008 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:10.371818 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80535) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 14:25:10.372105 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:10.372410 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:10.372694 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:10.372969 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:10.373244 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:10.373510 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:10.373773 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:10.387207 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:10.387481 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:10.392060 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80534) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 14:25:10.392996 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:10.393279 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:10.395664 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:10.395954 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:10.397820 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80535) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 14:25:10.401598 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80534) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 14:25:10.402597 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:10.402892 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:10.405195 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80534) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 14:25:10.408037 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80535) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 14:25:10.408795 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:10.409091 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:10.409379 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:10.409660 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:10.409941 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:10.410214 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:10.411636 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80535) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 14:25:10.415571 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:10.416365 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:10.416654 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:10.416942 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:10.417229 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:10.417504 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:10.429219 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80534) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 14:25:10.429499 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:10.429760 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:10.430019 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:10.437875 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80535) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 14:25:10.438160 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:10.438427 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:10.438695 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:10.439292 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:10.441000 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:10.441273 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:10.444467 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80534) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 14:25:10.444713 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:10.444990 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:10.445263 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:10.445541 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:10.446658 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:10.448812 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:10.449088 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:10.452299 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80535) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 14:25:10.452590 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:10.452870 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:10.453150 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:10.453426 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:10.458734 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80534) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 14:25:10.459014 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:10.459293 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:10.459577 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:10.459853 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:10.461575 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:10.461864 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:10.467669 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80535) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 14:25:10.467948 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:10.468260 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:10.468544 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:10.468823 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:10.470522 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:10.470822 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:10.480251 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80534) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 14:25:10.483501 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80534) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 14:25:10.486760 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:10.488503 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:10.489239 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80535) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 14:25:10.490116 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80534) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 14:25:10.490389 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:10.490669 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:10.492528 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80535) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 14:25:10.496915 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:10.498454 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:10.498642 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:10.500028 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80534) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 14:25:10.500318 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80535) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 14:25:10.500600 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:10.500879 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:10.503227 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:10.503513 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:10.503904 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:10.504186 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:10.508034 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:10.510295 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80535) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 14:25:10.513229 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80534) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 14:25:10.513511 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:10.513597 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:10.513784 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:10.513868 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:10.514184 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:10.514464 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:10.521556 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80534) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 14:25:10.521837 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:10.522113 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:10.522384 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:10.522651 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:10.523027 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:10.523301 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:10.523538 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80535) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 14:25:10.523622 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:10.523826 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:10.523921 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:10.524087 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:10.524168 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:10.524384 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:10.524642 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:10.525434 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:10.525693 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:10.533042 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80535) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 14:25:10.533325 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:10.533602 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:10.533878 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:10.534150 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:10.534524 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:10.534806 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:10.535082 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:10.535367 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:10.535637 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:10.535905 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:10.536164 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:10.536454 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:10.536730 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:10.563943 dv-cinder-master-3-smb devstack@keystone.service[80534]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55b78fe609c0 pid: 80534 (default app) Jul 11 14:25:10.567428 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e797069-99a7-41f4-9c6d-bd47873fd4ef None None] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:10.567714 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e797069-99a7-41f4-9c6d-bd47873fd4ef None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:10.567989 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e797069-99a7-41f4-9c6d-bd47873fd4ef None None] PATH_INFO: `/v3` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:10.573397 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1/1] 10.222.0.70 () {50 vars in 791 bytes} [Mon Jul 11 14:25:10 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:25:10.576882 dv-cinder-master-3-smb devstack@keystone.service[80535]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55b78fe609c0 pid: 80535 (default app) Jul 11 14:25:19.006460 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a038d2d6-ee56-42c7-be68-d766b44083fe None None] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:19.007042 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a038d2d6-ee56-42c7-be68-d766b44083fe None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:19.007042 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a038d2d6-ee56-42c7-be68-d766b44083fe None None] PATH_INFO: `/` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:19.008401 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 2/2] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:25:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 14:25:19.017219 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178169d0-70e0-4c3c-9ee7-83fb9ecdde16 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:19.017739 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178169d0-70e0-4c3c-9ee7-83fb9ecdde16 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:19.017840 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178169d0-70e0-4c3c-9ee7-83fb9ecdde16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:19.090657 dv-cinder-master-3-smb devstack@keystone.service[80535]: INFO dbcounter [None req-178169d0-70e0-4c3c-9ee7-83fb9ecdde16 None None] Registered counter for database keystone Jul 11 14:25:19.113657 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG oslo_db.sqlalchemy.engines [None req-178169d0-70e0-4c3c-9ee7-83fb9ecdde16 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80535) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 11 14:25:19.120461 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writer thread running {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 11 14:25:19.319915 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG passlib.handlers.bcrypt [None req-178169d0-70e0-4c3c-9ee7-83fb9ecdde16 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80535) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 11 14:25:19.320246 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG passlib.handlers.bcrypt [None req-178169d0-70e0-4c3c-9ee7-83fb9ecdde16 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80535) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 11 14:25:19.376528 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-178169d0-70e0-4c3c-9ee7-83fb9ecdde16 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:25:19.378135 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-178169d0-70e0-4c3c-9ee7-83fb9ecdde16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:19.506856 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1/3] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:25:19 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 493 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 11 14:25:19.583158 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a038d2d6-ee56-42c7-be68-d766b44083fe None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:19.658046 dv-cinder-master-3-smb devstack@keystone.service[80534]: INFO dbcounter [None req-a038d2d6-ee56-42c7-be68-d766b44083fe None None] Registered counter for database keystone Jul 11 14:25:19.679125 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG oslo_db.sqlalchemy.engines [None req-a038d2d6-ee56-42c7-be68-d766b44083fe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80534) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 11 14:25:19.687331 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writer thread running {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 11 14:25:19.815093 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a038d2d6-ee56-42c7-be68-d766b44083fe None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:19.819532 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98630381-f82e-4a5c-942c-ee45780324c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:19.820254 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98630381-f82e-4a5c-942c-ee45780324c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:19.820548 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98630381-f82e-4a5c-942c-ee45780324c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:19.820830 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98630381-f82e-4a5c-942c-ee45780324c2 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:19.831304 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98630381-f82e-4a5c-942c-ee45780324c2 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:19.886495 dv-cinder-master-3-smb devstack@keystone.service[80534]: WARNING keystone.common.rbac_enforcer.enforcer [None req-98630381-f82e-4a5c-942c-ee45780324c2 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 11 14:25:19.886834 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98630381-f82e-4a5c-942c-ee45780324c2 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:19.897598 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 3/4] 10.222.0.70 () {58 vars in 1324 bytes} [Mon Jul 11 14:25:19 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 14:25:19.904513 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178169d0-70e0-4c3c-9ee7-83fb9ecdde16 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:19.923005 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178169d0-70e0-4c3c-9ee7-83fb9ecdde16 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:19.927530 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c334dda-39c4-40e0-8fe0-2f13acbef5f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:19.928721 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c334dda-39c4-40e0-8fe0-2f13acbef5f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:19.929014 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c334dda-39c4-40e0-8fe0-2f13acbef5f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:19.929297 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c334dda-39c4-40e0-8fe0-2f13acbef5f6 admin admin] PATH_INFO: `/v3/projects/3a62c198ecd94c498e9bd153b3d4226c` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:19.931625 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c334dda-39c4-40e0-8fe0-2f13acbef5f6 admin admin] RBAC: Authorizing `identity:get_project(project_id=3a62c198ecd94c498e9bd153b3d4226c)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:19.984307 dv-cinder-master-3-smb devstack@keystone.service[80535]: WARNING keystone.common.rbac_enforcer.enforcer [None req-0c334dda-39c4-40e0-8fe0-2f13acbef5f6 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 11 14:25:19.984706 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c334dda-39c4-40e0-8fe0-2f13acbef5f6 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:19.989881 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 2/5] 10.222.0.70 () {56 vars in 1207 bytes} [Mon Jul 11 14:25:19 2022] GET /identity/v3/projects/3a62c198ecd94c498e9bd153b3d4226c => generated 344 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:25:22.075364 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef653263-3c1a-4342-a488-b30beb5a3884 None None] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:22.075883 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef653263-3c1a-4342-a488-b30beb5a3884 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:22.075998 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef653263-3c1a-4342-a488-b30beb5a3884 None None] PATH_INFO: `/` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:22.080042 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 4/6] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:25:22 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 14:25:22.085531 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb3d19b-1194-4b37-8ce3-b252f1355bd7 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:22.085948 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb3d19b-1194-4b37-8ce3-b252f1355bd7 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:22.086099 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb3d19b-1194-4b37-8ce3-b252f1355bd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:22.105588 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-1eb3d19b-1194-4b37-8ce3-b252f1355bd7 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:25:22.107174 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-1eb3d19b-1194-4b37-8ce3-b252f1355bd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:22.115163 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 3/7] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:25:22 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 11 14:25:22.139340 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef653263-3c1a-4342-a488-b30beb5a3884 None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:22.152691 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef653263-3c1a-4342-a488-b30beb5a3884 None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:22.157002 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a0de10-c5fe-41d4-a363-832520563ff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:22.157652 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a0de10-c5fe-41d4-a363-832520563ff0 admin admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:22.157938 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a0de10-c5fe-41d4-a363-832520563ff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:22.158215 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a0de10-c5fe-41d4-a363-832520563ff0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:22.167050 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a0de10-c5fe-41d4-a363-832520563ff0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:22.168854 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a0de10-c5fe-41d4-a363-832520563ff0 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:22.177807 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 5/8] 10.222.0.70 () {58 vars in 1324 bytes} [Mon Jul 11 14:25:22 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 14:25:22.184685 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb3d19b-1194-4b37-8ce3-b252f1355bd7 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:22.193406 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb3d19b-1194-4b37-8ce3-b252f1355bd7 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:22.198425 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9eb8e1-2a78-4d5b-9ae6-fc2f9d9dc3d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:22.199291 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9eb8e1-2a78-4d5b-9ae6-fc2f9d9dc3d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:22.199576 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9eb8e1-2a78-4d5b-9ae6-fc2f9d9dc3d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:22.199853 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9eb8e1-2a78-4d5b-9ae6-fc2f9d9dc3d1 admin admin] PATH_INFO: `/v3/users/c2bda2fc12a24c48ba42c84873d8bfa1` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:22.201271 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9eb8e1-2a78-4d5b-9ae6-fc2f9d9dc3d1 admin admin] RBAC: Authorizing `identity:get_user(user_id=c2bda2fc12a24c48ba42c84873d8bfa1)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:22.203102 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9eb8e1-2a78-4d5b-9ae6-fc2f9d9dc3d1 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:22.204742 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 4/9] 10.222.0.70 () {56 vars in 1198 bytes} [Mon Jul 11 14:25:22 2022] GET /identity/v3/users/c2bda2fc12a24c48ba42c84873d8bfa1 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:25:24.359370 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43715290-d201-4e4e-ad05-960c9f65f241 None None] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:24.360186 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43715290-d201-4e4e-ad05-960c9f65f241 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:24.360186 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43715290-d201-4e4e-ad05-960c9f65f241 None None] PATH_INFO: `/` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:24.361287 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 6/10] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:25:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 14:25:24.368053 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0d3738-7da6-47e8-9753-cb39a40867cd None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:24.368602 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0d3738-7da6-47e8-9753-cb39a40867cd None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:24.369108 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0d3738-7da6-47e8-9753-cb39a40867cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:24.391476 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-fe0d3738-7da6-47e8-9753-cb39a40867cd None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:25:24.392914 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-fe0d3738-7da6-47e8-9753-cb39a40867cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:24.432110 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0aec16-7bc9-4601-9505-f94659ea5f3e None None] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:24.432610 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0aec16-7bc9-4601-9505-f94659ea5f3e None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:24.433080 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0aec16-7bc9-4601-9505-f94659ea5f3e None None] PATH_INFO: `/` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:24.435756 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 7/11] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:25:24 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:25:24.444874 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b57796b-e1b1-4906-ad60-f70f19ca6dec None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:24.445377 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b57796b-e1b1-4906-ad60-f70f19ca6dec None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:24.445854 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b57796b-e1b1-4906-ad60-f70f19ca6dec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:24.483858 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 5/12] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:25:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:25:24.508138 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0d3738-7da6-47e8-9753-cb39a40867cd None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:24.520657 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG passlib.handlers.bcrypt [None req-9b57796b-e1b1-4906-ad60-f70f19ca6dec None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80534) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 11 14:25:24.521333 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG passlib.handlers.bcrypt [None req-9b57796b-e1b1-4906-ad60-f70f19ca6dec None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80534) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 11 14:25:24.533694 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:24.575766 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-9b57796b-e1b1-4906-ad60-f70f19ca6dec None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:25:24.578553 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-9b57796b-e1b1-4906-ad60-f70f19ca6dec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:24.629300 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0d3738-7da6-47e8-9753-cb39a40867cd None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:24.688858 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc869d7-b196-4b5c-8d41-186b3863c458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:24.690216 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc869d7-b196-4b5c-8d41-186b3863c458 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:24.690725 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc869d7-b196-4b5c-8d41-186b3863c458 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:24.691213 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc869d7-b196-4b5c-8d41-186b3863c458 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:24.697973 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 8/13] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:25:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 14:25:24.713019 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc869d7-b196-4b5c-8d41-186b3863c458 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:25:24.720945 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b57796b-e1b1-4906-ad60-f70f19ca6dec None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:24.734026 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-4cc869d7-b196-4b5c-8d41-186b3863c458 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:25:24.734026 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:25:24.734026 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:25:24.734026 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:25:24.734026 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:25:24.734026 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:25:24.734026 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:25:24.734026 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:25:24.734026 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:25:24.734026 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:25:24.734026 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:25:24.734026 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:25:24.734026 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:25:24.734026 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:25:24.734026 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:25:24.734026 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:25:24.735059 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:25:24.735059 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:25:24.735059 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:25:24.735059 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:25:24.735059 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:25:24.735059 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:25:24.735059 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:25:24.735059 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:25:24.735059 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:25:24.735059 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:25:24.735059 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:25:24.735059 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( Jul 11 14:25:24.735059 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:25:24.735059 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:25:24.735059 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:25:24.735059 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:25:24.735872 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:25:24.735872 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:25:24.735872 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:25:24.735872 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:25:24.735872 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:25:24.735872 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:25:24.735872 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:25:24.735872 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:25:24.735872 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:25:24.735872 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:25:24.735872 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:25:24.735872 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Jul 11 14:25:24.735872 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 6/14] 10.222.0.70 () {56 vars in 1096 bytes} [Mon Jul 11 14:25:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:25:24.744958 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc869d7-b196-4b5c-8d41-186b3863c458 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:24.838664 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b57796b-e1b1-4906-ad60-f70f19ca6dec None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:24.841999 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:24.858310 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:24.880240 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc869d7-b196-4b5c-8d41-186b3863c458 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:24.888827 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2b5153-e727-49c1-83be-6783f71b9668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:24.890232 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2b5153-e727-49c1-83be-6783f71b9668 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:24.890673 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2b5153-e727-49c1-83be-6783f71b9668 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:24.891113 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2b5153-e727-49c1-83be-6783f71b9668 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:24.918994 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80ed24d-9d9a-4f6d-8a0f-ab05d5273367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:24.919676 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80ed24d-9d9a-4f6d-8a0f-ab05d5273367 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:24.919957 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80ed24d-9d9a-4f6d-8a0f-ab05d5273367 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:24.920255 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80ed24d-9d9a-4f6d-8a0f-ab05d5273367 None admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:24.921018 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80ed24d-9d9a-4f6d-8a0f-ab05d5273367 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:25:24.921324 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80ed24d-9d9a-4f6d-8a0f-ab05d5273367 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:24.922735 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80ed24d-9d9a-4f6d-8a0f-ab05d5273367 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:24.935736 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 7/15] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Jul 11 14:25:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:25:24.941280 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80ed24d-9d9a-4f6d-8a0f-ab05d5273367 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:24.999380 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2b5153-e727-49c1-83be-6783f71b9668 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:25.001340 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2b5153-e727-49c1-83be-6783f71b9668 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:25.092848 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80ed24d-9d9a-4f6d-8a0f-ab05d5273367 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:25.107199 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 9/16] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Jul 11 14:25:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 11 14:25:25.115964 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2b5153-e727-49c1-83be-6783f71b9668 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:25.120013 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:25.139225 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6110dd15-a5ba-4d67-a481-bc5255925402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:25.140023 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6110dd15-a5ba-4d67-a481-bc5255925402 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:25.140333 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6110dd15-a5ba-4d67-a481-bc5255925402 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:25.140608 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6110dd15-a5ba-4d67-a481-bc5255925402 None admin] PATH_INFO: `/v3/users/c2bda2fc12a24c48ba42c84873d8bfa1` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:25.141908 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6110dd15-a5ba-4d67-a481-bc5255925402 None admin] RBAC: Authorizing `identity:get_user(user_id=c2bda2fc12a24c48ba42c84873d8bfa1)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:25.143284 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6110dd15-a5ba-4d67-a481-bc5255925402 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:25.145146 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 8/17] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Jul 11 14:25:24 2022] GET /identity/v3/users/c2bda2fc12a24c48ba42c84873d8bfa1 => generated 247 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:25:25.154341 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6110dd15-a5ba-4d67-a481-bc5255925402 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:25.172036 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:25.272835 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6110dd15-a5ba-4d67-a481-bc5255925402 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:25.278276 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2b5153-e727-49c1-83be-6783f71b9668 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:25.314384 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ed19e7-d397-4e7a-88b5-f96d749d43a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:25.315400 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8e7881-6761-4fbf-94cd-79969a4d1e51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:25.315700 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ed19e7-d397-4e7a-88b5-f96d749d43a7 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:25.315859 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ed19e7-d397-4e7a-88b5-f96d749d43a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:25.316241 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ed19e7-d397-4e7a-88b5-f96d749d43a7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:25.316393 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8e7881-6761-4fbf-94cd-79969a4d1e51 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:25.316710 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8e7881-6761-4fbf-94cd-79969a4d1e51 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:25.317077 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8e7881-6761-4fbf-94cd-79969a4d1e51 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:25.317846 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ed19e7-d397-4e7a-88b5-f96d749d43a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:25.319405 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ed19e7-d397-4e7a-88b5-f96d749d43a7 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:25.321449 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 9/18] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 11 14:25:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:25:25.328433 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ed19e7-d397-4e7a-88b5-f96d749d43a7 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:25.341016 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8e7881-6761-4fbf-94cd-79969a4d1e51 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:25.342491 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8e7881-6761-4fbf-94cd-79969a4d1e51 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:25.365857 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application [None req-ba8e7881-6761-4fbf-94cd-79969a4d1e51 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:25:25.365857 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:25:25.365857 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:25:25.365857 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:25:25.365857 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:25:25.365857 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:25:25.365857 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:25:25.365857 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:25:25.365857 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:25:25.365857 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:25:25.365857 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:25:25.365857 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:25:25.365857 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:25:25.365857 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:25:25.365857 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:25:25.368141 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:25:25.368141 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:25:25.368141 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:25:25.368141 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:25:25.368141 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:25:25.368141 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:25:25.368141 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:25:25.368141 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:25:25.368141 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application with Lock( Jul 11 14:25:25.368141 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:25:25.368141 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:25:25.368141 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:25:25.368141 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:25:25.368141 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:25:25.368141 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:25:25.368141 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:25:25.368141 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:25:25.369017 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:25:25.369017 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:25:25.369017 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:25:25.369017 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Jul 11 14:25:25.369017 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 10/19] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 11 14:25:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:25:25.374454 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8e7881-6761-4fbf-94cd-79969a4d1e51 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:25.428858 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:25.449458 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:25.462508 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ed19e7-d397-4e7a-88b5-f96d749d43a7 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:25.504939 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8e7881-6761-4fbf-94cd-79969a4d1e51 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:25.506429 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05321f1-9e07-4dd7-8f38-ccd0e8a6da0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:25.507472 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05321f1-9e07-4dd7-8f38-ccd0e8a6da0e None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:25.507937 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05321f1-9e07-4dd7-8f38-ccd0e8a6da0e None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:25.508442 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05321f1-9e07-4dd7-8f38-ccd0e8a6da0e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:25.509480 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05321f1-9e07-4dd7-8f38-ccd0e8a6da0e None admin] RBAC: Adding query filter params (role.id=b46df176b0fe479da63c318db225bed4, scope.domain.id=default, user.id=c2bda2fc12a24c48ba42c84873d8bfa1) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:25:25.509930 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05321f1-9e07-4dd7-8f38-ccd0e8a6da0e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:25.511501 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05321f1-9e07-4dd7-8f38-ccd0e8a6da0e None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:25.519843 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 10/20] 10.222.0.70 () {56 vars in 1322 bytes} [Mon Jul 11 14:25:25 2022] GET /identity/v3/role_assignments?user.id=c2bda2fc12a24c48ba42c84873d8bfa1&scope.domain.id=default&role.id=b46df176b0fe479da63c318db225bed4 => generated 233 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:25:25.547884 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dce7929-7a41-431f-963a-80152e49ecf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:25.548700 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dce7929-7a41-431f-963a-80152e49ecf5 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:25.549089 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dce7929-7a41-431f-963a-80152e49ecf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:25.549433 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dce7929-7a41-431f-963a-80152e49ecf5 None admin] PATH_INFO: `/v3/domains` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:25.550417 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dce7929-7a41-431f-963a-80152e49ecf5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:25:25.550796 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dce7929-7a41-431f-963a-80152e49ecf5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:25.552375 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dce7929-7a41-431f-963a-80152e49ecf5 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:25.583516 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 11/21] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jul 11 14:25:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:25:29.295213 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35d8635-b565-4d11-8336-8292ebd64d2a None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:29.296810 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35d8635-b565-4d11-8336-8292ebd64d2a None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:29.297591 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35d8635-b565-4d11-8336-8292ebd64d2a None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:29.300382 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 11/22] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:25:29 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:25:29.311334 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb22a405-0008-4325-8e5c-a7b834d0aa95 None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:29.312103 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb22a405-0008-4325-8e5c-a7b834d0aa95 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:29.312362 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb22a405-0008-4325-8e5c-a7b834d0aa95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:29.350254 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-cb22a405-0008-4325-8e5c-a7b834d0aa95 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:25:29.353433 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-cb22a405-0008-4325-8e5c-a7b834d0aa95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:29.510723 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 12/23] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:25:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:25:29.546488 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35d8635-b565-4d11-8336-8292ebd64d2a None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:29.633037 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f54e49-39da-4798-a944-ec9666e11524 None None] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:29.634073 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f54e49-39da-4798-a944-ec9666e11524 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:29.634532 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f54e49-39da-4798-a944-ec9666e11524 None None] PATH_INFO: `/` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:29.641444 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 13/24] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:25:29 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 14:25:29.655964 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b603e1ab-40d5-49e0-b7ee-93920363d5f5 None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:29.656479 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b603e1ab-40d5-49e0-b7ee-93920363d5f5 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:29.656932 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b603e1ab-40d5-49e0-b7ee-93920363d5f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:29.714136 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-b603e1ab-40d5-49e0-b7ee-93920363d5f5 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:25:29.716390 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-b603e1ab-40d5-49e0-b7ee-93920363d5f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:29.820750 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35d8635-b565-4d11-8336-8292ebd64d2a None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:29.877338 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:29.922187 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d1f251-602e-424c-8ba1-b1903523b4bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:29.923824 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d1f251-602e-424c-8ba1-b1903523b4bd None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:29.924545 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d1f251-602e-424c-8ba1-b1903523b4bd None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:29.925310 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d1f251-602e-424c-8ba1-b1903523b4bd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:29.927108 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 14/25] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:25:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jul 11 14:25:29.929830 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e167afd1-461f-4707-a3fc-13bed4b42c0c None None] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:29.931531 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e167afd1-461f-4707-a3fc-13bed4b42c0c None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:29.932309 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e167afd1-461f-4707-a3fc-13bed4b42c0c None None] PATH_INFO: `/` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:29.935767 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 15/26] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:25:29 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:25:29.938505 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1fc6e8-e591-411f-8f19-b2be4b521aa4 None None] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:29.939293 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1fc6e8-e591-411f-8f19-b2be4b521aa4 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:29.940014 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1fc6e8-e591-411f-8f19-b2be4b521aa4 None None] PATH_INFO: `/` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:29.943308 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 16/27] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:25:29 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:25:29.948745 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d1f251-602e-424c-8ba1-b1903523b4bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:25:29.951261 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856fba95-dab2-4361-ad5f-72a0dc790e45 None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:29.952044 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856fba95-dab2-4361-ad5f-72a0dc790e45 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:29.952776 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856fba95-dab2-4361-ad5f-72a0dc790e45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:29.965374 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-64d1f251-602e-424c-8ba1-b1903523b4bd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:25:29.965374 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:25:29.965374 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:25:29.965374 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:25:29.965374 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:25:29.965374 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:25:29.965374 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:25:29.965374 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:25:29.965374 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:25:29.965374 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:25:29.965374 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:25:29.965374 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:25:29.965374 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:25:29.965374 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:25:29.965374 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:25:29.965374 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:25:29.967069 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:25:29.967069 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:25:29.967069 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:25:29.967069 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:25:29.967069 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:25:29.967069 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:25:29.967069 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:25:29.967069 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:25:29.967069 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:25:29.967069 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:25:29.967069 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:25:29.967069 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( Jul 11 14:25:29.967069 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:25:29.967069 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:25:29.967069 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:25:29.967069 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:25:29.968605 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:25:29.968605 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:25:29.968605 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:25:29.968605 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:25:29.968605 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:25:29.968605 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:25:29.968605 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:25:29.968605 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:25:29.968605 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:25:29.968605 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:25:29.968605 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:25:29.968605 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Jul 11 14:25:29.968605 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 12/28] 10.222.0.70 () {56 vars in 1096 bytes} [Mon Jul 11 14:25:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 422 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:25:29.970246 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ca789f-1005-4b1d-b7d7-a1613f764071 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:29.970246 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ca789f-1005-4b1d-b7d7-a1613f764071 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:29.970715 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ca789f-1005-4b1d-b7d7-a1613f764071 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:29.995798 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:30.002271 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-856fba95-dab2-4361-ad5f-72a0dc790e45 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:25:30.004585 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-856fba95-dab2-4361-ad5f-72a0dc790e45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:30.020463 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-12ca789f-1005-4b1d-b7d7-a1613f764071 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:25:30.021760 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-12ca789f-1005-4b1d-b7d7-a1613f764071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:30.132504 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 13/29] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:25:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:25:30.134344 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ca789f-1005-4b1d-b7d7-a1613f764071 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:30.136564 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 17/30] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:25:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:25:30.137688 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856fba95-dab2-4361-ad5f-72a0dc790e45 None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:30.275481 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ca789f-1005-4b1d-b7d7-a1613f764071 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:30.316739 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c6dbe3-7443-43fe-ae69-d15f3f997714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:30.318265 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c6dbe3-7443-43fe-ae69-d15f3f997714 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:30.318776 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c6dbe3-7443-43fe-ae69-d15f3f997714 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:30.319251 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c6dbe3-7443-43fe-ae69-d15f3f997714 None admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:30.320332 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c6dbe3-7443-43fe-ae69-d15f3f997714 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:25:30.321427 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c6dbe3-7443-43fe-ae69-d15f3f997714 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:30.323460 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c6dbe3-7443-43fe-ae69-d15f3f997714 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:30.325468 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:30.336656 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 14/31] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Jul 11 14:25:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:25:30.338456 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c6dbe3-7443-43fe-ae69-d15f3f997714 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:30.358936 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856fba95-dab2-4361-ad5f-72a0dc790e45 None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:30.369254 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:30.425311 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67deab8-0506-4093-b923-1dd9caddafd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:30.426804 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67deab8-0506-4093-b923-1dd9caddafd6 None admin] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:30.427492 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67deab8-0506-4093-b923-1dd9caddafd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:30.428150 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67deab8-0506-4093-b923-1dd9caddafd6 None admin] PATH_INFO: `/v3/roles` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:30.429688 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67deab8-0506-4093-b923-1dd9caddafd6 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:30.432855 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67deab8-0506-4093-b923-1dd9caddafd6 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:30.580689 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c6dbe3-7443-43fe-ae69-d15f3f997714 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:30.652274 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc07a79e-6492-4b94-a961-c48e1563d668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:30.653893 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc07a79e-6492-4b94-a961-c48e1563d668 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:30.654641 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc07a79e-6492-4b94-a961-c48e1563d668 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:30.655260 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc07a79e-6492-4b94-a961-c48e1563d668 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:30.672662 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 18/32] 10.222.0.70 () {60 vars in 1131 bytes} [Mon Jul 11 14:25:30 2022] POST /identity/v3/roles => generated 219 bytes in 535 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:25:30.674886 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67deab8-0506-4093-b923-1dd9caddafd6 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:30.677409 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc07a79e-6492-4b94-a961-c48e1563d668 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:30.682208 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc07a79e-6492-4b94-a961-c48e1563d668 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:30.723533 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-fc07a79e-6492-4b94-a961-c48e1563d668 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:25:30.723533 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:25:30.723533 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:25:30.723533 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:25:30.723533 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:25:30.723533 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:25:30.723533 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:25:30.723533 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:25:30.723533 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:25:30.723533 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:25:30.723533 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:25:30.723533 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:25:30.723533 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:25:30.723533 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:25:30.723533 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:25:30.725438 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:25:30.725438 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:25:30.725438 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:25:30.725438 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:25:30.725438 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:25:30.725438 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:25:30.725438 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:25:30.725438 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:25:30.725438 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( Jul 11 14:25:30.725438 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:25:30.725438 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:25:30.725438 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:25:30.725438 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:25:30.725438 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:25:30.725438 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:25:30.725438 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:25:30.725438 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:25:30.726988 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:25:30.726988 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:25:30.726988 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:25:30.726988 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Jul 11 14:25:30.731305 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 15/33] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 11 14:25:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 393 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:25:30.733155 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc07a79e-6492-4b94-a961-c48e1563d668 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:30.848769 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:31.004344 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67deab8-0506-4093-b923-1dd9caddafd6 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:31.020935 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc07a79e-6492-4b94-a961-c48e1563d668 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:31.093517 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c94845-d0b8-4007-8eca-0655e573307f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:31.094659 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c94845-d0b8-4007-8eca-0655e573307f None admin] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:31.095152 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c94845-d0b8-4007-8eca-0655e573307f None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:31.095641 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c94845-d0b8-4007-8eca-0655e573307f None admin] PATH_INFO: `/v3/roles` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:31.097029 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c94845-d0b8-4007-8eca-0655e573307f None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:31.097389 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f9fe32-42f1-4c2c-ac63-7946621a5325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:31.099058 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f9fe32-42f1-4c2c-ac63-7946621a5325 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:31.099680 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f9fe32-42f1-4c2c-ac63-7946621a5325 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:31.099838 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c94845-d0b8-4007-8eca-0655e573307f None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:31.100426 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f9fe32-42f1-4c2c-ac63-7946621a5325 None admin] PATH_INFO: `/v3/users/c2bda2fc12a24c48ba42c84873d8bfa1` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:31.103811 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f9fe32-42f1-4c2c-ac63-7946621a5325 None admin] RBAC: Authorizing `identity:get_user(user_id=c2bda2fc12a24c48ba42c84873d8bfa1)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:31.106525 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f9fe32-42f1-4c2c-ac63-7946621a5325 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:31.109886 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 16/34] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Jul 11 14:25:30 2022] GET /identity/v3/users/c2bda2fc12a24c48ba42c84873d8bfa1 => generated 247 bytes in 377 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:25:31.111340 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f9fe32-42f1-4c2c-ac63-7946621a5325 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:31.132581 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 19/35] 10.222.0.70 () {60 vars in 1131 bytes} [Mon Jul 11 14:25:30 2022] POST /identity/v3/roles => generated 225 bytes in 459 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:25:31.135936 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c94845-d0b8-4007-8eca-0655e573307f None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:31.196669 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:31.321058 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f9fe32-42f1-4c2c-ac63-7946621a5325 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:31.356039 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:31.362287 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c94845-d0b8-4007-8eca-0655e573307f None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:31.400880 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea3d571-82c3-4241-af1f-2339230ed674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:31.401717 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea3d571-82c3-4241-af1f-2339230ed674 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:31.402321 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea3d571-82c3-4241-af1f-2339230ed674 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:31.402899 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea3d571-82c3-4241-af1f-2339230ed674 None admin] PATH_INFO: `/v3/domains` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:31.404329 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea3d571-82c3-4241-af1f-2339230ed674 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:25:31.404940 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea3d571-82c3-4241-af1f-2339230ed674 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:31.407778 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea3d571-82c3-4241-af1f-2339230ed674 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:31.441727 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2659cb-0d33-4548-9aeb-ad0619f1ed21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:31.443707 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2659cb-0d33-4548-9aeb-ad0619f1ed21 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:31.444518 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2659cb-0d33-4548-9aeb-ad0619f1ed21 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:31.445344 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2659cb-0d33-4548-9aeb-ad0619f1ed21 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:31.454220 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2659cb-0d33-4548-9aeb-ad0619f1ed21 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:31.457728 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2659cb-0d33-4548-9aeb-ad0619f1ed21 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:31.461286 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 17/36] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jul 11 14:25:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:25:31.463626 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 20/37] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 11 14:25:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:25:31.470864 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea3d571-82c3-4241-af1f-2339230ed674 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:31.473409 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2659cb-0d33-4548-9aeb-ad0619f1ed21 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:31.685547 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea3d571-82c3-4241-af1f-2339230ed674 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:31.708013 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:31.719386 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2659cb-0d33-4548-9aeb-ad0619f1ed21 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:31.740619 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9e2311-22d2-4347-b7f4-1494f662cc80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:31.741439 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9e2311-22d2-4347-b7f4-1494f662cc80 None admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:31.741705 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9e2311-22d2-4347-b7f4-1494f662cc80 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:31.741993 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9e2311-22d2-4347-b7f4-1494f662cc80 None admin] PATH_INFO: `/v3/projects` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:31.743058 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9e2311-22d2-4347-b7f4-1494f662cc80 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:31.744987 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9e2311-22d2-4347-b7f4-1494f662cc80 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:31.789064 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec27a192-0bf2-4ecf-b6be-f32b716c2dac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:31.791579 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec27a192-0bf2-4ecf-b6be-f32b716c2dac None admin] REQUEST_METHOD: `PUT` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:31.792105 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec27a192-0bf2-4ecf-b6be-f32b716c2dac None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:31.792684 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec27a192-0bf2-4ecf-b6be-f32b716c2dac None admin] PATH_INFO: `/v3/domains/default/users/c2bda2fc12a24c48ba42c84873d8bfa1/roles/b46df176b0fe479da63c318db225bed4` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:31.796912 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec27a192-0bf2-4ecf-b6be-f32b716c2dac None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=c2bda2fc12a24c48ba42c84873d8bfa1, role_id=b46df176b0fe479da63c318db225bed4)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:31.799634 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec27a192-0bf2-4ecf-b6be-f32b716c2dac None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:31.840388 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 21/38] 10.222.0.70 () {58 vars in 1361 bytes} [Mon Jul 11 14:25:31 2022] PUT /identity/v3/domains/default/users/c2bda2fc12a24c48ba42c84873d8bfa1/roles/b46df176b0fe479da63c318db225bed4 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:25:31.840388 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153c2035-801d-4a6b-99a1-c17d534e94ab None None] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:31.840388 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153c2035-801d-4a6b-99a1-c17d534e94ab None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:31.840388 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153c2035-801d-4a6b-99a1-c17d534e94ab None None] PATH_INFO: `/` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:31.840962 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 22/39] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:25:31 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:25:31.851198 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b938f0e0-b466-4ca5-9925-2dbefc7cbee9 None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:31.852833 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b938f0e0-b466-4ca5-9925-2dbefc7cbee9 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:31.853649 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b938f0e0-b466-4ca5-9925-2dbefc7cbee9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:31.887636 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-b938f0e0-b466-4ca5-9925-2dbefc7cbee9 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:25:31.891150 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-b938f0e0-b466-4ca5-9925-2dbefc7cbee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:32.045944 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 23/40] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:25:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 14:25:32.080300 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50596b8d-ab0b-4e44-851b-ecb1d1687432 None None] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:32.081460 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50596b8d-ab0b-4e44-851b-ecb1d1687432 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:32.082244 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50596b8d-ab0b-4e44-851b-ecb1d1687432 None None] PATH_INFO: `/` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:32.084418 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 24/41] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:25:32 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 14:25:32.086232 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50596b8d-ab0b-4e44-851b-ecb1d1687432 None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:32.105317 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 18/42] 10.222.0.70 () {60 vars in 1141 bytes} [Mon Jul 11 14:25:31 2022] POST /identity/v3/projects => generated 301 bytes in 635 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:25:32.107685 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a8b12f-b34a-4706-8e4b-5e3fa4a2a69d None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:32.108190 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a8b12f-b34a-4706-8e4b-5e3fa4a2a69d None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:32.108722 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a8b12f-b34a-4706-8e4b-5e3fa4a2a69d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:32.136032 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-07a8b12f-b34a-4706-8e4b-5e3fa4a2a69d None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:25:32.138041 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-07a8b12f-b34a-4706-8e4b-5e3fa4a2a69d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:32.196181 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:32.283440 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:32.311472 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 19/43] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:25:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:25:32.321655 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50596b8d-ab0b-4e44-851b-ecb1d1687432 None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:32.358211 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a8b12f-b34a-4706-8e4b-5e3fa4a2a69d None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:32.394348 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bba085-63b3-4ec7-a19b-953d2dc2701a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:32.395569 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bba085-63b3-4ec7-a19b-953d2dc2701a None admin] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:32.396088 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bba085-63b3-4ec7-a19b-953d2dc2701a None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:32.396622 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bba085-63b3-4ec7-a19b-953d2dc2701a None admin] PATH_INFO: `/v3/roles` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:32.398133 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bba085-63b3-4ec7-a19b-953d2dc2701a None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:32.401057 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bba085-63b3-4ec7-a19b-953d2dc2701a None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:32.424772 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 25/44] 10.222.0.70 () {60 vars in 1131 bytes} [Mon Jul 11 14:25:32 2022] POST /identity/v3/roles => generated 223 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:25:32.519023 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a8b12f-b34a-4706-8e4b-5e3fa4a2a69d None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:32.565389 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8cee74-a1c5-4e44-b507-474c72996b4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:32.566775 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8cee74-a1c5-4e44-b507-474c72996b4d None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:32.567263 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8cee74-a1c5-4e44-b507-474c72996b4d None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:32.567719 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8cee74-a1c5-4e44-b507-474c72996b4d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:32.569972 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8cee74-a1c5-4e44-b507-474c72996b4d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:32.574433 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8cee74-a1c5-4e44-b507-474c72996b4d None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:32.577098 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 20/45] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 11 14:25:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:25:32.586154 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bba085-63b3-4ec7-a19b-953d2dc2701a None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:32.743769 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bba085-63b3-4ec7-a19b-953d2dc2701a None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:32.788615 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be921d2-76c8-4080-8d06-083a19cf9662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:32.789422 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be921d2-76c8-4080-8d06-083a19cf9662 None admin] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:32.789874 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be921d2-76c8-4080-8d06-083a19cf9662 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:32.790346 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be921d2-76c8-4080-8d06-083a19cf9662 None admin] PATH_INFO: `/v3/projects` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:32.791177 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be921d2-76c8-4080-8d06-083a19cf9662 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:32.792806 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be921d2-76c8-4080-8d06-083a19cf9662 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:32.812627 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:32.828518 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 26/46] 10.222.0.70 () {60 vars in 1141 bytes} [Mon Jul 11 14:25:32 2022] POST /identity/v3/projects => generated 312 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:25:34.573322 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e739c280-046a-4826-aabc-1e97eea806f1 None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:34.574135 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e739c280-046a-4826-aabc-1e97eea806f1 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:34.574135 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e739c280-046a-4826-aabc-1e97eea806f1 None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:34.575576 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 21/47] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:25:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:25:34.582017 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70093a5-9b7e-46cb-89e1-6ab29e2a4799 None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:34.582647 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70093a5-9b7e-46cb-89e1-6ab29e2a4799 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:34.583227 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70093a5-9b7e-46cb-89e1-6ab29e2a4799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:34.612820 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-e70093a5-9b7e-46cb-89e1-6ab29e2a4799 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:25:34.614918 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-e70093a5-9b7e-46cb-89e1-6ab29e2a4799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:34.738726 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 27/48] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:25:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:25:34.764479 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e739c280-046a-4826-aabc-1e97eea806f1 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:34.797206 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:34.906777 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e739c280-046a-4826-aabc-1e97eea806f1 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:34.949207 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd24027-4bf0-4539-83ff-468b229d5e49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:34.950006 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd24027-4bf0-4539-83ff-468b229d5e49 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:34.950286 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd24027-4bf0-4539-83ff-468b229d5e49 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:34.950561 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd24027-4bf0-4539-83ff-468b229d5e49 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:34.962882 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd24027-4bf0-4539-83ff-468b229d5e49 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:25:34.970708 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-6fd24027-4bf0-4539-83ff-468b229d5e49 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:25:34.970708 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:25:34.970708 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:25:34.970708 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:25:34.970708 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:25:34.970708 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:25:34.970708 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:25:34.970708 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:25:34.970708 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:25:34.970708 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:25:34.970708 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:25:34.970708 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:25:34.970708 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:25:34.970708 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:25:34.970708 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:25:34.970708 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:25:34.972759 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:25:34.972759 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:25:34.972759 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:25:34.972759 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:25:34.972759 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:25:34.972759 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:25:34.972759 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:25:34.972759 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:25:34.972759 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:25:34.972759 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:25:34.972759 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:25:34.972759 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( Jul 11 14:25:34.972759 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:25:34.972759 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:25:34.972759 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:25:34.972759 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:25:34.974348 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:25:34.974348 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:25:34.974348 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:25:34.974348 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:25:34.974348 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:25:34.974348 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:25:34.974348 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:25:34.974348 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:25:34.974348 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:25:34.974348 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:25:34.974348 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:25:34.974348 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Jul 11 14:25:34.974348 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 22/49] 10.222.0.70 () {56 vars in 1096 bytes} [Mon Jul 11 14:25:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:25:34.979484 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70093a5-9b7e-46cb-89e1-6ab29e2a4799 None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:35.331250 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70093a5-9b7e-46cb-89e1-6ab29e2a4799 None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:35.384365 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:35.395954 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ac36f4-7ac2-4b69-b2e6-58bb00c912d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:35.396896 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ac36f4-7ac2-4b69-b2e6-58bb00c912d8 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:35.397268 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ac36f4-7ac2-4b69-b2e6-58bb00c912d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:35.397635 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ac36f4-7ac2-4b69-b2e6-58bb00c912d8 None admin] PATH_INFO: `/v3/roles` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:35.398498 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ac36f4-7ac2-4b69-b2e6-58bb00c912d8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:25:35.398933 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ac36f4-7ac2-4b69-b2e6-58bb00c912d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:35.400501 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ac36f4-7ac2-4b69-b2e6-58bb00c912d8 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:35.413958 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 28/50] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Jul 11 14:25:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 436 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:25:35.423997 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd24027-4bf0-4539-83ff-468b229d5e49 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:35.440651 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078b4f2b-ba15-4e5a-99c8-df5f0e1a3f9c None None] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:35.441673 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078b4f2b-ba15-4e5a-99c8-df5f0e1a3f9c None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:35.442019 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078b4f2b-ba15-4e5a-99c8-df5f0e1a3f9c None None] PATH_INFO: `/` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:35.443521 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 29/51] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:25:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 14:25:35.450012 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8fc3e1-7085-473c-95c8-ccf7fb1c896b None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:35.450298 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8fc3e1-7085-473c-95c8-ccf7fb1c896b None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:35.450579 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8fc3e1-7085-473c-95c8-ccf7fb1c896b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:35.468449 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-0d8fc3e1-7085-473c-95c8-ccf7fb1c896b None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:25:35.469980 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-0d8fc3e1-7085-473c-95c8-ccf7fb1c896b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:35.576503 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:35.596537 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 30/52] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:25:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 14:25:35.598733 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd24027-4bf0-4539-83ff-468b229d5e49 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:35.625483 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8fc3e1-7085-473c-95c8-ccf7fb1c896b None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:35.645720 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a53d508-56c6-4a72-815f-5249595b6534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:35.646790 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a53d508-56c6-4a72-815f-5249595b6534 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:35.647162 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a53d508-56c6-4a72-815f-5249595b6534 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:35.647525 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a53d508-56c6-4a72-815f-5249595b6534 None admin] PATH_INFO: `/v3/users/c2bda2fc12a24c48ba42c84873d8bfa1` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:35.649128 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a53d508-56c6-4a72-815f-5249595b6534 None admin] RBAC: Authorizing `identity:get_user(user_id=c2bda2fc12a24c48ba42c84873d8bfa1)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:35.651046 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a53d508-56c6-4a72-815f-5249595b6534 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:35.653158 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 23/53] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Jul 11 14:25:35 2022] GET /identity/v3/users/c2bda2fc12a24c48ba42c84873d8bfa1 => generated 247 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:25:35.661737 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a53d508-56c6-4a72-815f-5249595b6534 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:35.767519 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8fc3e1-7085-473c-95c8-ccf7fb1c896b None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:35.795977 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:35.819911 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e327f946-b292-4058-9310-31ced2f1d0c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:35.821034 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e327f946-b292-4058-9310-31ced2f1d0c4 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:35.821410 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e327f946-b292-4058-9310-31ced2f1d0c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:35.821885 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e327f946-b292-4058-9310-31ced2f1d0c4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:35.823234 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a53d508-56c6-4a72-815f-5249595b6534 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:35.823448 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e327f946-b292-4058-9310-31ced2f1d0c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:35.825123 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e327f946-b292-4058-9310-31ced2f1d0c4 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:35.827536 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 31/54] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 11 14:25:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:25:35.837847 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e327f946-b292-4058-9310-31ced2f1d0c4 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:35.880448 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f820a17f-7c9f-4090-8c1f-ce1e30b1c377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:35.881409 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f820a17f-7c9f-4090-8c1f-ce1e30b1c377 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:35.881850 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f820a17f-7c9f-4090-8c1f-ce1e30b1c377 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:35.882223 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f820a17f-7c9f-4090-8c1f-ce1e30b1c377 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:35.884625 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f820a17f-7c9f-4090-8c1f-ce1e30b1c377 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:35.886531 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f820a17f-7c9f-4090-8c1f-ce1e30b1c377 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:35.888466 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 24/55] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 11 14:25:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:25:35.897583 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f820a17f-7c9f-4090-8c1f-ce1e30b1c377 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:35.932196 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:35.978606 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e327f946-b292-4058-9310-31ced2f1d0c4 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:36.029530 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318558ab-ab86-43a7-a133-5149bfee9037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:36.030403 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318558ab-ab86-43a7-a133-5149bfee9037 None admin] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:36.030773 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318558ab-ab86-43a7-a133-5149bfee9037 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:36.031199 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318558ab-ab86-43a7-a133-5149bfee9037 None admin] PATH_INFO: `/v3/projects` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:36.032033 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318558ab-ab86-43a7-a133-5149bfee9037 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:36.033718 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318558ab-ab86-43a7-a133-5149bfee9037 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:36.039690 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f820a17f-7c9f-4090-8c1f-ce1e30b1c377 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:36.084249 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 32/56] 10.222.0.70 () {60 vars in 1140 bytes} [Mon Jul 11 14:25:35 2022] POST /identity/v3/projects => generated 298 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:25:36.087966 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab24600-2a0f-4e4a-95c2-987164f068d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:36.088677 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab24600-2a0f-4e4a-95c2-987164f068d5 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:36.088961 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab24600-2a0f-4e4a-95c2-987164f068d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:36.089239 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab24600-2a0f-4e4a-95c2-987164f068d5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:36.090109 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab24600-2a0f-4e4a-95c2-987164f068d5 None admin] RBAC: Adding query filter params (role.id=b46df176b0fe479da63c318db225bed4, scope.domain.id=default, user.id=c2bda2fc12a24c48ba42c84873d8bfa1) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:25:36.090426 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab24600-2a0f-4e4a-95c2-987164f068d5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:36.091940 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab24600-2a0f-4e4a-95c2-987164f068d5 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:36.098920 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 25/57] 10.222.0.70 () {56 vars in 1322 bytes} [Mon Jul 11 14:25:35 2022] GET /identity/v3/role_assignments?user.id=c2bda2fc12a24c48ba42c84873d8bfa1&scope.domain.id=default&role.id=b46df176b0fe479da63c318db225bed4 => generated 530 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:25:38.310244 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db58d14-47f6-4468-a9e7-17b7f31b3b42 None None] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:38.311043 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db58d14-47f6-4468-a9e7-17b7f31b3b42 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:38.311229 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db58d14-47f6-4468-a9e7-17b7f31b3b42 None None] PATH_INFO: `/` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:38.313867 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 33/58] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:25:38 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:25:38.319969 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fb73e2-c01b-4e8d-b3fa-8e5a6bf8bf1b None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:38.320578 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fb73e2-c01b-4e8d-b3fa-8e5a6bf8bf1b None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:38.320648 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fb73e2-c01b-4e8d-b3fa-8e5a6bf8bf1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:38.340357 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-73fb73e2-c01b-4e8d-b3fa-8e5a6bf8bf1b None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:25:38.341617 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-73fb73e2-c01b-4e8d-b3fa-8e5a6bf8bf1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:38.419259 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 26/59] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:25:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:25:38.444718 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db58d14-47f6-4468-a9e7-17b7f31b3b42 None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:38.494644 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:38.567963 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db58d14-47f6-4468-a9e7-17b7f31b3b42 None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:38.609365 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c11d4b0-1bee-413f-86c9-cf1a31409206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:38.610183 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c11d4b0-1bee-413f-86c9-cf1a31409206 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:38.610468 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c11d4b0-1bee-413f-86c9-cf1a31409206 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:38.610747 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c11d4b0-1bee-413f-86c9-cf1a31409206 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:38.612107 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c11d4b0-1bee-413f-86c9-cf1a31409206 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:38.613628 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c11d4b0-1bee-413f-86c9-cf1a31409206 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:38.615356 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 34/60] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 11 14:25:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:25:38.621845 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fb73e2-c01b-4e8d-b3fa-8e5a6bf8bf1b None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:38.641603 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:38.751659 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fb73e2-c01b-4e8d-b3fa-8e5a6bf8bf1b None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:38.792190 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3280dd05-0e3c-4061-b65b-bf9e5d94570a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:38.792918 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3280dd05-0e3c-4061-b65b-bf9e5d94570a None admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:38.793203 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3280dd05-0e3c-4061-b65b-bf9e5d94570a None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:38.793481 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3280dd05-0e3c-4061-b65b-bf9e5d94570a None admin] PATH_INFO: `/v3/users` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:38.794230 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3280dd05-0e3c-4061-b65b-bf9e5d94570a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:38.795724 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3280dd05-0e3c-4061-b65b-bf9e5d94570a None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:38.828459 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 27/61] 10.222.0.70 () {60 vars in 1132 bytes} [Mon Jul 11 14:25:38 2022] POST /identity/v3/users => generated 275 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:25:42.488610 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4231a9b-d5d6-41e3-9434-d9779d4dc38c None None] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:42.490226 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4231a9b-d5d6-41e3-9434-d9779d4dc38c None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:42.490723 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4231a9b-d5d6-41e3-9434-d9779d4dc38c None None] PATH_INFO: `/` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:42.493082 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 35/62] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:25:42 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:25:42.499438 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3a41ec-25c9-437f-98f2-92d7f55e112a None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:42.500565 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3a41ec-25c9-437f-98f2-92d7f55e112a None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:42.501075 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3a41ec-25c9-437f-98f2-92d7f55e112a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:42.525033 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-db3a41ec-25c9-437f-98f2-92d7f55e112a None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:25:42.526616 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-db3a41ec-25c9-437f-98f2-92d7f55e112a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:42.571390 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ef7bba-2378-4053-a1e7-8e608e486255 None None] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:42.571694 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ef7bba-2378-4053-a1e7-8e608e486255 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:42.571954 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ef7bba-2378-4053-a1e7-8e608e486255 None None] PATH_INFO: `/` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:42.573424 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 36/63] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:25:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:25:42.580027 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5fcdbb-f314-42d8-b4a9-288cf2fc60d4 None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:42.580339 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5fcdbb-f314-42d8-b4a9-288cf2fc60d4 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:42.580616 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5fcdbb-f314-42d8-b4a9-288cf2fc60d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:42.615679 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-8f5fcdbb-f314-42d8-b4a9-288cf2fc60d4 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:25:42.619141 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-8f5fcdbb-f314-42d8-b4a9-288cf2fc60d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:42.659128 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 28/64] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:25:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:25:42.700953 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3a41ec-25c9-437f-98f2-92d7f55e112a None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:42.720598 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:42.762241 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 37/65] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:25:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jul 11 14:25:42.790580 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5fcdbb-f314-42d8-b4a9-288cf2fc60d4 None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:42.843019 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:42.931730 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3a41ec-25c9-437f-98f2-92d7f55e112a None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:42.981558 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5fcdbb-f314-42d8-b4a9-288cf2fc60d4 None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:43.010766 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf9a8b9-be42-46f3-8bc3-80dfc0a8c240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:43.011598 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf9a8b9-be42-46f3-8bc3-80dfc0a8c240 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:43.011886 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf9a8b9-be42-46f3-8bc3-80dfc0a8c240 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:43.012170 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf9a8b9-be42-46f3-8bc3-80dfc0a8c240 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:43.035414 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf9a8b9-be42-46f3-8bc3-80dfc0a8c240 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:25:43.049613 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455f9bc5-f51f-47d5-8613-f40c39efba6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:43.050454 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455f9bc5-f51f-47d5-8613-f40c39efba6f None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:43.050739 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455f9bc5-f51f-47d5-8613-f40c39efba6f None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:43.051017 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455f9bc5-f51f-47d5-8613-f40c39efba6f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:43.055527 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-fcf9a8b9-be42-46f3-8bc3-80dfc0a8c240 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 14:25:43.055527 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:25:43.055527 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:25:43.055527 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:25:43.055527 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:25:43.055527 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:25:43.055527 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:25:43.055527 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:25:43.055527 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:25:43.055527 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:25:43.055527 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:25:43.055527 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:25:43.055527 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:25:43.055527 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:25:43.055527 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:25:43.055527 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:25:43.056435 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:25:43.056435 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:25:43.056435 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:25:43.056435 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:25:43.056435 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:25:43.056435 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:25:43.056435 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:25:43.056435 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:25:43.056435 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:25:43.056435 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:25:43.056435 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:25:43.056435 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( Jul 11 14:25:43.056435 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:25:43.056435 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:25:43.056435 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:25:43.056435 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:25:43.057819 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:25:43.057819 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:25:43.057819 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:25:43.057819 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:25:43.057819 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:25:43.057819 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:25:43.057819 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:25:43.057819 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:25:43.057819 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:25:43.057819 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:25:43.057819 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 14:25:43.057819 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Jul 11 14:25:43.057819 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 29/66] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Jul 11 14:25:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 356 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:25:43.064959 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf9a8b9-be42-46f3-8bc3-80dfc0a8c240 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:43.081422 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455f9bc5-f51f-47d5-8613-f40c39efba6f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:25:43.091494 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application [None req-455f9bc5-f51f-47d5-8613-f40c39efba6f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 14:25:43.091494 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:25:43.091494 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:25:43.091494 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:25:43.091494 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:25:43.091494 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:25:43.091494 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:25:43.091494 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:25:43.091494 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:25:43.091494 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:25:43.091494 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:25:43.091494 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:25:43.091494 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:25:43.091494 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:25:43.091494 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:25:43.091494 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:25:43.092453 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:25:43.092453 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:25:43.092453 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:25:43.092453 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:25:43.092453 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:25:43.092453 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:25:43.092453 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:25:43.092453 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:25:43.092453 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:25:43.092453 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:25:43.092453 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:25:43.092453 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application with Lock( Jul 11 14:25:43.092453 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:25:43.092453 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:25:43.092453 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:25:43.092453 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:25:43.093200 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:25:43.093200 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:25:43.093200 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:25:43.093200 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:25:43.093200 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:25:43.093200 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:25:43.093200 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:25:43.093200 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:25:43.093200 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:25:43.093200 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:25:43.093200 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 14:25:43.093200 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Jul 11 14:25:43.095625 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 38/67] 10.222.0.70 () {56 vars in 1114 bytes} [Mon Jul 11 14:25:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:25:43.105512 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455f9bc5-f51f-47d5-8613-f40c39efba6f None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:43.138234 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:43.185478 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf9a8b9-be42-46f3-8bc3-80dfc0a8c240 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:43.227228 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:43.230215 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066fafff-80e5-4711-9e91-356ab6f594ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:43.230907 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066fafff-80e5-4711-9e91-356ab6f594ed None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:43.231197 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066fafff-80e5-4711-9e91-356ab6f594ed None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:43.231477 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066fafff-80e5-4711-9e91-356ab6f594ed None admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:43.232275 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066fafff-80e5-4711-9e91-356ab6f594ed None admin] RBAC: Adding query filter params (name=member) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:25:43.232628 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066fafff-80e5-4711-9e91-356ab6f594ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:43.234562 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066fafff-80e5-4711-9e91-356ab6f594ed None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:43.238133 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455f9bc5-f51f-47d5-8613-f40c39efba6f None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:43.244991 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 30/68] 10.222.0.70 () {56 vars in 1101 bytes} [Mon Jul 11 14:25:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:25:43.247365 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb4ce54-e43c-41c6-99b4-94dd7d463280 None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:43.247365 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb4ce54-e43c-41c6-99b4-94dd7d463280 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:43.247365 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb4ce54-e43c-41c6-99b4-94dd7d463280 None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:43.248242 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 31/69] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:25:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:25:43.251098 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfe616c-670f-4104-ac6d-bc5a5f2136c3 None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:43.251098 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfe616c-670f-4104-ac6d-bc5a5f2136c3 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:43.251098 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfe616c-670f-4104-ac6d-bc5a5f2136c3 None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:43.251342 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 32/70] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:25:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:25:43.253301 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfe616c-670f-4104-ac6d-bc5a5f2136c3 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:43.284665 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e77c7b9-3602-47e9-bfca-22675257d4d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:43.285542 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e77c7b9-3602-47e9-bfca-22675257d4d3 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:43.285761 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e77c7b9-3602-47e9-bfca-22675257d4d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:43.286157 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e77c7b9-3602-47e9-bfca-22675257d4d3 None admin] PATH_INFO: `/v3/roles` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:43.286945 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e77c7b9-3602-47e9-bfca-22675257d4d3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:25:43.287257 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e77c7b9-3602-47e9-bfca-22675257d4d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:43.288742 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e77c7b9-3602-47e9-bfca-22675257d4d3 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:43.306241 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 39/71] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Jul 11 14:25:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:25:43.307721 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e749d443-6867-4645-973f-c71d0e28a403 None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:43.308256 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e749d443-6867-4645-973f-c71d0e28a403 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:43.309566 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e749d443-6867-4645-973f-c71d0e28a403 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:43.327977 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-e749d443-6867-4645-973f-c71d0e28a403 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:25:43.329230 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-e749d443-6867-4645-973f-c71d0e28a403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:43.383257 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfe616c-670f-4104-ac6d-bc5a5f2136c3 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:43.420476 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:43.425727 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 40/72] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:25:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:25:43.427140 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f6085a-b2f8-44cf-9f20-902cd68dfc60 None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:43.427432 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f6085a-b2f8-44cf-9f20-902cd68dfc60 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:43.427712 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f6085a-b2f8-44cf-9f20-902cd68dfc60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:43.437570 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e5c86a-6fea-494a-819c-5a671787ad35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:43.438490 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e5c86a-6fea-494a-819c-5a671787ad35 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:43.438776 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e5c86a-6fea-494a-819c-5a671787ad35 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:43.439061 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e5c86a-6fea-494a-819c-5a671787ad35 None admin] PATH_INFO: `/v3/users/9196d98d4897499d92e1ce81c2f9bdf8` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:43.450677 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-14f6085a-b2f8-44cf-9f20-902cd68dfc60 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:25:43.451596 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-14f6085a-b2f8-44cf-9f20-902cd68dfc60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:43.459165 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e5c86a-6fea-494a-819c-5a671787ad35 None admin] RBAC: Authorizing `identity:get_user(user_id=9196d98d4897499d92e1ce81c2f9bdf8)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:43.460793 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e5c86a-6fea-494a-819c-5a671787ad35 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:43.463621 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 33/73] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Jul 11 14:25:43 2022] GET /identity/v3/users/9196d98d4897499d92e1ce81c2f9bdf8 => generated 275 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:25:43.464608 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e5c86a-6fea-494a-819c-5a671787ad35 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:43.545416 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 41/74] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:25:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:25:43.546759 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18efb09f-c0fd-47fa-8b19-8b3879c5102c None None] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:43.547046 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18efb09f-c0fd-47fa-8b19-8b3879c5102c None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:43.547327 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18efb09f-c0fd-47fa-8b19-8b3879c5102c None None] PATH_INFO: `/` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:43.548804 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 42/75] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:25:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:25:43.549587 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18efb09f-c0fd-47fa-8b19-8b3879c5102c None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:43.582774 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:43.602775 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e5c86a-6fea-494a-819c-5a671787ad35 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:43.641735 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebe6fa1-5129-40cf-9f83-e786ab377517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:43.642637 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebe6fa1-5129-40cf-9f83-e786ab377517 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:43.643160 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebe6fa1-5129-40cf-9f83-e786ab377517 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:43.643731 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebe6fa1-5129-40cf-9f83-e786ab377517 None admin] PATH_INFO: `/v3/users/9196d98d4897499d92e1ce81c2f9bdf8` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:43.645693 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebe6fa1-5129-40cf-9f83-e786ab377517 None admin] RBAC: Authorizing `identity:get_user(user_id=9196d98d4897499d92e1ce81c2f9bdf8)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:43.647396 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebe6fa1-5129-40cf-9f83-e786ab377517 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:43.654016 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 34/76] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Jul 11 14:25:43 2022] GET /identity/v3/users/9196d98d4897499d92e1ce81c2f9bdf8 => generated 275 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:25:43.654016 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebe6fa1-5129-40cf-9f83-e786ab377517 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:43.707487 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:43.710663 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18efb09f-c0fd-47fa-8b19-8b3879c5102c None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:43.748744 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3733f9c0-d399-476a-af0a-e6fde325c404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:43.749549 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3733f9c0-d399-476a-af0a-e6fde325c404 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:43.749832 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3733f9c0-d399-476a-af0a-e6fde325c404 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:43.750104 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3733f9c0-d399-476a-af0a-e6fde325c404 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:43.761764 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3733f9c0-d399-476a-af0a-e6fde325c404 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:25:43.769689 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application [None req-3733f9c0-d399-476a-af0a-e6fde325c404 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:25:43.769689 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:25:43.769689 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:25:43.769689 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:25:43.769689 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:25:43.769689 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:25:43.769689 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:25:43.769689 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:25:43.769689 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:25:43.769689 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:25:43.769689 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:25:43.769689 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:25:43.769689 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:25:43.769689 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:25:43.769689 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:25:43.769689 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:25:43.770646 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:25:43.770646 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:25:43.770646 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:25:43.770646 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:25:43.770646 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:25:43.770646 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:25:43.770646 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:25:43.770646 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:25:43.770646 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:25:43.770646 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:25:43.770646 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:25:43.770646 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application with Lock( Jul 11 14:25:43.770646 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:25:43.770646 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:25:43.770646 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:25:43.770646 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:25:43.771421 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:25:43.771421 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:25:43.771421 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:25:43.771421 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:25:43.771421 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:25:43.771421 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:25:43.771421 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:25:43.771421 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:25:43.771421 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:25:43.771421 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:25:43.771421 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:25:43.771421 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Jul 11 14:25:43.771421 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 43/77] 10.222.0.70 () {56 vars in 1096 bytes} [Mon Jul 11 14:25:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:25:43.772450 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c38ea0f-b805-46a5-a063-e2904ae55269 None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:43.772603 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebe6fa1-5129-40cf-9f83-e786ab377517 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:43.772700 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c38ea0f-b805-46a5-a063-e2904ae55269 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:43.772884 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c38ea0f-b805-46a5-a063-e2904ae55269 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:43.790836 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-3c38ea0f-b805-46a5-a063-e2904ae55269 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:25:43.792093 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-3c38ea0f-b805-46a5-a063-e2904ae55269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:43.816425 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f446a8-ed97-42b4-b317-65dbe52acfc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:43.817494 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f446a8-ed97-42b4-b317-65dbe52acfc5 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:43.818012 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f446a8-ed97-42b4-b317-65dbe52acfc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:43.818452 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f446a8-ed97-42b4-b317-65dbe52acfc5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:43.876061 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 44/78] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:25:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:25:43.876977 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c38ea0f-b805-46a5-a063-e2904ae55269 None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:43.901482 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:43.910500 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f446a8-ed97-42b4-b317-65dbe52acfc5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:43.911978 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f446a8-ed97-42b4-b317-65dbe52acfc5 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:43.983725 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:44.017920 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c38ea0f-b805-46a5-a063-e2904ae55269 None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:44.061445 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 35/79] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Jul 11 14:25:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 14:25:44.062328 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f446a8-ed97-42b4-b317-65dbe52acfc5 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:44.062447 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b200884-a78f-49c6-8d61-8919ae88c9c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:44.063641 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b200884-a78f-49c6-8d61-8919ae88c9c5 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:44.064104 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b200884-a78f-49c6-8d61-8919ae88c9c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:44.064580 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b200884-a78f-49c6-8d61-8919ae88c9c5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:44.079840 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b200884-a78f-49c6-8d61-8919ae88c9c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:25:44.088017 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application [None req-8b200884-a78f-49c6-8d61-8919ae88c9c5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 14:25:44.088017 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:25:44.088017 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:25:44.088017 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:25:44.088017 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:25:44.088017 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:25:44.088017 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:25:44.088017 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:25:44.088017 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:25:44.088017 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:25:44.088017 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:25:44.088017 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:25:44.088017 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:25:44.088017 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:25:44.088017 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:25:44.088017 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:25:44.089321 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:25:44.089321 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:25:44.089321 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:25:44.089321 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:25:44.089321 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:25:44.089321 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:25:44.089321 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:25:44.089321 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:25:44.089321 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:25:44.089321 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:25:44.089321 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:25:44.089321 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application with Lock( Jul 11 14:25:44.089321 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:25:44.089321 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:25:44.089321 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:25:44.089321 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:25:44.090128 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:25:44.090128 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:25:44.090128 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:25:44.090128 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:25:44.090128 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:25:44.090128 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:25:44.090128 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:25:44.090128 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:25:44.090128 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:25:44.090128 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:25:44.090128 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 14:25:44.090128 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Jul 11 14:25:44.090128 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 45/80] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Jul 11 14:25:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:25:44.091281 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b200884-a78f-49c6-8d61-8919ae88c9c5 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:44.192878 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:44.206854 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f446a8-ed97-42b4-b317-65dbe52acfc5 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:44.244648 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b200884-a78f-49c6-8d61-8919ae88c9c5 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:44.255290 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6728f5f-88aa-42bb-82fc-2987f0760a58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:44.256161 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6728f5f-88aa-42bb-82fc-2987f0760a58 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:44.256588 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6728f5f-88aa-42bb-82fc-2987f0760a58 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:44.256954 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6728f5f-88aa-42bb-82fc-2987f0760a58 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:44.282049 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:44.287546 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e90406c-1899-40c7-97ce-b8d590d58c95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:44.288269 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e90406c-1899-40c7-97ce-b8d590d58c95 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:44.288563 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e90406c-1899-40c7-97ce-b8d590d58c95 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:44.288847 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e90406c-1899-40c7-97ce-b8d590d58c95 None admin] PATH_INFO: `/v3/roles` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:44.289907 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e90406c-1899-40c7-97ce-b8d590d58c95 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:25:44.290088 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e90406c-1899-40c7-97ce-b8d590d58c95 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:44.291616 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e90406c-1899-40c7-97ce-b8d590d58c95 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:44.301911 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 46/81] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Jul 11 14:25:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:25:44.303040 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e90406c-1899-40c7-97ce-b8d590d58c95 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:44.352230 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6728f5f-88aa-42bb-82fc-2987f0760a58 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:44.354986 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6728f5f-88aa-42bb-82fc-2987f0760a58 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:44.422301 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e90406c-1899-40c7-97ce-b8d590d58c95 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:44.454738 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:44.461602 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1ec82f-8849-4877-ac81-5b4cef82afbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:44.462424 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1ec82f-8849-4877-ac81-5b4cef82afbf None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:44.462706 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1ec82f-8849-4877-ac81-5b4cef82afbf None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:44.462982 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1ec82f-8849-4877-ac81-5b4cef82afbf None admin] PATH_INFO: `/v3/domains/default` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:44.464686 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1ec82f-8849-4877-ac81-5b4cef82afbf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:44.466167 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1ec82f-8849-4877-ac81-5b4cef82afbf None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:44.467872 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 47/82] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 11 14:25:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:25:44.469014 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1ec82f-8849-4877-ac81-5b4cef82afbf None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:44.497944 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 36/83] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Jul 11 14:25:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 14:25:44.497944 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6728f5f-88aa-42bb-82fc-2987f0760a58 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:44.548144 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:44.591032 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1ec82f-8849-4877-ac81-5b4cef82afbf None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:44.618782 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6728f5f-88aa-42bb-82fc-2987f0760a58 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:44.652043 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a08f9d0-e53c-4644-9b91-0cb98f35435e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:44.653581 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a08f9d0-e53c-4644-9b91-0cb98f35435e None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:44.654020 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a08f9d0-e53c-4644-9b91-0cb98f35435e None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:44.654440 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a08f9d0-e53c-4644-9b91-0cb98f35435e None admin] PATH_INFO: `/v3/projects/02bf3f49198a4e809a9a6d408d01baa9` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:44.656497 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a08f9d0-e53c-4644-9b91-0cb98f35435e None admin] RBAC: Authorizing `identity:get_project(project_id=02bf3f49198a4e809a9a6d408d01baa9)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:44.658934 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a08f9d0-e53c-4644-9b91-0cb98f35435e None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:44.659612 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d113f5-c35e-42a1-8e3a-dcccbdf6a204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:44.660386 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d113f5-c35e-42a1-8e3a-dcccbdf6a204 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:44.660716 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d113f5-c35e-42a1-8e3a-dcccbdf6a204 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:44.661004 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d113f5-c35e-42a1-8e3a-dcccbdf6a204 None admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:44.661794 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d113f5-c35e-42a1-8e3a-dcccbdf6a204 None admin] RBAC: Adding query filter params (name=member) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:25:44.662101 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d113f5-c35e-42a1-8e3a-dcccbdf6a204 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:44.662345 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 48/84] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Jul 11 14:25:44 2022] GET /identity/v3/projects/02bf3f49198a4e809a9a6d408d01baa9 => generated 298 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:25:44.663362 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a08f9d0-e53c-4644-9b91-0cb98f35435e None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:44.663687 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d113f5-c35e-42a1-8e3a-dcccbdf6a204 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:44.674924 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 37/85] 10.222.0.70 () {56 vars in 1101 bytes} [Mon Jul 11 14:25:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:25:44.677699 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d113f5-c35e-42a1-8e3a-dcccbdf6a204 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:44.748726 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:44.787764 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a08f9d0-e53c-4644-9b91-0cb98f35435e None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:44.814921 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d113f5-c35e-42a1-8e3a-dcccbdf6a204 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:44.835235 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:44.836792 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ee7beb-98aa-46f3-93d6-b66ae28c8e33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:44.838051 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ee7beb-98aa-46f3-93d6-b66ae28c8e33 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:44.838051 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ee7beb-98aa-46f3-93d6-b66ae28c8e33 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:44.838374 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ee7beb-98aa-46f3-93d6-b66ae28c8e33 None admin] PATH_INFO: `/v3/users/c2bda2fc12a24c48ba42c84873d8bfa1` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:44.840152 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ee7beb-98aa-46f3-93d6-b66ae28c8e33 None admin] RBAC: Authorizing `identity:get_user(user_id=c2bda2fc12a24c48ba42c84873d8bfa1)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:44.841862 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ee7beb-98aa-46f3-93d6-b66ae28c8e33 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:44.843717 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 49/86] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Jul 11 14:25:44 2022] GET /identity/v3/users/c2bda2fc12a24c48ba42c84873d8bfa1 => generated 247 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:25:44.845584 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ee7beb-98aa-46f3-93d6-b66ae28c8e33 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:44.870282 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c7e520-7b2d-42f4-9054-3c1fcc35ee7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:44.871258 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c7e520-7b2d-42f4-9054-3c1fcc35ee7e None admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:44.871716 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c7e520-7b2d-42f4-9054-3c1fcc35ee7e None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:44.872190 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c7e520-7b2d-42f4-9054-3c1fcc35ee7e None admin] PATH_INFO: `/v3/users` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:44.873479 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c7e520-7b2d-42f4-9054-3c1fcc35ee7e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:44.875913 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c7e520-7b2d-42f4-9054-3c1fcc35ee7e None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:44.904542 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 38/87] 10.222.0.70 () {60 vars in 1132 bytes} [Mon Jul 11 14:25:44 2022] POST /identity/v3/users => generated 289 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:25:44.905632 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c7e520-7b2d-42f4-9054-3c1fcc35ee7e None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:45.030486 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ee7beb-98aa-46f3-93d6-b66ae28c8e33 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:45.092333 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c7e520-7b2d-42f4-9054-3c1fcc35ee7e None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:45.095959 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a4d740-6bac-40c1-874c-6081af1abac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:45.097469 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a4d740-6bac-40c1-874c-6081af1abac8 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:45.097862 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a4d740-6bac-40c1-874c-6081af1abac8 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:45.098228 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a4d740-6bac-40c1-874c-6081af1abac8 None admin] PATH_INFO: `/v3/projects/02bf3f49198a4e809a9a6d408d01baa9` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:45.099681 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a4d740-6bac-40c1-874c-6081af1abac8 None admin] RBAC: Authorizing `identity:get_project(project_id=02bf3f49198a4e809a9a6d408d01baa9)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:45.103060 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a4d740-6bac-40c1-874c-6081af1abac8 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:45.105047 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 50/88] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Jul 11 14:25:44 2022] GET /identity/v3/projects/02bf3f49198a4e809a9a6d408d01baa9 => generated 298 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:25:45.106083 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a4d740-6bac-40c1-874c-6081af1abac8 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:45.111114 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:45.147985 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688eb059-0e76-4d48-a4c1-a465f83e8d1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:45.149102 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688eb059-0e76-4d48-a4c1-a465f83e8d1b None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:45.151618 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688eb059-0e76-4d48-a4c1-a465f83e8d1b None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:45.151618 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688eb059-0e76-4d48-a4c1-a465f83e8d1b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:45.151829 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688eb059-0e76-4d48-a4c1-a465f83e8d1b None admin] RBAC: Adding query filter params (role.id=8eff41f243c843ed95505a488ca6eada, scope.project.id=02bf3f49198a4e809a9a6d408d01baa9, user.id=9196d98d4897499d92e1ce81c2f9bdf8) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:25:45.152237 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688eb059-0e76-4d48-a4c1-a465f83e8d1b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:45.154774 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688eb059-0e76-4d48-a4c1-a465f83e8d1b None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:45.162678 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 39/89] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Jul 11 14:25:44 2022] GET /identity/v3/role_assignments?user.id=9196d98d4897499d92e1ce81c2f9bdf8&scope.project.id=02bf3f49198a4e809a9a6d408d01baa9&role.id=8eff41f243c843ed95505a488ca6eada => generated 259 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:25:45.163841 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688eb059-0e76-4d48-a4c1-a465f83e8d1b None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:45.227075 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:45.289725 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a4d740-6bac-40c1-874c-6081af1abac8 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:45.345356 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6aee9d-4dda-4eb4-a226-cda030fcefc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:45.347891 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6aee9d-4dda-4eb4-a226-cda030fcefc6 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:45.348809 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6aee9d-4dda-4eb4-a226-cda030fcefc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:45.349303 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6aee9d-4dda-4eb4-a226-cda030fcefc6 None admin] PATH_INFO: `/v3/users/9196d98d4897499d92e1ce81c2f9bdf8` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:45.353609 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6aee9d-4dda-4eb4-a226-cda030fcefc6 None admin] RBAC: Authorizing `identity:get_user(user_id=9196d98d4897499d92e1ce81c2f9bdf8)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:45.356259 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6aee9d-4dda-4eb4-a226-cda030fcefc6 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:45.359414 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 51/90] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Jul 11 14:25:45 2022] GET /identity/v3/users/9196d98d4897499d92e1ce81c2f9bdf8 => generated 275 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:25:45.365199 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6aee9d-4dda-4eb4-a226-cda030fcefc6 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:45.371269 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688eb059-0e76-4d48-a4c1-a465f83e8d1b None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:45.439984 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78672d73-8108-4e37-ba01-cecde53d1c4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:45.441149 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78672d73-8108-4e37-ba01-cecde53d1c4c None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:45.441674 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78672d73-8108-4e37-ba01-cecde53d1c4c None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:45.442203 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78672d73-8108-4e37-ba01-cecde53d1c4c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:45.505401 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:45.606466 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78672d73-8108-4e37-ba01-cecde53d1c4c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:45.609232 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78672d73-8108-4e37-ba01-cecde53d1c4c None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:45.682154 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6aee9d-4dda-4eb4-a226-cda030fcefc6 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:45.685819 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:45.802334 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 40/91] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Jul 11 14:25:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 639 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 14:25:45.803369 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ac809f-97b5-451c-b468-3c5c8519348f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:45.803722 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78672d73-8108-4e37-ba01-cecde53d1c4c None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:45.805110 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ac809f-97b5-451c-b468-3c5c8519348f None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:45.805707 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ac809f-97b5-451c-b468-3c5c8519348f None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:45.806150 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ac809f-97b5-451c-b468-3c5c8519348f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:45.807849 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ac809f-97b5-451c-b468-3c5c8519348f None admin] RBAC: Adding query filter params (role.id=7d8b0827910944f29bfa3a92d6cb7c92, scope.project.id=02bf3f49198a4e809a9a6d408d01baa9, user.id=9196d98d4897499d92e1ce81c2f9bdf8) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:25:45.808461 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ac809f-97b5-451c-b468-3c5c8519348f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:45.818899 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ac809f-97b5-451c-b468-3c5c8519348f None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:45.835035 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 52/92] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Jul 11 14:25:45 2022] GET /identity/v3/role_assignments?user.id=9196d98d4897499d92e1ce81c2f9bdf8&scope.project.id=02bf3f49198a4e809a9a6d408d01baa9&role.id=7d8b0827910944f29bfa3a92d6cb7c92 => generated 259 bytes in 471 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:25:45.841006 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ac809f-97b5-451c-b468-3c5c8519348f None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:46.139678 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ac809f-97b5-451c-b468-3c5c8519348f None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:46.207791 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78672d73-8108-4e37-ba01-cecde53d1c4c None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:46.215058 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26abdc75-5b5c-4541-acae-b6cd5850a49c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:46.216987 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26abdc75-5b5c-4541-acae-b6cd5850a49c None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:46.217581 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26abdc75-5b5c-4541-acae-b6cd5850a49c None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:46.218171 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26abdc75-5b5c-4541-acae-b6cd5850a49c None admin] PATH_INFO: `/v3/projects/02bf3f49198a4e809a9a6d408d01baa9` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:46.222735 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26abdc75-5b5c-4541-acae-b6cd5850a49c None admin] RBAC: Authorizing `identity:get_project(project_id=02bf3f49198a4e809a9a6d408d01baa9)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:46.226027 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26abdc75-5b5c-4541-acae-b6cd5850a49c None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:46.230157 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 53/93] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Jul 11 14:25:45 2022] GET /identity/v3/projects/02bf3f49198a4e809a9a6d408d01baa9 => generated 298 bytes in 395 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:25:46.246414 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26abdc75-5b5c-4541-acae-b6cd5850a49c None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:46.248727 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:46.253708 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:46.256197 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0aec95-3a9b-4f28-9d87-54de349c0381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:46.257208 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0aec95-3a9b-4f28-9d87-54de349c0381 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:46.257759 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0aec95-3a9b-4f28-9d87-54de349c0381 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:46.258268 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0aec95-3a9b-4f28-9d87-54de349c0381 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:46.382505 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0aec95-3a9b-4f28-9d87-54de349c0381 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:46.384606 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0aec95-3a9b-4f28-9d87-54de349c0381 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:46.454442 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26abdc75-5b5c-4541-acae-b6cd5850a49c None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:46.568153 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68141c6c-6a4b-40e2-be36-d8d40471bca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:46.568153 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68141c6c-6a4b-40e2-be36-d8d40471bca4 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:46.568153 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68141c6c-6a4b-40e2-be36-d8d40471bca4 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:46.568153 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68141c6c-6a4b-40e2-be36-d8d40471bca4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:46.569025 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68141c6c-6a4b-40e2-be36-d8d40471bca4 None admin] RBAC: Adding query filter params (role.id=b46df176b0fe479da63c318db225bed4, scope.project.id=02bf3f49198a4e809a9a6d408d01baa9, user.id=c2bda2fc12a24c48ba42c84873d8bfa1) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:25:46.569464 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68141c6c-6a4b-40e2-be36-d8d40471bca4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:46.580248 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68141c6c-6a4b-40e2-be36-d8d40471bca4 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:46.598148 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 54/94] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Jul 11 14:25:46 2022] GET /identity/v3/role_assignments?user.id=c2bda2fc12a24c48ba42c84873d8bfa1&scope.project.id=02bf3f49198a4e809a9a6d408d01baa9&role.id=b46df176b0fe479da63c318db225bed4 => generated 259 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:25:46.643996 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 41/95] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Jul 11 14:25:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 840 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 14:25:46.652911 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68141c6c-6a4b-40e2-be36-d8d40471bca4 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:46.812940 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:46.884839 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68141c6c-6a4b-40e2-be36-d8d40471bca4 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:46.952073 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a884f7b8-3a30-4f61-8c08-bf0af464a3ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:46.953663 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a884f7b8-3a30-4f61-8c08-bf0af464a3ee None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:46.954134 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a884f7b8-3a30-4f61-8c08-bf0af464a3ee None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:46.954608 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a884f7b8-3a30-4f61-8c08-bf0af464a3ee None admin] PATH_INFO: `/v3/projects/bc1cda584784489383c52a7d7b35d28d` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:46.956947 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a884f7b8-3a30-4f61-8c08-bf0af464a3ee None admin] RBAC: Authorizing `identity:get_project(project_id=bc1cda584784489383c52a7d7b35d28d)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:46.959878 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a884f7b8-3a30-4f61-8c08-bf0af464a3ee None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:46.963482 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 55/96] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Jul 11 14:25:46 2022] GET /identity/v3/projects/bc1cda584784489383c52a7d7b35d28d => generated 312 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:25:46.973429 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0aec95-3a9b-4f28-9d87-54de349c0381 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:47.029068 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:47.131344 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0aec95-3a9b-4f28-9d87-54de349c0381 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:47.178816 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03d23cd-b9fd-47bd-8bde-8438cd117578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:47.180023 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03d23cd-b9fd-47bd-8bde-8438cd117578 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:47.180353 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03d23cd-b9fd-47bd-8bde-8438cd117578 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:47.180639 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03d23cd-b9fd-47bd-8bde-8438cd117578 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:47.181519 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03d23cd-b9fd-47bd-8bde-8438cd117578 None admin] RBAC: Adding query filter params (role.id=8eff41f243c843ed95505a488ca6eada, scope.project.id=bc1cda584784489383c52a7d7b35d28d, user.id=9196d98d4897499d92e1ce81c2f9bdf8) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:25:47.181840 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03d23cd-b9fd-47bd-8bde-8438cd117578 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:47.183379 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03d23cd-b9fd-47bd-8bde-8438cd117578 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:47.192816 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 42/97] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Jul 11 14:25:46 2022] GET /identity/v3/role_assignments?user.id=9196d98d4897499d92e1ce81c2f9bdf8&scope.project.id=bc1cda584784489383c52a7d7b35d28d&role.id=8eff41f243c843ed95505a488ca6eada => generated 259 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:25:49.004805 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef69d577-63f9-4ef9-b0a1-d378b5fb18a2 None None] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:49.006354 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef69d577-63f9-4ef9-b0a1-d378b5fb18a2 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:49.007132 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef69d577-63f9-4ef9-b0a1-d378b5fb18a2 None None] PATH_INFO: `/` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:49.010694 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 56/98] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:25:49 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:25:49.019835 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb306e6-4f7d-48ba-85c0-a33469fc7d53 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:49.021270 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb306e6-4f7d-48ba-85c0-a33469fc7d53 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:49.021976 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb306e6-4f7d-48ba-85c0-a33469fc7d53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:49.056441 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-ecb306e6-4f7d-48ba-85c0-a33469fc7d53 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:25:49.059310 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-ecb306e6-4f7d-48ba-85c0-a33469fc7d53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:49.107218 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42757bcd-326a-449d-a688-e63c5806962c None None] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:49.108178 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42757bcd-326a-449d-a688-e63c5806962c None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:49.108990 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42757bcd-326a-449d-a688-e63c5806962c None None] PATH_INFO: `/` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:49.111837 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 57/99] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:25:49 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 14:25:49.124004 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a7c58f-dec5-4828-beb0-19d03a14d335 None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:49.124907 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a7c58f-dec5-4828-beb0-19d03a14d335 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:49.125641 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a7c58f-dec5-4828-beb0-19d03a14d335 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:49.172254 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-c6a7c58f-dec5-4828-beb0-19d03a14d335 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:25:49.173484 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-c6a7c58f-dec5-4828-beb0-19d03a14d335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:49.287700 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 43/100] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:25:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:25:49.379018 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 58/101] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:25:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:25:49.408898 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb306e6-4f7d-48ba-85c0-a33469fc7d53 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:49.474680 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a37909-869b-4b10-ade2-2a4234626323 None None] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:49.476716 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a37909-869b-4b10-ade2-2a4234626323 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:49.477756 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a37909-869b-4b10-ade2-2a4234626323 None None] PATH_INFO: `/` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:49.479255 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:49.484020 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 59/102] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:25:49 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:25:49.486362 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a37909-869b-4b10-ade2-2a4234626323 None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:49.630040 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb306e6-4f7d-48ba-85c0-a33469fc7d53 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:49.649705 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:49.713922 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e544b098-314e-4228-a043-f935be758a99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:49.715761 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e544b098-314e-4228-a043-f935be758a99 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:49.716605 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e544b098-314e-4228-a043-f935be758a99 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:49.717401 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e544b098-314e-4228-a043-f935be758a99 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:49.739194 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e544b098-314e-4228-a043-f935be758a99 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:25:49.764599 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a37909-869b-4b10-ade2-2a4234626323 None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:49.767986 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-e544b098-314e-4228-a043-f935be758a99 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 14:25:49.767986 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:25:49.767986 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:25:49.767986 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:25:49.767986 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:25:49.767986 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:25:49.767986 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:25:49.767986 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:25:49.767986 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:25:49.767986 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:25:49.767986 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:25:49.767986 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:25:49.767986 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:25:49.767986 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:25:49.767986 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:25:49.767986 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:25:49.769599 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:25:49.769599 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:25:49.769599 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:25:49.769599 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:25:49.769599 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:25:49.769599 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:25:49.769599 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:25:49.769599 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:25:49.769599 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:25:49.769599 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:25:49.769599 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:25:49.769599 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( Jul 11 14:25:49.769599 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:25:49.769599 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:25:49.769599 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:25:49.769599 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:25:49.771080 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:25:49.771080 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:25:49.771080 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:25:49.771080 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:25:49.771080 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:25:49.771080 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:25:49.771080 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:25:49.771080 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:25:49.771080 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:25:49.771080 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:25:49.771080 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 14:25:49.771080 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Jul 11 14:25:49.778554 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 44/103] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Jul 11 14:25:49 2022] GET /identity/v3/roles/reader => generated 84 bytes in 371 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:25:49.780988 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dee61bd-47c7-47e7-a9a8-908bc4d09358 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:49.781527 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dee61bd-47c7-47e7-a9a8-908bc4d09358 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:49.782051 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dee61bd-47c7-47e7-a9a8-908bc4d09358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:49.838520 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-6dee61bd-47c7-47e7-a9a8-908bc4d09358 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:25:49.840475 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-6dee61bd-47c7-47e7-a9a8-908bc4d09358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:49.841466 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7054fe2d-f138-4f71-b2e1-2429434e89fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:49.843047 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7054fe2d-f138-4f71-b2e1-2429434e89fe None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:49.843780 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7054fe2d-f138-4f71-b2e1-2429434e89fe None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:49.844544 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7054fe2d-f138-4f71-b2e1-2429434e89fe None admin] PATH_INFO: `/v3/domains/default` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:49.846996 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7054fe2d-f138-4f71-b2e1-2429434e89fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:49.849947 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7054fe2d-f138-4f71-b2e1-2429434e89fe None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:49.854129 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 60/104] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 11 14:25:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 369 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:25:49.856008 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7054fe2d-f138-4f71-b2e1-2429434e89fe None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:50.066437 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7054fe2d-f138-4f71-b2e1-2429434e89fe None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:50.078790 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 45/105] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:25:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:25:50.082338 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dee61bd-47c7-47e7-a9a8-908bc4d09358 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:50.137331 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:50.138395 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:50.153592 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37caf49-44f9-4343-87bc-edd283b2b745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:50.154710 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37caf49-44f9-4343-87bc-edd283b2b745 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:50.155217 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37caf49-44f9-4343-87bc-edd283b2b745 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:50.155759 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37caf49-44f9-4343-87bc-edd283b2b745 None admin] PATH_INFO: `/v3/roles` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:50.157422 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37caf49-44f9-4343-87bc-edd283b2b745 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:25:50.157944 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37caf49-44f9-4343-87bc-edd283b2b745 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:50.160807 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37caf49-44f9-4343-87bc-edd283b2b745 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:50.180619 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 61/106] 10.222.0.70 () {56 vars in 1101 bytes} [Mon Jul 11 14:25:49 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:25:50.182944 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c56a27-a5c8-412e-9f14-d70d2dea49a9 None None] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:50.183449 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c56a27-a5c8-412e-9f14-d70d2dea49a9 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:50.184195 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c56a27-a5c8-412e-9f14-d70d2dea49a9 None None] PATH_INFO: `/` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:50.187026 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 62/107] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:25:50 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:25:50.192237 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c56a27-a5c8-412e-9f14-d70d2dea49a9 None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:50.320085 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dee61bd-47c7-47e7-a9a8-908bc4d09358 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:50.394547 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c56a27-a5c8-412e-9f14-d70d2dea49a9 None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:50.394911 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30144abe-e5a2-4450-a6bd-19ed880e63da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:50.396313 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30144abe-e5a2-4450-a6bd-19ed880e63da None admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:50.397496 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30144abe-e5a2-4450-a6bd-19ed880e63da None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:50.398470 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30144abe-e5a2-4450-a6bd-19ed880e63da None admin] PATH_INFO: `/v3/projects` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:50.405852 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30144abe-e5a2-4450-a6bd-19ed880e63da None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:50.410185 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30144abe-e5a2-4450-a6bd-19ed880e63da None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:50.464733 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75108154-8644-4674-a4c3-6e8ce5e6d54e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:50.466137 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75108154-8644-4674-a4c3-6e8ce5e6d54e None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:50.466639 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75108154-8644-4674-a4c3-6e8ce5e6d54e None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:50.467116 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75108154-8644-4674-a4c3-6e8ce5e6d54e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:50.472868 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 46/108] 10.222.0.70 () {60 vars in 1141 bytes} [Mon Jul 11 14:25:50 2022] POST /identity/v3/projects => generated 302 bytes in 392 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:25:50.475465 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30144abe-e5a2-4450-a6bd-19ed880e63da None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:50.511400 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75108154-8644-4674-a4c3-6e8ce5e6d54e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:25:50.543167 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application [None req-75108154-8644-4674-a4c3-6e8ce5e6d54e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 14:25:50.543167 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:25:50.543167 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:25:50.543167 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:25:50.543167 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:25:50.543167 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:25:50.543167 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:25:50.543167 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:25:50.543167 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:25:50.543167 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:25:50.543167 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:25:50.543167 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:25:50.543167 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:25:50.543167 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:25:50.543167 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:25:50.543167 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:25:50.544828 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:25:50.544828 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:25:50.544828 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:25:50.544828 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:25:50.544828 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:25:50.544828 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:25:50.544828 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:25:50.544828 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:25:50.544828 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:25:50.544828 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:25:50.544828 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:25:50.544828 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application with Lock( Jul 11 14:25:50.544828 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:25:50.544828 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:25:50.544828 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:25:50.544828 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:25:50.546325 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:25:50.546325 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:25:50.546325 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:25:50.546325 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:25:50.546325 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:25:50.546325 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:25:50.546325 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:25:50.546325 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:25:50.546325 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:25:50.546325 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:25:50.546325 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 14:25:50.546325 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Jul 11 14:25:50.546325 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 63/109] 10.222.0.70 () {56 vars in 1114 bytes} [Mon Jul 11 14:25:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 358 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:25:50.547934 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117441ba-240a-4001-94fd-1f4cc8a844d5 None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:50.556484 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117441ba-240a-4001-94fd-1f4cc8a844d5 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:50.557096 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117441ba-240a-4001-94fd-1f4cc8a844d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:50.626923 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-117441ba-240a-4001-94fd-1f4cc8a844d5 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:25:50.629138 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-117441ba-240a-4001-94fd-1f4cc8a844d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:50.639272 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:50.723334 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30144abe-e5a2-4450-a6bd-19ed880e63da None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:50.759394 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:50.791178 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215da5ee-c7da-44fc-9be9-04a1c8b1c5ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:50.792336 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215da5ee-c7da-44fc-9be9-04a1c8b1c5ab None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:50.792773 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215da5ee-c7da-44fc-9be9-04a1c8b1c5ab None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:50.793057 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215da5ee-c7da-44fc-9be9-04a1c8b1c5ab None admin] PATH_INFO: `/v3/users/f2dd64eee9154f3e927c93902ba26fe4` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:50.805165 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 64/110] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:25:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:25:50.806465 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117441ba-240a-4001-94fd-1f4cc8a844d5 None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:50.815451 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215da5ee-c7da-44fc-9be9-04a1c8b1c5ab None admin] RBAC: Authorizing `identity:get_user(user_id=f2dd64eee9154f3e927c93902ba26fe4)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:50.817169 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215da5ee-c7da-44fc-9be9-04a1c8b1c5ab None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:50.819237 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 47/111] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Jul 11 14:25:50 2022] GET /identity/v3/users/f2dd64eee9154f3e927c93902ba26fe4 => generated 289 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:25:50.827067 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31950e42-0356-43bd-95f5-07f777741393 None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:50.827566 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31950e42-0356-43bd-95f5-07f777741393 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:50.828056 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31950e42-0356-43bd-95f5-07f777741393 None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:50.830887 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 48/112] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:25:50 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:25:50.832191 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31950e42-0356-43bd-95f5-07f777741393 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:51.010362 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117441ba-240a-4001-94fd-1f4cc8a844d5 None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:51.033141 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31950e42-0356-43bd-95f5-07f777741393 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:51.071097 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9c3d50-3235-4aab-a83f-1cbaf8ffe229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:51.072129 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9c3d50-3235-4aab-a83f-1cbaf8ffe229 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:51.072652 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9c3d50-3235-4aab-a83f-1cbaf8ffe229 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:51.073111 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9c3d50-3235-4aab-a83f-1cbaf8ffe229 None admin] PATH_INFO: `/v3/roles` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:51.074567 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9c3d50-3235-4aab-a83f-1cbaf8ffe229 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:25:51.075123 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9c3d50-3235-4aab-a83f-1cbaf8ffe229 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:51.077791 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9c3d50-3235-4aab-a83f-1cbaf8ffe229 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:51.082491 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:51.094116 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 65/113] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Jul 11 14:25:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:25:51.096061 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c663fdb-9ed5-47bd-a9a2-75ea84df38d1 None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:51.096615 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c663fdb-9ed5-47bd-a9a2-75ea84df38d1 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:51.097068 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c663fdb-9ed5-47bd-a9a2-75ea84df38d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:51.105912 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e057886-c29b-43d0-afb9-e8708b2c1625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:51.107015 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e057886-c29b-43d0-afb9-e8708b2c1625 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:51.107509 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e057886-c29b-43d0-afb9-e8708b2c1625 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:51.107990 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e057886-c29b-43d0-afb9-e8708b2c1625 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:51.116600 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-8c663fdb-9ed5-47bd-a9a2-75ea84df38d1 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:25:51.118017 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-8c663fdb-9ed5-47bd-a9a2-75ea84df38d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:51.193878 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:51.221343 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e057886-c29b-43d0-afb9-e8708b2c1625 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:51.227681 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e057886-c29b-43d0-afb9-e8708b2c1625 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:51.244320 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 66/114] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:25:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:25:51.244320 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c663fdb-9ed5-47bd-a9a2-75ea84df38d1 None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:51.376294 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 49/115] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Jul 11 14:25:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 545 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 14:25:51.377654 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5331dad3-2331-4558-a454-c7ae6ad07391 None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:51.377955 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5331dad3-2331-4558-a454-c7ae6ad07391 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:51.378237 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5331dad3-2331-4558-a454-c7ae6ad07391 None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:51.384285 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 50/116] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:25:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:25:51.384285 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5331dad3-2331-4558-a454-c7ae6ad07391 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:51.420793 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:51.457260 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c663fdb-9ed5-47bd-a9a2-75ea84df38d1 None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:51.514920 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430590e3-a279-4378-9684-bcda9469cff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:51.515839 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430590e3-a279-4378-9684-bcda9469cff2 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:51.516129 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430590e3-a279-4378-9684-bcda9469cff2 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:51.516437 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430590e3-a279-4378-9684-bcda9469cff2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:51.530685 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430590e3-a279-4378-9684-bcda9469cff2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:25:51.539984 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application [None req-430590e3-a279-4378-9684-bcda9469cff2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 14:25:51.539984 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:25:51.539984 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:25:51.539984 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:25:51.539984 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:25:51.539984 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:25:51.539984 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:25:51.539984 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:25:51.539984 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:25:51.539984 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:25:51.539984 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:25:51.539984 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:25:51.539984 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:25:51.539984 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:25:51.539984 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:25:51.539984 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:25:51.541782 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:25:51.541782 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:25:51.541782 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:25:51.541782 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:25:51.541782 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:25:51.541782 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:25:51.541782 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:25:51.541782 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:25:51.541782 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:25:51.541782 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:25:51.541782 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:25:51.541782 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application with Lock( Jul 11 14:25:51.541782 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:25:51.541782 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:25:51.541782 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:25:51.541782 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:25:51.543251 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:25:51.543251 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:25:51.543251 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:25:51.543251 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:25:51.543251 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:25:51.543251 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:25:51.543251 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:25:51.543251 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:25:51.543251 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:25:51.543251 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:25:51.543251 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 14:25:51.543251 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Jul 11 14:25:51.543251 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 67/117] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Jul 11 14:25:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:25:51.543251 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430590e3-a279-4378-9684-bcda9469cff2 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:51.553446 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5331dad3-2331-4558-a454-c7ae6ad07391 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:51.605151 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:51.629808 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b959f79a-7b86-43ba-82cd-b8ef8893ac8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:51.631350 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b959f79a-7b86-43ba-82cd-b8ef8893ac8d None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:51.631851 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b959f79a-7b86-43ba-82cd-b8ef8893ac8d None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:51.632503 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b959f79a-7b86-43ba-82cd-b8ef8893ac8d None admin] PATH_INFO: `/v3/users/9196d98d4897499d92e1ce81c2f9bdf8` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:51.635305 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b959f79a-7b86-43ba-82cd-b8ef8893ac8d None admin] RBAC: Authorizing `identity:get_user(user_id=9196d98d4897499d92e1ce81c2f9bdf8)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:51.638349 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b959f79a-7b86-43ba-82cd-b8ef8893ac8d None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:51.641911 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 51/118] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Jul 11 14:25:51 2022] GET /identity/v3/users/9196d98d4897499d92e1ce81c2f9bdf8 => generated 275 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:25:51.644262 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10d1ac8-6c22-42ae-8c95-dd472654a74a None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:51.644744 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10d1ac8-6c22-42ae-8c95-dd472654a74a None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:51.645313 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10d1ac8-6c22-42ae-8c95-dd472654a74a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:51.674667 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-c10d1ac8-6c22-42ae-8c95-dd472654a74a None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:25:51.676752 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-c10d1ac8-6c22-42ae-8c95-dd472654a74a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:51.708871 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430590e3-a279-4378-9684-bcda9469cff2 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:51.754474 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1f38c6-0a20-4565-90d6-6c5d9ca2ee57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:51.755766 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1f38c6-0a20-4565-90d6-6c5d9ca2ee57 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:51.756252 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1f38c6-0a20-4565-90d6-6c5d9ca2ee57 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:51.756674 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1f38c6-0a20-4565-90d6-6c5d9ca2ee57 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:51.775215 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1f38c6-0a20-4565-90d6-6c5d9ca2ee57 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:25:51.783945 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application [None req-da1f38c6-0a20-4565-90d6-6c5d9ca2ee57 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 14:25:51.783945 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:25:51.783945 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:25:51.783945 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:25:51.783945 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:25:51.783945 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:25:51.783945 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:25:51.783945 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:25:51.783945 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:25:51.783945 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:25:51.783945 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:25:51.783945 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:25:51.783945 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:25:51.783945 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:25:51.783945 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:25:51.783945 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:25:51.785730 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:25:51.785730 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:25:51.785730 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:25:51.785730 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:25:51.785730 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:25:51.785730 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:25:51.785730 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:25:51.785730 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:25:51.785730 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:25:51.785730 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:25:51.785730 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:25:51.785730 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application with Lock( Jul 11 14:25:51.785730 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:25:51.785730 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:25:51.785730 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:25:51.785730 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:25:51.787267 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:25:51.787267 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:25:51.787267 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:25:51.787267 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:25:51.787267 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:25:51.787267 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:25:51.787267 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:25:51.787267 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:25:51.787267 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:25:51.787267 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:25:51.787267 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 14:25:51.787267 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Jul 11 14:25:51.787267 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 68/119] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Jul 11 14:25:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:25:51.790000 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1f38c6-0a20-4565-90d6-6c5d9ca2ee57 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:51.810330 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 52/120] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:25:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:25:51.817896 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10d1ac8-6c22-42ae-8c95-dd472654a74a None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:51.874201 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:51.977678 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:51.988056 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1f38c6-0a20-4565-90d6-6c5d9ca2ee57 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:52.023733 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10d1ac8-6c22-42ae-8c95-dd472654a74a None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:52.038280 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d7e19f-eb94-4e48-9070-5fc034c17534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:52.039769 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d7e19f-eb94-4e48-9070-5fc034c17534 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:52.040049 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d7e19f-eb94-4e48-9070-5fc034c17534 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:52.040380 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d7e19f-eb94-4e48-9070-5fc034c17534 None admin] PATH_INFO: `/v3/projects/02bf3f49198a4e809a9a6d408d01baa9` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:52.041795 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d7e19f-eb94-4e48-9070-5fc034c17534 None admin] RBAC: Authorizing `identity:get_project(project_id=02bf3f49198a4e809a9a6d408d01baa9)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:52.043324 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d7e19f-eb94-4e48-9070-5fc034c17534 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:52.045217 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 69/121] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Jul 11 14:25:51 2022] GET /identity/v3/projects/02bf3f49198a4e809a9a6d408d01baa9 => generated 298 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:25:52.046060 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d7e19f-eb94-4e48-9070-5fc034c17534 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:52.092420 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90d78f1-815a-472a-a3af-a9d954d3bf67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:52.093170 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90d78f1-815a-472a-a3af-a9d954d3bf67 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:52.093438 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90d78f1-815a-472a-a3af-a9d954d3bf67 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:52.093679 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90d78f1-815a-472a-a3af-a9d954d3bf67 None admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:52.094463 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90d78f1-815a-472a-a3af-a9d954d3bf67 None admin] RBAC: Adding query filter params (name=member) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:25:52.094778 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90d78f1-815a-472a-a3af-a9d954d3bf67 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:52.096366 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90d78f1-815a-472a-a3af-a9d954d3bf67 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:52.111279 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 53/122] 10.222.0.70 () {56 vars in 1101 bytes} [Mon Jul 11 14:25:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:25:52.111279 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90d78f1-815a-472a-a3af-a9d954d3bf67 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:52.235622 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:52.253409 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d7e19f-eb94-4e48-9070-5fc034c17534 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:52.262383 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90d78f1-815a-472a-a3af-a9d954d3bf67 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:52.310668 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdac76f-e67f-43b3-aacc-c452467498e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:52.311510 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdac76f-e67f-43b3-aacc-c452467498e3 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:52.311972 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdac76f-e67f-43b3-aacc-c452467498e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:52.312314 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdac76f-e67f-43b3-aacc-c452467498e3 None admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:52.313098 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdac76f-e67f-43b3-aacc-c452467498e3 None admin] RBAC: Adding query filter params (name=member) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:25:52.313509 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdac76f-e67f-43b3-aacc-c452467498e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:52.315147 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdac76f-e67f-43b3-aacc-c452467498e3 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:52.320988 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97892e9e-6171-4b5e-b87d-fdd8557f599a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:52.323259 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97892e9e-6171-4b5e-b87d-fdd8557f599a None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:52.324081 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97892e9e-6171-4b5e-b87d-fdd8557f599a None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:52.324777 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97892e9e-6171-4b5e-b87d-fdd8557f599a None admin] PATH_INFO: `/v3/projects/02bf3f49198a4e809a9a6d408d01baa9` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:52.325861 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 54/123] 10.222.0.70 () {56 vars in 1101 bytes} [Mon Jul 11 14:25:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:25:52.327284 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdac76f-e67f-43b3-aacc-c452467498e3 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:52.332803 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97892e9e-6171-4b5e-b87d-fdd8557f599a None admin] RBAC: Authorizing `identity:get_project(project_id=02bf3f49198a4e809a9a6d408d01baa9)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:52.336139 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97892e9e-6171-4b5e-b87d-fdd8557f599a None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:52.339708 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 70/124] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Jul 11 14:25:52 2022] GET /identity/v3/projects/02bf3f49198a4e809a9a6d408d01baa9 => generated 298 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:25:52.341205 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97892e9e-6171-4b5e-b87d-fdd8557f599a None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:52.413890 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:52.481320 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdac76f-e67f-43b3-aacc-c452467498e3 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:52.529050 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5fb013-4102-4360-84fe-3c2ac85202c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:52.530253 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5fb013-4102-4360-84fe-3c2ac85202c1 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:52.530733 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5fb013-4102-4360-84fe-3c2ac85202c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:52.531195 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5fb013-4102-4360-84fe-3c2ac85202c1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:52.536719 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97892e9e-6171-4b5e-b87d-fdd8557f599a None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:52.549520 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5fb013-4102-4360-84fe-3c2ac85202c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:25:52.563652 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-2c5fb013-4102-4360-84fe-3c2ac85202c1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:25:52.563652 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:25:52.563652 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:25:52.563652 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:25:52.563652 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:25:52.563652 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:25:52.563652 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:25:52.563652 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:25:52.563652 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:25:52.563652 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:25:52.563652 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:25:52.563652 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:25:52.563652 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:25:52.563652 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:25:52.563652 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:25:52.563652 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:25:52.565383 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:25:52.565383 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:25:52.565383 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:25:52.565383 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:25:52.565383 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:25:52.565383 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:25:52.565383 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:25:52.565383 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:25:52.565383 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:25:52.565383 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:25:52.565383 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:25:52.565383 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( Jul 11 14:25:52.565383 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:25:52.565383 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:25:52.565383 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:25:52.565383 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:25:52.566928 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:25:52.566928 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:25:52.566928 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:25:52.566928 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:25:52.566928 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:25:52.566928 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:25:52.566928 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:25:52.566928 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:25:52.566928 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:25:52.566928 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:25:52.566928 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:25:52.566928 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Jul 11 14:25:52.566928 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 55/125] 10.222.0.70 () {56 vars in 1096 bytes} [Mon Jul 11 14:25:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:25:52.568050 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5fb013-4102-4360-84fe-3c2ac85202c1 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:52.587236 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:52.599854 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffadefa-7fd6-4a12-a0aa-7dfdd10bdbbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:52.600760 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffadefa-7fd6-4a12-a0aa-7dfdd10bdbbd None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:52.601307 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffadefa-7fd6-4a12-a0aa-7dfdd10bdbbd None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:52.601774 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffadefa-7fd6-4a12-a0aa-7dfdd10bdbbd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:52.603109 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffadefa-7fd6-4a12-a0aa-7dfdd10bdbbd None admin] RBAC: Adding query filter params (role.id=09e9dee5b1e848eaba8cef2325325d08, scope.project.id=02bf3f49198a4e809a9a6d408d01baa9, user.id=f2dd64eee9154f3e927c93902ba26fe4) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:25:52.603471 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffadefa-7fd6-4a12-a0aa-7dfdd10bdbbd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:52.605245 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffadefa-7fd6-4a12-a0aa-7dfdd10bdbbd None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:52.612991 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 71/126] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Jul 11 14:25:52 2022] GET /identity/v3/role_assignments?user.id=f2dd64eee9154f3e927c93902ba26fe4&scope.project.id=02bf3f49198a4e809a9a6d408d01baa9&role.id=09e9dee5b1e848eaba8cef2325325d08 => generated 259 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:25:52.614435 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffadefa-7fd6-4a12-a0aa-7dfdd10bdbbd None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:52.748702 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5fb013-4102-4360-84fe-3c2ac85202c1 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:52.799233 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d81c4b6-b435-49b9-ad1b-86f608472dea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:52.800479 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d81c4b6-b435-49b9-ad1b-86f608472dea None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:52.800956 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d81c4b6-b435-49b9-ad1b-86f608472dea None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:52.802245 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d81c4b6-b435-49b9-ad1b-86f608472dea None admin] PATH_INFO: `/v3/users/9196d98d4897499d92e1ce81c2f9bdf8` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:52.803908 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d81c4b6-b435-49b9-ad1b-86f608472dea None admin] RBAC: Authorizing `identity:get_user(user_id=9196d98d4897499d92e1ce81c2f9bdf8)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:52.806233 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d81c4b6-b435-49b9-ad1b-86f608472dea None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:52.808693 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 56/127] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Jul 11 14:25:52 2022] GET /identity/v3/users/9196d98d4897499d92e1ce81c2f9bdf8 => generated 275 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:25:52.810628 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d81c4b6-b435-49b9-ad1b-86f608472dea None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:52.818478 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:52.829466 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffadefa-7fd6-4a12-a0aa-7dfdd10bdbbd None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:52.902056 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbca483a-db30-4234-88e3-c004c658ea19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:52.903694 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbca483a-db30-4234-88e3-c004c658ea19 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:52.904184 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbca483a-db30-4234-88e3-c004c658ea19 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:52.904764 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbca483a-db30-4234-88e3-c004c658ea19 None admin] PATH_INFO: `/v3/users/9196d98d4897499d92e1ce81c2f9bdf8` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:52.907170 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbca483a-db30-4234-88e3-c004c658ea19 None admin] RBAC: Authorizing `identity:get_user(user_id=9196d98d4897499d92e1ce81c2f9bdf8)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:52.910435 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbca483a-db30-4234-88e3-c004c658ea19 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:52.920421 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 72/128] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Jul 11 14:25:52 2022] GET /identity/v3/users/9196d98d4897499d92e1ce81c2f9bdf8 => generated 275 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:25:52.921144 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:52.924010 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbca483a-db30-4234-88e3-c004c658ea19 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:52.944633 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d81c4b6-b435-49b9-ad1b-86f608472dea None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:52.985226 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3f43ed-f200-481f-9d26-903a889ca7c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:52.986599 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3f43ed-f200-481f-9d26-903a889ca7c5 None admin] REQUEST_METHOD: `PUT` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:52.987045 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3f43ed-f200-481f-9d26-903a889ca7c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:52.987496 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3f43ed-f200-481f-9d26-903a889ca7c5 None admin] PATH_INFO: `/v3/projects/02bf3f49198a4e809a9a6d408d01baa9/users/9196d98d4897499d92e1ce81c2f9bdf8/roles/7d8b0827910944f29bfa3a92d6cb7c92` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:52.990183 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3f43ed-f200-481f-9d26-903a889ca7c5 None admin] RBAC: Authorizing `identity:create_grant(project_id=02bf3f49198a4e809a9a6d408d01baa9, user_id=9196d98d4897499d92e1ce81c2f9bdf8, role_id=7d8b0827910944f29bfa3a92d6cb7c92)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:52.992505 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3f43ed-f200-481f-9d26-903a889ca7c5 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:53.010592 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 57/129] 10.222.0.70 () {58 vars in 1439 bytes} [Mon Jul 11 14:25:52 2022] PUT /identity/v3/projects/02bf3f49198a4e809a9a6d408d01baa9/users/9196d98d4897499d92e1ce81c2f9bdf8/roles/7d8b0827910944f29bfa3a92d6cb7c92 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:25:53.011819 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3f43ed-f200-481f-9d26-903a889ca7c5 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:53.147229 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbca483a-db30-4234-88e3-c004c658ea19 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:53.254372 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbe9662-e55d-4b1e-8df1-90690144c4f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:53.255934 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbe9662-e55d-4b1e-8df1-90690144c4f1 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:53.256113 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbe9662-e55d-4b1e-8df1-90690144c4f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:53.256664 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbe9662-e55d-4b1e-8df1-90690144c4f1 None admin] PATH_INFO: `/v3/roles` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:53.258911 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbe9662-e55d-4b1e-8df1-90690144c4f1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:25:53.259358 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbe9662-e55d-4b1e-8df1-90690144c4f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:53.262180 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbe9662-e55d-4b1e-8df1-90690144c4f1 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:53.282041 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 73/130] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Jul 11 14:25:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 361 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:25:53.285357 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbe9662-e55d-4b1e-8df1-90690144c4f1 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:53.310113 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3f43ed-f200-481f-9d26-903a889ca7c5 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:53.342895 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:53.399926 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954b2cc8-6f71-49fd-b41b-c3ec194900f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:53.401552 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954b2cc8-6f71-49fd-b41b-c3ec194900f2 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:53.402098 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954b2cc8-6f71-49fd-b41b-c3ec194900f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:53.402635 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954b2cc8-6f71-49fd-b41b-c3ec194900f2 None admin] PATH_INFO: `/v3/projects/02bf3f49198a4e809a9a6d408d01baa9` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:53.405152 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954b2cc8-6f71-49fd-b41b-c3ec194900f2 None admin] RBAC: Authorizing `identity:get_project(project_id=02bf3f49198a4e809a9a6d408d01baa9)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:53.408235 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954b2cc8-6f71-49fd-b41b-c3ec194900f2 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:53.412454 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 58/131] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Jul 11 14:25:53 2022] GET /identity/v3/projects/02bf3f49198a4e809a9a6d408d01baa9 => generated 298 bytes in 401 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:25:53.415806 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc614459-df39-4011-a213-804a97784b1e None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:53.416368 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc614459-df39-4011-a213-804a97784b1e None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:53.417098 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc614459-df39-4011-a213-804a97784b1e None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:53.420262 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 59/132] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:25:53 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:25:53.421947 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc614459-df39-4011-a213-804a97784b1e None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:53.431524 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:53.523543 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbe9662-e55d-4b1e-8df1-90690144c4f1 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:53.608758 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7979ea9-6f09-455b-8e2f-3109c38b054d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:53.610713 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7979ea9-6f09-455b-8e2f-3109c38b054d None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:53.611473 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7979ea9-6f09-455b-8e2f-3109c38b054d None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:53.612184 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7979ea9-6f09-455b-8e2f-3109c38b054d None admin] PATH_INFO: `/v3/projects/bc1cda584784489383c52a7d7b35d28d` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:53.614877 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7979ea9-6f09-455b-8e2f-3109c38b054d None admin] RBAC: Authorizing `identity:get_project(project_id=bc1cda584784489383c52a7d7b35d28d)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:53.618463 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7979ea9-6f09-455b-8e2f-3109c38b054d None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:53.622197 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 74/133] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Jul 11 14:25:53 2022] GET /identity/v3/projects/bc1cda584784489383c52a7d7b35d28d => generated 312 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:25:53.624094 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7979ea9-6f09-455b-8e2f-3109c38b054d None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:53.659363 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc614459-df39-4011-a213-804a97784b1e None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:53.727262 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0ca584-0763-45e1-a83e-d450538853ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:53.728867 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0ca584-0763-45e1-a83e-d450538853ab None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:53.729619 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0ca584-0763-45e1-a83e-d450538853ab None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:53.729957 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0ca584-0763-45e1-a83e-d450538853ab None admin] PATH_INFO: `/v3/users/c2bda2fc12a24c48ba42c84873d8bfa1` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:53.732179 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0ca584-0763-45e1-a83e-d450538853ab None admin] RBAC: Authorizing `identity:get_user(user_id=c2bda2fc12a24c48ba42c84873d8bfa1)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:53.735016 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0ca584-0763-45e1-a83e-d450538853ab None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:53.738373 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 60/134] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Jul 11 14:25:53 2022] GET /identity/v3/users/c2bda2fc12a24c48ba42c84873d8bfa1 => generated 247 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:25:53.740736 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a364945d-991e-4168-8a19-59085d73a595 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:53.741223 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a364945d-991e-4168-8a19-59085d73a595 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:53.742250 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a364945d-991e-4168-8a19-59085d73a595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:53.772050 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-a364945d-991e-4168-8a19-59085d73a595 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:25:53.774821 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-a364945d-991e-4168-8a19-59085d73a595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:53.825142 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:53.838945 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7979ea9-6f09-455b-8e2f-3109c38b054d None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:53.905886 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939bfe59-b0a7-4fcd-8fc3-a60ff43108f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:53.908015 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939bfe59-b0a7-4fcd-8fc3-a60ff43108f1 None admin] REQUEST_METHOD: `PUT` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:53.908814 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939bfe59-b0a7-4fcd-8fc3-a60ff43108f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:53.909736 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939bfe59-b0a7-4fcd-8fc3-a60ff43108f1 None admin] PATH_INFO: `/v3/projects/02bf3f49198a4e809a9a6d408d01baa9/users/9196d98d4897499d92e1ce81c2f9bdf8/roles/8eff41f243c843ed95505a488ca6eada` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:53.914163 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939bfe59-b0a7-4fcd-8fc3-a60ff43108f1 None admin] RBAC: Authorizing `identity:create_grant(project_id=02bf3f49198a4e809a9a6d408d01baa9, user_id=9196d98d4897499d92e1ce81c2f9bdf8, role_id=8eff41f243c843ed95505a488ca6eada)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:53.917171 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 61/135] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:25:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:25:53.918014 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939bfe59-b0a7-4fcd-8fc3-a60ff43108f1 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:53.918635 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a364945d-991e-4168-8a19-59085d73a595 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:53.922850 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:53.953479 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 75/136] 10.222.0.70 () {58 vars in 1439 bytes} [Mon Jul 11 14:25:53 2022] PUT /identity/v3/projects/02bf3f49198a4e809a9a6d408d01baa9/users/9196d98d4897499d92e1ce81c2f9bdf8/roles/8eff41f243c843ed95505a488ca6eada => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:25:53.954927 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939bfe59-b0a7-4fcd-8fc3-a60ff43108f1 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:54.127361 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a364945d-991e-4168-8a19-59085d73a595 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:54.153540 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939bfe59-b0a7-4fcd-8fc3-a60ff43108f1 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:54.203140 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acd63c2-d231-46a0-beba-66681d04985b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:54.204564 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acd63c2-d231-46a0-beba-66681d04985b None admin] REQUEST_METHOD: `PUT` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:54.205032 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acd63c2-d231-46a0-beba-66681d04985b None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:54.205643 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acd63c2-d231-46a0-beba-66681d04985b None admin] PATH_INFO: `/v3/projects/bc1cda584784489383c52a7d7b35d28d/users/9196d98d4897499d92e1ce81c2f9bdf8/roles/8eff41f243c843ed95505a488ca6eada` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:54.209175 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acd63c2-d231-46a0-beba-66681d04985b None admin] RBAC: Authorizing `identity:create_grant(project_id=bc1cda584784489383c52a7d7b35d28d, user_id=9196d98d4897499d92e1ce81c2f9bdf8, role_id=8eff41f243c843ed95505a488ca6eada)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:54.212380 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acd63c2-d231-46a0-beba-66681d04985b None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:54.247888 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 62/137] 10.222.0.70 () {58 vars in 1439 bytes} [Mon Jul 11 14:25:53 2022] PUT /identity/v3/projects/bc1cda584784489383c52a7d7b35d28d/users/9196d98d4897499d92e1ce81c2f9bdf8/roles/8eff41f243c843ed95505a488ca6eada => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:25:54.250970 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acd63c2-d231-46a0-beba-66681d04985b None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:54.276887 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73a3883-5dd1-490a-9cff-8ddbe453b5c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:54.278490 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73a3883-5dd1-490a-9cff-8ddbe453b5c8 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:54.279104 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73a3883-5dd1-490a-9cff-8ddbe453b5c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:54.279597 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73a3883-5dd1-490a-9cff-8ddbe453b5c8 None admin] PATH_INFO: `/v3/projects/02bf3f49198a4e809a9a6d408d01baa9` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:54.285882 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73a3883-5dd1-490a-9cff-8ddbe453b5c8 None admin] RBAC: Authorizing `identity:get_project(project_id=02bf3f49198a4e809a9a6d408d01baa9)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:54.291733 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73a3883-5dd1-490a-9cff-8ddbe453b5c8 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:54.295740 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 76/138] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Jul 11 14:25:53 2022] GET /identity/v3/projects/02bf3f49198a4e809a9a6d408d01baa9 => generated 298 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:25:54.301717 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73a3883-5dd1-490a-9cff-8ddbe453b5c8 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:54.377277 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:54.378442 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:54.432045 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acd63c2-d231-46a0-beba-66681d04985b None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:54.473377 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e820c9-5291-4465-ab6b-d3a8640e5d82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:54.474211 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e820c9-5291-4465-ab6b-d3a8640e5d82 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:54.474555 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e820c9-5291-4465-ab6b-d3a8640e5d82 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:54.474941 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e820c9-5291-4465-ab6b-d3a8640e5d82 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:54.476811 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e820c9-5291-4465-ab6b-d3a8640e5d82 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:54.478550 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e820c9-5291-4465-ab6b-d3a8640e5d82 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:54.480514 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 63/139] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 11 14:25:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:25:54.489737 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e820c9-5291-4465-ab6b-d3a8640e5d82 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:54.628131 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e820c9-5291-4465-ab6b-d3a8640e5d82 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:54.630510 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73a3883-5dd1-490a-9cff-8ddbe453b5c8 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:54.670965 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24bdb29-b99b-42a7-8f8c-79c6cad05428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:54.671811 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24bdb29-b99b-42a7-8f8c-79c6cad05428 None admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:54.672174 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24bdb29-b99b-42a7-8f8c-79c6cad05428 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:54.672569 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24bdb29-b99b-42a7-8f8c-79c6cad05428 None admin] PATH_INFO: `/v3/users` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:54.673397 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24bdb29-b99b-42a7-8f8c-79c6cad05428 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:54.674972 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24bdb29-b99b-42a7-8f8c-79c6cad05428 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:54.692692 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:54.708358 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 64/140] 10.222.0.70 () {60 vars in 1132 bytes} [Mon Jul 11 14:25:54 2022] POST /identity/v3/users => generated 283 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:25:54.711822 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8319a9c2-02a3-4b27-a74a-658406d94bad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:54.713614 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8319a9c2-02a3-4b27-a74a-658406d94bad None admin] REQUEST_METHOD: `PUT` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:54.714092 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8319a9c2-02a3-4b27-a74a-658406d94bad None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:54.714564 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8319a9c2-02a3-4b27-a74a-658406d94bad None admin] PATH_INFO: `/v3/projects/02bf3f49198a4e809a9a6d408d01baa9/users/c2bda2fc12a24c48ba42c84873d8bfa1/roles/b46df176b0fe479da63c318db225bed4` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:54.718846 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8319a9c2-02a3-4b27-a74a-658406d94bad None admin] RBAC: Authorizing `identity:create_grant(project_id=02bf3f49198a4e809a9a6d408d01baa9, user_id=c2bda2fc12a24c48ba42c84873d8bfa1, role_id=b46df176b0fe479da63c318db225bed4)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:54.721747 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8319a9c2-02a3-4b27-a74a-658406d94bad None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:54.756977 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 77/141] 10.222.0.70 () {58 vars in 1439 bytes} [Mon Jul 11 14:25:54 2022] PUT /identity/v3/projects/02bf3f49198a4e809a9a6d408d01baa9/users/c2bda2fc12a24c48ba42c84873d8bfa1/roles/b46df176b0fe479da63c318db225bed4 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:25:56.667603 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713302e2-ee51-41a1-8cc4-c6b939889b56 None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:56.668534 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713302e2-ee51-41a1-8cc4-c6b939889b56 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:56.668534 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713302e2-ee51-41a1-8cc4-c6b939889b56 None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:56.669674 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 65/142] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:25:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:25:56.690826 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b127e330-d088-4667-84c8-ef2f76dcce40 None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:56.692408 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b127e330-d088-4667-84c8-ef2f76dcce40 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:56.693170 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b127e330-d088-4667-84c8-ef2f76dcce40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:56.738172 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-b127e330-d088-4667-84c8-ef2f76dcce40 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:25:56.740882 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-b127e330-d088-4667-84c8-ef2f76dcce40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:56.887780 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 78/143] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:25:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:25:56.928707 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713302e2-ee51-41a1-8cc4-c6b939889b56 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:57.189477 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713302e2-ee51-41a1-8cc4-c6b939889b56 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:57.269501 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bd4c1c-b379-4fcd-bd15-6bd000a2cfe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:57.270823 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bd4c1c-b379-4fcd-bd15-6bd000a2cfe6 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:57.271292 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bd4c1c-b379-4fcd-bd15-6bd000a2cfe6 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:57.271775 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bd4c1c-b379-4fcd-bd15-6bd000a2cfe6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:57.301926 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bd4c1c-b379-4fcd-bd15-6bd000a2cfe6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:25:57.304932 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59fe100-8f2b-42fc-b7da-4adf0a8350ad None None] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:57.305729 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59fe100-8f2b-42fc-b7da-4adf0a8350ad None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:57.306446 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59fe100-8f2b-42fc-b7da-4adf0a8350ad None None] PATH_INFO: `/` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:57.309431 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 79/144] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:25:57 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:25:57.319042 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-19bd4c1c-b379-4fcd-bd15-6bd000a2cfe6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 14:25:57.319042 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:25:57.319042 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:25:57.319042 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:25:57.319042 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:25:57.319042 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:25:57.319042 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:25:57.319042 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:25:57.319042 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:25:57.319042 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:25:57.319042 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:25:57.319042 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:25:57.319042 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:25:57.319042 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:25:57.319042 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:25:57.319042 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:25:57.321297 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:25:57.321297 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:25:57.321297 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:25:57.321297 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:25:57.321297 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:25:57.321297 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:25:57.321297 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:25:57.321297 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:25:57.321297 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:25:57.321297 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:25:57.321297 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:25:57.321297 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( Jul 11 14:25:57.321297 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:25:57.321297 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:25:57.321297 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:25:57.321297 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:25:57.322682 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:25:57.322682 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:25:57.322682 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:25:57.322682 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:25:57.322682 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:25:57.322682 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:25:57.322682 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:25:57.322682 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:25:57.322682 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:25:57.322682 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:25:57.322682 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 14:25:57.322682 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Jul 11 14:25:57.326543 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 66/145] 10.222.0.70 () {56 vars in 1114 bytes} [Mon Jul 11 14:25:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 398 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:25:57.329421 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064cf95d-268f-408b-9353-6010e81f7ad7 None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:57.330197 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064cf95d-268f-408b-9353-6010e81f7ad7 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:57.330917 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064cf95d-268f-408b-9353-6010e81f7ad7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:57.336276 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bd4c1c-b379-4fcd-bd15-6bd000a2cfe6 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:57.381901 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-064cf95d-268f-408b-9353-6010e81f7ad7 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:25:57.384895 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-064cf95d-268f-408b-9353-6010e81f7ad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:57.420238 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:57.500397 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:57.541618 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 80/146] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:25:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 14:25:57.608026 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bd4c1c-b379-4fcd-bd15-6bd000a2cfe6 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:57.618533 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064cf95d-268f-408b-9353-6010e81f7ad7 None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:57.731785 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b8973f-6fdc-44d7-8185-20b6b2c5a642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:57.733995 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b8973f-6fdc-44d7-8185-20b6b2c5a642 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:57.734763 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b8973f-6fdc-44d7-8185-20b6b2c5a642 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:57.735575 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b8973f-6fdc-44d7-8185-20b6b2c5a642 None admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:57.737208 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b8973f-6fdc-44d7-8185-20b6b2c5a642 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:25:57.738035 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b8973f-6fdc-44d7-8185-20b6b2c5a642 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:57.740785 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b8973f-6fdc-44d7-8185-20b6b2c5a642 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:57.773672 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 67/147] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Jul 11 14:25:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 441 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:25:57.779895 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b8973f-6fdc-44d7-8185-20b6b2c5a642 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:57.942109 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b8973f-6fdc-44d7-8185-20b6b2c5a642 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:57.952304 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064cf95d-268f-408b-9353-6010e81f7ad7 None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:57.961454 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:57.999738 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50923c58-882a-4708-8d10-e294c3a4921a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:58.000681 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50923c58-882a-4708-8d10-e294c3a4921a None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:58.000970 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50923c58-882a-4708-8d10-e294c3a4921a None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:58.001257 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50923c58-882a-4708-8d10-e294c3a4921a None admin] PATH_INFO: `/v3/users/9196d98d4897499d92e1ce81c2f9bdf8` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:58.002550 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50923c58-882a-4708-8d10-e294c3a4921a None admin] RBAC: Authorizing `identity:get_user(user_id=9196d98d4897499d92e1ce81c2f9bdf8)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:58.004050 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50923c58-882a-4708-8d10-e294c3a4921a None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:58.005865 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 68/148] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Jul 11 14:25:57 2022] GET /identity/v3/users/9196d98d4897499d92e1ce81c2f9bdf8 => generated 275 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:25:58.012511 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50923c58-882a-4708-8d10-e294c3a4921a None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:58.049014 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92749ce9-e910-4b6d-9bd2-96bc2bf69b8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:58.050256 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92749ce9-e910-4b6d-9bd2-96bc2bf69b8a None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:58.050752 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92749ce9-e910-4b6d-9bd2-96bc2bf69b8a None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:58.051234 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92749ce9-e910-4b6d-9bd2-96bc2bf69b8a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:58.098060 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92749ce9-e910-4b6d-9bd2-96bc2bf69b8a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:25:58.145021 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application [None req-92749ce9-e910-4b6d-9bd2-96bc2bf69b8a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 14:25:58.145021 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:25:58.145021 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:25:58.145021 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:25:58.145021 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:25:58.145021 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:25:58.145021 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:25:58.145021 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:25:58.145021 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:25:58.145021 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:25:58.145021 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:25:58.145021 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:25:58.145021 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:25:58.145021 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:25:58.145021 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:25:58.145021 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:25:58.146695 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:25:58.146695 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:25:58.146695 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:25:58.146695 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:25:58.146695 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:25:58.146695 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:25:58.146695 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:25:58.146695 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:25:58.146695 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:25:58.146695 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:25:58.146695 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:25:58.146695 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application with Lock( Jul 11 14:25:58.146695 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:25:58.146695 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:25:58.146695 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:25:58.146695 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:25:58.149854 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:25:58.149854 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:25:58.149854 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:25:58.149854 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:25:58.149854 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:25:58.149854 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:25:58.149854 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:25:58.149854 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:25:58.149854 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:25:58.149854 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:25:58.149854 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 14:25:58.149854 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Jul 11 14:25:58.149854 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 81/149] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Jul 11 14:25:57 2022] GET /identity/v3/roles/reader => generated 84 bytes in 529 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:25:58.152474 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39483c4-d5a3-4827-9e24-82ddc178ec70 None None] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:58.152474 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39483c4-d5a3-4827-9e24-82ddc178ec70 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:58.152474 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39483c4-d5a3-4827-9e24-82ddc178ec70 None None] PATH_INFO: `/` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:58.157314 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 82/150] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:25:58 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:25:58.168078 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdef264b-7c17-4d92-b545-fb0119c9e921 None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:58.168543 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdef264b-7c17-4d92-b545-fb0119c9e921 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:58.168988 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdef264b-7c17-4d92-b545-fb0119c9e921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:58.188683 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:58.222095 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-cdef264b-7c17-4d92-b545-fb0119c9e921 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:25:58.224309 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-cdef264b-7c17-4d92-b545-fb0119c9e921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:58.392516 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 83/151] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:25:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:25:58.394243 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdef264b-7c17-4d92-b545-fb0119c9e921 None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:58.400706 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50923c58-882a-4708-8d10-e294c3a4921a None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:58.542394 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12aacb34-6b1b-4549-9bf7-5c154f1a34a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:58.543832 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aacb34-6b1b-4549-9bf7-5c154f1a34a2 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:58.544561 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aacb34-6b1b-4549-9bf7-5c154f1a34a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:58.545250 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aacb34-6b1b-4549-9bf7-5c154f1a34a2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:58.684978 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:58.702696 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdef264b-7c17-4d92-b545-fb0119c9e921 None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:58.762073 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12aacb34-6b1b-4549-9bf7-5c154f1a34a2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:58.764881 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12aacb34-6b1b-4549-9bf7-5c154f1a34a2 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:58.765244 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:58.771859 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c32a3ae-2dd0-4365-8736-46fa54770fdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:58.773303 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c32a3ae-2dd0-4365-8736-46fa54770fdf None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:58.775479 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c32a3ae-2dd0-4365-8736-46fa54770fdf None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:58.776178 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c32a3ae-2dd0-4365-8736-46fa54770fdf None admin] PATH_INFO: `/v3/roles` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:58.777951 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c32a3ae-2dd0-4365-8736-46fa54770fdf None admin] RBAC: Adding query filter params (name=reader) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:25:58.778714 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c32a3ae-2dd0-4365-8736-46fa54770fdf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:58.781500 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c32a3ae-2dd0-4365-8736-46fa54770fdf None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:58.800128 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 84/152] 10.222.0.70 () {56 vars in 1101 bytes} [Mon Jul 11 14:25:58 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 407 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:25:58.802669 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c32a3ae-2dd0-4365-8736-46fa54770fdf None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:59.012804 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c32a3ae-2dd0-4365-8736-46fa54770fdf None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:59.129366 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3972279-a646-45cb-813d-862c3d6d5ace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:59.130641 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3972279-a646-45cb-813d-862c3d6d5ace None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:59.131115 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3972279-a646-45cb-813d-862c3d6d5ace None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:59.131589 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3972279-a646-45cb-813d-862c3d6d5ace None admin] PATH_INFO: `/v3/roles/member` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:59.182144 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3972279-a646-45cb-813d-862c3d6d5ace None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:25:59.187532 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 69/153] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Jul 11 14:25:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 1175 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 14:25:59.189342 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12aacb34-6b1b-4549-9bf7-5c154f1a34a2 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:59.203644 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application [None req-c3972279-a646-45cb-813d-862c3d6d5ace None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 14:25:59.203644 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:25:59.203644 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:25:59.203644 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:25:59.203644 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:25:59.203644 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:25:59.203644 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:25:59.203644 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:25:59.203644 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:25:59.203644 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:25:59.203644 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:25:59.203644 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:25:59.203644 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:25:59.203644 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:25:59.203644 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:25:59.203644 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:25:59.205461 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:25:59.205461 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:25:59.205461 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:25:59.205461 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:25:59.205461 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:25:59.205461 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:25:59.205461 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:25:59.205461 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:25:59.205461 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:25:59.205461 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:25:59.205461 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:25:59.205461 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application with Lock( Jul 11 14:25:59.205461 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:25:59.205461 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:25:59.205461 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:25:59.205461 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:25:59.207260 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:25:59.207260 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:25:59.207260 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:25:59.207260 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:25:59.207260 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:25:59.207260 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:25:59.207260 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:25:59.207260 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:25:59.207260 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:25:59.207260 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:25:59.207260 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 14:25:59.207260 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Jul 11 14:25:59.213959 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 85/154] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Jul 11 14:25:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 413 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:25:59.215648 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3972279-a646-45cb-813d-862c3d6d5ace None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:59.416641 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:59.452873 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:59.524361 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12aacb34-6b1b-4549-9bf7-5c154f1a34a2 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:59.526475 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3972279-a646-45cb-813d-862c3d6d5ace None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:59.614780 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46de0b1e-aa28-424f-bcfc-307b1260a07e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:59.616114 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46de0b1e-aa28-424f-bcfc-307b1260a07e None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:59.617924 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46de0b1e-aa28-424f-bcfc-307b1260a07e None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:59.618469 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46de0b1e-aa28-424f-bcfc-307b1260a07e None admin] PATH_INFO: `/v3/users/f2dd64eee9154f3e927c93902ba26fe4` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:59.621081 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46de0b1e-aa28-424f-bcfc-307b1260a07e None admin] RBAC: Authorizing `identity:get_user(user_id=f2dd64eee9154f3e927c93902ba26fe4)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:59.623914 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46de0b1e-aa28-424f-bcfc-307b1260a07e None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:59.632604 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 70/155] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Jul 11 14:25:59 2022] GET /identity/v3/users/f2dd64eee9154f3e927c93902ba26fe4 => generated 289 bytes in 443 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:25:59.641288 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46de0b1e-aa28-424f-bcfc-307b1260a07e None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:59.676429 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fceefa6e-cb2e-4f6c-b384-4c707a999f6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:59.677995 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceefa6e-cb2e-4f6c-b384-4c707a999f6f None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:59.678506 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceefa6e-cb2e-4f6c-b384-4c707a999f6f None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:59.679712 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceefa6e-cb2e-4f6c-b384-4c707a999f6f None admin] PATH_INFO: `/v3/projects/02bf3f49198a4e809a9a6d408d01baa9` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:59.686312 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fceefa6e-cb2e-4f6c-b384-4c707a999f6f None admin] RBAC: Authorizing `identity:get_project(project_id=02bf3f49198a4e809a9a6d408d01baa9)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:59.692381 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fceefa6e-cb2e-4f6c-b384-4c707a999f6f None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:59.698501 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 86/156] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Jul 11 14:25:59 2022] GET /identity/v3/projects/02bf3f49198a4e809a9a6d408d01baa9 => generated 298 bytes in 484 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:25:59.708838 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800fbd1f-57b2-4559-943a-e4b3cee49446 None None] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:59.709282 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800fbd1f-57b2-4559-943a-e4b3cee49446 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:59.709735 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800fbd1f-57b2-4559-943a-e4b3cee49446 None None] PATH_INFO: `/` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:59.713682 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 87/157] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:25:59 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:25:59.714705 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800fbd1f-57b2-4559-943a-e4b3cee49446 None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:59.975407 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46de0b1e-aa28-424f-bcfc-307b1260a07e None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:00.081651 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800fbd1f-57b2-4559-943a-e4b3cee49446 None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:00.089285 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3256c2-3d0a-49cb-be45-26e0b6784677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:00.090866 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3256c2-3d0a-49cb-be45-26e0b6784677 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:00.091623 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3256c2-3d0a-49cb-be45-26e0b6784677 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:00.092380 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3256c2-3d0a-49cb-be45-26e0b6784677 None admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:00.094082 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3256c2-3d0a-49cb-be45-26e0b6784677 None admin] RBAC: Adding query filter params (name=member) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:00.094876 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3256c2-3d0a-49cb-be45-26e0b6784677 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:00.097855 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3256c2-3d0a-49cb-be45-26e0b6784677 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:00.115239 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 71/158] 10.222.0.70 () {56 vars in 1101 bytes} [Mon Jul 11 14:25:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 483 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:00.118409 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19e3f5e-53df-427e-9417-fd4c732958ec None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:00.119197 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19e3f5e-53df-427e-9417-fd4c732958ec None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:00.119909 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19e3f5e-53df-427e-9417-fd4c732958ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:00.142541 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:00.142790 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:00.153652 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-f19e3f5e-53df-427e-9417-fd4c732958ec None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:26:00.155833 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-f19e3f5e-53df-427e-9417-fd4c732958ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:26:00.190554 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2ea727-7d86-4eb1-b297-3b4d6c2b6af6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:00.191451 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2ea727-7d86-4eb1-b297-3b4d6c2b6af6 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:00.191739 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2ea727-7d86-4eb1-b297-3b4d6c2b6af6 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:00.192019 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2ea727-7d86-4eb1-b297-3b4d6c2b6af6 None admin] PATH_INFO: `/v3/projects/02bf3f49198a4e809a9a6d408d01baa9` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:00.193339 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2ea727-7d86-4eb1-b297-3b4d6c2b6af6 None admin] RBAC: Authorizing `identity:get_project(project_id=02bf3f49198a4e809a9a6d408d01baa9)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:00.195587 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2ea727-7d86-4eb1-b297-3b4d6c2b6af6 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:00.201757 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 88/159] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Jul 11 14:25:59 2022] GET /identity/v3/projects/02bf3f49198a4e809a9a6d408d01baa9 => generated 298 bytes in 483 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:00.201757 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2ea727-7d86-4eb1-b297-3b4d6c2b6af6 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:00.301750 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 72/160] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:26:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:26:00.306153 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e90f1d-ed52-4cb2-9bac-e8cdc47bd0f1 None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:00.306677 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e90f1d-ed52-4cb2-9bac-e8cdc47bd0f1 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:00.307174 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e90f1d-ed52-4cb2-9bac-e8cdc47bd0f1 None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:00.312311 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 73/161] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:26:00 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:26:00.317744 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e90f1d-ed52-4cb2-9bac-e8cdc47bd0f1 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:00.549476 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2ea727-7d86-4eb1-b297-3b4d6c2b6af6 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:00.611166 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e90f1d-ed52-4cb2-9bac-e8cdc47bd0f1 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:00.677027 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f3d474-b5c6-46a1-92ce-572632b4e22d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:00.677914 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f3d474-b5c6-46a1-92ce-572632b4e22d None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:00.678302 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f3d474-b5c6-46a1-92ce-572632b4e22d None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:00.678714 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f3d474-b5c6-46a1-92ce-572632b4e22d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:00.680826 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f3d474-b5c6-46a1-92ce-572632b4e22d None admin] RBAC: Adding query filter params (role.id=7d8b0827910944f29bfa3a92d6cb7c92, scope.project.id=02bf3f49198a4e809a9a6d408d01baa9, user.id=9196d98d4897499d92e1ce81c2f9bdf8) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:00.681270 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f3d474-b5c6-46a1-92ce-572632b4e22d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:00.688239 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f3d474-b5c6-46a1-92ce-572632b4e22d None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:00.690722 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 89/162] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Jul 11 14:26:00 2022] GET /identity/v3/role_assignments?user.id=9196d98d4897499d92e1ce81c2f9bdf8&scope.project.id=02bf3f49198a4e809a9a6d408d01baa9&role.id=7d8b0827910944f29bfa3a92d6cb7c92 => generated 608 bytes in 493 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:00.691708 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f3d474-b5c6-46a1-92ce-572632b4e22d None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:00.696069 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f2a8e1-2aa4-4db5-9acb-77d176b8f1be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:00.698145 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f2a8e1-2aa4-4db5-9acb-77d176b8f1be None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:00.699003 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f2a8e1-2aa4-4db5-9acb-77d176b8f1be None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:00.699742 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f2a8e1-2aa4-4db5-9acb-77d176b8f1be None admin] PATH_INFO: `/v3/users/9196d98d4897499d92e1ce81c2f9bdf8` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:00.709907 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f2a8e1-2aa4-4db5-9acb-77d176b8f1be None admin] RBAC: Authorizing `identity:get_user(user_id=9196d98d4897499d92e1ce81c2f9bdf8)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:00.713914 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f2a8e1-2aa4-4db5-9acb-77d176b8f1be None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:00.722201 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 74/163] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Jul 11 14:26:00 2022] GET /identity/v3/users/9196d98d4897499d92e1ce81c2f9bdf8 => generated 275 bytes in 407 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:00.729474 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c83da97-9b3b-4d85-a182-177ac3b4aa87 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:00.731027 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c83da97-9b3b-4d85-a182-177ac3b4aa87 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:00.736293 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c83da97-9b3b-4d85-a182-177ac3b4aa87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:00.760177 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:00.798502 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-7c83da97-9b3b-4d85-a182-177ac3b4aa87 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:26:00.801217 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-7c83da97-9b3b-4d85-a182-177ac3b4aa87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:26:00.870572 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:00.978168 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f3d474-b5c6-46a1-92ce-572632b4e22d None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:01.011258 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 75/164] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:26:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:26:01.012228 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c83da97-9b3b-4d85-a182-177ac3b4aa87 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:01.027767 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d85492-302d-47cb-a8cd-26a871c310df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:01.028714 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d85492-302d-47cb-a8cd-26a871c310df None admin] REQUEST_METHOD: `PUT` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:01.028997 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d85492-302d-47cb-a8cd-26a871c310df None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:01.029271 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d85492-302d-47cb-a8cd-26a871c310df None admin] PATH_INFO: `/v3/projects/02bf3f49198a4e809a9a6d408d01baa9/users/f2dd64eee9154f3e927c93902ba26fe4/roles/09e9dee5b1e848eaba8cef2325325d08` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:01.033590 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d85492-302d-47cb-a8cd-26a871c310df None admin] RBAC: Authorizing `identity:create_grant(project_id=02bf3f49198a4e809a9a6d408d01baa9, user_id=f2dd64eee9154f3e927c93902ba26fe4, role_id=09e9dee5b1e848eaba8cef2325325d08)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:01.035098 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d85492-302d-47cb-a8cd-26a871c310df None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:01.062721 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 90/165] 10.222.0.70 () {58 vars in 1439 bytes} [Mon Jul 11 14:26:00 2022] PUT /identity/v3/projects/02bf3f49198a4e809a9a6d408d01baa9/users/f2dd64eee9154f3e927c93902ba26fe4/roles/09e9dee5b1e848eaba8cef2325325d08 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:26:01.064363 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d85492-302d-47cb-a8cd-26a871c310df None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:01.224284 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c83da97-9b3b-4d85-a182-177ac3b4aa87 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:01.294251 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d85492-302d-47cb-a8cd-26a871c310df None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:01.299276 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b0d457-690b-4429-bc8e-c808bf851f9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:01.300814 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b0d457-690b-4429-bc8e-c808bf851f9f None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:01.301332 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b0d457-690b-4429-bc8e-c808bf851f9f None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:01.301836 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b0d457-690b-4429-bc8e-c808bf851f9f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:01.306255 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:01.328354 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b0d457-690b-4429-bc8e-c808bf851f9f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:26:01.329580 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:01.345426 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-25b0d457-690b-4429-bc8e-c808bf851f9f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 14:26:01.345426 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:01.345426 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:26:01.345426 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:26:01.345426 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:26:01.345426 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:26:01.345426 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:26:01.345426 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:26:01.345426 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:26:01.345426 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:26:01.345426 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:26:01.345426 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:26:01.345426 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:26:01.345426 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:26:01.345426 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:26:01.345426 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:26:01.347332 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:26:01.347332 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:26:01.347332 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:26:01.347332 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:26:01.347332 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:26:01.347332 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:26:01.347332 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:26:01.347332 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:26:01.347332 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:26:01.347332 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:26:01.347332 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:26:01.347332 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( Jul 11 14:26:01.347332 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:26:01.347332 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:26:01.347332 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:26:01.347332 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:26:01.348976 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:26:01.348976 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:26:01.348976 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:26:01.348976 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:26:01.348976 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:26:01.348976 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:26:01.348976 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:26:01.348976 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:26:01.348976 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:26:01.348976 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:26:01.348976 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 14:26:01.348976 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Jul 11 14:26:01.348976 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 76/166] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Jul 11 14:26:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 336 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:26:01.350523 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ae7fde-0012-425c-9af3-6d57a1830bd1 None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:01.351182 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ae7fde-0012-425c-9af3-6d57a1830bd1 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:01.351696 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ae7fde-0012-425c-9af3-6d57a1830bd1 None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:01.354514 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 77/167] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:26:01 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:26:01.362685 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcabb2ff-5f2a-4b12-96f4-b2caaec06921 None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:01.363194 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcabb2ff-5f2a-4b12-96f4-b2caaec06921 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:01.363692 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcabb2ff-5f2a-4b12-96f4-b2caaec06921 None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:01.366895 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 78/168] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:26:01 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:26:01.371636 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcabb2ff-5f2a-4b12-96f4-b2caaec06921 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:01.391815 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0090cfcd-3417-419a-bdba-d6262bb8fcef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:01.393427 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0090cfcd-3417-419a-bdba-d6262bb8fcef None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:01.394152 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0090cfcd-3417-419a-bdba-d6262bb8fcef None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:01.394826 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0090cfcd-3417-419a-bdba-d6262bb8fcef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:01.509687 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0090cfcd-3417-419a-bdba-d6262bb8fcef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:01.511134 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0090cfcd-3417-419a-bdba-d6262bb8fcef None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:01.578820 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcabb2ff-5f2a-4b12-96f4-b2caaec06921 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:01.634719 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8a0d49-e5be-4dea-995a-26ddbbd3ad38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:01.635812 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8a0d49-e5be-4dea-995a-26ddbbd3ad38 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:01.636284 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8a0d49-e5be-4dea-995a-26ddbbd3ad38 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:01.636583 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8a0d49-e5be-4dea-995a-26ddbbd3ad38 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:01.648371 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8a0d49-e5be-4dea-995a-26ddbbd3ad38 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:26:01.656177 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-be8a0d49-e5be-4dea-995a-26ddbbd3ad38 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:26:01.656177 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:01.656177 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:26:01.656177 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:26:01.656177 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:26:01.656177 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:26:01.656177 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:26:01.656177 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:26:01.656177 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:26:01.656177 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:26:01.656177 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:26:01.656177 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:26:01.656177 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:26:01.656177 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:26:01.656177 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:26:01.656177 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:26:01.657864 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:26:01.657864 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:26:01.657864 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:26:01.657864 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:26:01.657864 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:26:01.657864 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:26:01.657864 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:26:01.657864 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:26:01.657864 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:26:01.657864 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:26:01.657864 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:26:01.657864 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( Jul 11 14:26:01.657864 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:26:01.657864 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:26:01.657864 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:26:01.657864 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:26:01.658719 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:26:01.658719 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:26:01.658719 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:26:01.658719 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:26:01.658719 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:26:01.658719 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:26:01.658719 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:26:01.658719 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:26:01.658719 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:26:01.658719 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:26:01.658719 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:26:01.658719 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Jul 11 14:26:01.658719 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 79/169] 10.222.0.70 () {56 vars in 1096 bytes} [Mon Jul 11 14:26:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:26:01.658719 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8a0d49-e5be-4dea-995a-26ddbbd3ad38 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:01.687786 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 91/170] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Jul 11 14:26:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 624 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 14:26:01.689836 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2641266-da4c-4756-84c2-1fd2ebe325e9 None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:01.690293 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2641266-da4c-4756-84c2-1fd2ebe325e9 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:01.690726 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2641266-da4c-4756-84c2-1fd2ebe325e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:01.715561 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-d2641266-da4c-4756-84c2-1fd2ebe325e9 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:26:01.717280 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-d2641266-da4c-4756-84c2-1fd2ebe325e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:26:01.735135 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:01.749344 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:01.813886 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8a0d49-e5be-4dea-995a-26ddbbd3ad38 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:01.851759 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 92/171] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:26:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:26:01.852415 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d0dadf-52b6-4dd0-b7f4-928d54654f26 None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:01.852926 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d0dadf-52b6-4dd0-b7f4-928d54654f26 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:01.853417 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d0dadf-52b6-4dd0-b7f4-928d54654f26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:01.878177 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a94c078-b9c6-4e08-b95d-7fbf0041a125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:01.878739 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a94c078-b9c6-4e08-b95d-7fbf0041a125 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:01.879249 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a94c078-b9c6-4e08-b95d-7fbf0041a125 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:01.879742 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a94c078-b9c6-4e08-b95d-7fbf0041a125 None admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:01.881290 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a94c078-b9c6-4e08-b95d-7fbf0041a125 None admin] RBAC: Adding query filter params (name=member) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:01.881853 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a94c078-b9c6-4e08-b95d-7fbf0041a125 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:01.884617 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a94c078-b9c6-4e08-b95d-7fbf0041a125 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:01.891326 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-27d0dadf-52b6-4dd0-b7f4-928d54654f26 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:26:01.893490 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-27d0dadf-52b6-4dd0-b7f4-928d54654f26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:26:01.901440 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 80/172] 10.222.0.70 () {56 vars in 1101 bytes} [Mon Jul 11 14:26:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:01.907724 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541c4c5d-b999-4560-8c6b-b7f130a3981b None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:01.908179 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541c4c5d-b999-4560-8c6b-b7f130a3981b None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:01.908634 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541c4c5d-b999-4560-8c6b-b7f130a3981b None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:01.911338 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 81/173] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:26:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:26:01.914860 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541c4c5d-b999-4560-8c6b-b7f130a3981b None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:01.988197 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 93/174] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:26:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:26:01.989539 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d0dadf-52b6-4dd0-b7f4-928d54654f26 None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:02.061633 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541c4c5d-b999-4560-8c6b-b7f130a3981b None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:02.081057 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:02.112067 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c095b9-2a80-49bb-9ae5-2373a731e956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:02.113846 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c095b9-2a80-49bb-9ae5-2373a731e956 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:02.114620 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c095b9-2a80-49bb-9ae5-2373a731e956 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:02.115414 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c095b9-2a80-49bb-9ae5-2373a731e956 None admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:02.117605 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c095b9-2a80-49bb-9ae5-2373a731e956 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:02.118402 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c095b9-2a80-49bb-9ae5-2373a731e956 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:02.121139 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c095b9-2a80-49bb-9ae5-2373a731e956 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:02.125790 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:02.137957 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 82/175] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Jul 11 14:26:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:02.139272 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c095b9-2a80-49bb-9ae5-2373a731e956 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:02.175987 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d0dadf-52b6-4dd0-b7f4-928d54654f26 None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:02.240865 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1499d9ba-ee67-485c-8aaa-b5ac8c37c57f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:02.242896 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1499d9ba-ee67-485c-8aaa-b5ac8c37c57f None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:02.243358 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1499d9ba-ee67-485c-8aaa-b5ac8c37c57f None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:02.243777 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1499d9ba-ee67-485c-8aaa-b5ac8c37c57f None admin] PATH_INFO: `/v3/projects/bc1cda584784489383c52a7d7b35d28d` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:02.245251 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1499d9ba-ee67-485c-8aaa-b5ac8c37c57f None admin] RBAC: Authorizing `identity:get_project(project_id=bc1cda584784489383c52a7d7b35d28d)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:02.246879 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1499d9ba-ee67-485c-8aaa-b5ac8c37c57f None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:02.248830 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 94/176] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Jul 11 14:26:01 2022] GET /identity/v3/projects/bc1cda584784489383c52a7d7b35d28d => generated 312 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:02.249742 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1499d9ba-ee67-485c-8aaa-b5ac8c37c57f None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:02.284085 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c095b9-2a80-49bb-9ae5-2373a731e956 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:02.340162 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334921d7-e09e-4ff8-9b82-6a0784cc2f7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:02.341477 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334921d7-e09e-4ff8-9b82-6a0784cc2f7c None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:02.342001 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334921d7-e09e-4ff8-9b82-6a0784cc2f7c None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:02.342508 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334921d7-e09e-4ff8-9b82-6a0784cc2f7c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:02.363115 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334921d7-e09e-4ff8-9b82-6a0784cc2f7c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:26:02.379139 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-334921d7-e09e-4ff8-9b82-6a0784cc2f7c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:26:02.379139 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:02.379139 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:26:02.379139 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:26:02.379139 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:26:02.379139 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:26:02.379139 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:26:02.379139 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:26:02.379139 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:26:02.379139 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:26:02.379139 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:26:02.379139 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:26:02.379139 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:26:02.379139 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:26:02.379139 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:26:02.379139 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:26:02.380162 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:26:02.380162 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:26:02.380162 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:26:02.380162 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:26:02.380162 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:26:02.380162 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:26:02.380162 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:26:02.380162 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:26:02.380162 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:26:02.380162 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:26:02.380162 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:26:02.380162 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( Jul 11 14:26:02.380162 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:26:02.380162 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:26:02.380162 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:26:02.380162 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:26:02.381085 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:26:02.381085 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:26:02.381085 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:26:02.381085 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:26:02.381085 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:26:02.381085 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:26:02.381085 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:26:02.381085 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:26:02.381085 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:26:02.381085 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:26:02.381085 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:26:02.381085 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Jul 11 14:26:02.389016 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 83/177] 10.222.0.70 () {56 vars in 1096 bytes} [Mon Jul 11 14:26:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:26:02.392364 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d69c492-288e-46ac-9fa0-5cdad2c57f3e None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:02.392863 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d69c492-288e-46ac-9fa0-5cdad2c57f3e None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:02.393339 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d69c492-288e-46ac-9fa0-5cdad2c57f3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:02.394013 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1499d9ba-ee67-485c-8aaa-b5ac8c37c57f None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:02.414997 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-2d69c492-288e-46ac-9fa0-5cdad2c57f3e None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:26:02.416576 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-2d69c492-288e-46ac-9fa0-5cdad2c57f3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:26:02.445903 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76cb8f6-31c1-473a-864b-a90cd1f7142c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:02.446992 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76cb8f6-31c1-473a-864b-a90cd1f7142c None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:02.447153 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76cb8f6-31c1-473a-864b-a90cd1f7142c None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:02.447418 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76cb8f6-31c1-473a-864b-a90cd1f7142c None admin] PATH_INFO: `/v3/users/9196d98d4897499d92e1ce81c2f9bdf8` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:02.448642 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76cb8f6-31c1-473a-864b-a90cd1f7142c None admin] RBAC: Authorizing `identity:get_user(user_id=9196d98d4897499d92e1ce81c2f9bdf8)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:02.450088 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76cb8f6-31c1-473a-864b-a90cd1f7142c None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:02.451851 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 95/178] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Jul 11 14:26:02 2022] GET /identity/v3/users/9196d98d4897499d92e1ce81c2f9bdf8 => generated 275 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:02.452517 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76cb8f6-31c1-473a-864b-a90cd1f7142c None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:02.468706 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:02.482539 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:02.560241 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 84/179] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:26:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:26:02.560241 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d69c492-288e-46ac-9fa0-5cdad2c57f3e None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:02.617765 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76cb8f6-31c1-473a-864b-a90cd1f7142c None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:02.674549 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fa8471-4b99-4bf1-8b77-9e0af10b37c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:02.675910 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fa8471-4b99-4bf1-8b77-9e0af10b37c5 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:02.676467 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fa8471-4b99-4bf1-8b77-9e0af10b37c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:02.677711 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fa8471-4b99-4bf1-8b77-9e0af10b37c5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:02.679160 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fa8471-4b99-4bf1-8b77-9e0af10b37c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:02.681717 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fa8471-4b99-4bf1-8b77-9e0af10b37c5 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:02.684966 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 96/180] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 11 14:26:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:02.689546 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fa8471-4b99-4bf1-8b77-9e0af10b37c5 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:02.738821 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d69c492-288e-46ac-9fa0-5cdad2c57f3e None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:02.790841 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9720d5c8-faf7-4d6d-8fd7-11656c17ca95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:02.792492 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9720d5c8-faf7-4d6d-8fd7-11656c17ca95 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:02.792492 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9720d5c8-faf7-4d6d-8fd7-11656c17ca95 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:02.792968 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9720d5c8-faf7-4d6d-8fd7-11656c17ca95 None admin] PATH_INFO: `/v3/users/c2bda2fc12a24c48ba42c84873d8bfa1` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:02.794667 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9720d5c8-faf7-4d6d-8fd7-11656c17ca95 None admin] RBAC: Authorizing `identity:get_user(user_id=c2bda2fc12a24c48ba42c84873d8bfa1)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:02.796338 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9720d5c8-faf7-4d6d-8fd7-11656c17ca95 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:02.805705 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 85/181] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Jul 11 14:26:02 2022] GET /identity/v3/users/c2bda2fc12a24c48ba42c84873d8bfa1 => generated 247 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:02.805705 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9720d5c8-faf7-4d6d-8fd7-11656c17ca95 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:02.834482 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:02.850464 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:02.879363 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fa8471-4b99-4bf1-8b77-9e0af10b37c5 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:02.944928 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecaaca6-a1b1-4309-baec-100655eb5863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:02.946109 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecaaca6-a1b1-4309-baec-100655eb5863 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:02.946604 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecaaca6-a1b1-4309-baec-100655eb5863 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:02.947116 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecaaca6-a1b1-4309-baec-100655eb5863 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:02.948800 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecaaca6-a1b1-4309-baec-100655eb5863 None admin] RBAC: Adding query filter params (role.id=8eff41f243c843ed95505a488ca6eada, scope.project.id=bc1cda584784489383c52a7d7b35d28d, user.id=9196d98d4897499d92e1ce81c2f9bdf8) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:02.949141 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9720d5c8-faf7-4d6d-8fd7-11656c17ca95 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:02.949366 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecaaca6-a1b1-4309-baec-100655eb5863 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:02.952166 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecaaca6-a1b1-4309-baec-100655eb5863 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:02.967492 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 97/182] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Jul 11 14:26:02 2022] GET /identity/v3/role_assignments?user.id=9196d98d4897499d92e1ce81c2f9bdf8&scope.project.id=bc1cda584784489383c52a7d7b35d28d&role.id=8eff41f243c843ed95505a488ca6eada => generated 608 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:02.967492 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecaaca6-a1b1-4309-baec-100655eb5863 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:03.024708 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ee9cd3-96ae-4a88-8f13-e51a13358ad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:03.026358 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ee9cd3-96ae-4a88-8f13-e51a13358ad8 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:03.027976 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ee9cd3-96ae-4a88-8f13-e51a13358ad8 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:03.028618 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ee9cd3-96ae-4a88-8f13-e51a13358ad8 None admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:03.030121 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ee9cd3-96ae-4a88-8f13-e51a13358ad8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:03.030792 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ee9cd3-96ae-4a88-8f13-e51a13358ad8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:03.033356 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ee9cd3-96ae-4a88-8f13-e51a13358ad8 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:03.056085 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 86/183] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Jul 11 14:26:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:03.057864 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ee9cd3-96ae-4a88-8f13-e51a13358ad8 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:03.234153 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecaaca6-a1b1-4309-baec-100655eb5863 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:03.261686 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:03.271183 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ee9cd3-96ae-4a88-8f13-e51a13358ad8 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:03.311378 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807402c9-90ba-416a-a200-7bafd15ed105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:03.311378 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807402c9-90ba-416a-a200-7bafd15ed105 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:03.311378 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807402c9-90ba-416a-a200-7bafd15ed105 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:03.311857 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807402c9-90ba-416a-a200-7bafd15ed105 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:03.339856 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:03.340699 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8840c6-b450-4ab2-ad28-a69358e61428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:03.342009 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8840c6-b450-4ab2-ad28-a69358e61428 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:03.342616 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8840c6-b450-4ab2-ad28-a69358e61428 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:03.342966 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8840c6-b450-4ab2-ad28-a69358e61428 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:03.361434 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8840c6-b450-4ab2-ad28-a69358e61428 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:26:03.378647 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-bb8840c6-b450-4ab2-ad28-a69358e61428 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 14:26:03.378647 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:03.378647 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:26:03.378647 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:26:03.378647 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:26:03.378647 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:26:03.378647 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:26:03.378647 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:26:03.378647 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:26:03.378647 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:26:03.378647 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:26:03.378647 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:26:03.378647 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:26:03.378647 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:26:03.378647 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:26:03.378647 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:26:03.380183 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:26:03.380183 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:26:03.380183 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:26:03.380183 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:26:03.380183 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:26:03.380183 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:26:03.380183 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:26:03.380183 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:26:03.380183 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:26:03.380183 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:26:03.380183 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:26:03.380183 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( Jul 11 14:26:03.380183 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:26:03.380183 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:26:03.380183 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:26:03.380183 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:26:03.388154 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:26:03.388154 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:26:03.388154 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:26:03.388154 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:26:03.388154 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:26:03.388154 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:26:03.388154 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:26:03.388154 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:26:03.388154 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:26:03.388154 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:26:03.388154 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 14:26:03.388154 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Jul 11 14:26:03.388154 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 87/184] 10.222.0.70 () {56 vars in 1114 bytes} [Mon Jul 11 14:26:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:26:03.388154 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8840c6-b450-4ab2-ad28-a69358e61428 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:03.426479 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807402c9-90ba-416a-a200-7bafd15ed105 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:03.429616 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807402c9-90ba-416a-a200-7bafd15ed105 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:03.585700 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8840c6-b450-4ab2-ad28-a69358e61428 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:03.587774 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 98/185] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Jul 11 14:26:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 623 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 14:26:03.588835 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807402c9-90ba-416a-a200-7bafd15ed105 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:03.643696 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:03.658264 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab73ad0-06db-4ed7-b036-53939a45ae28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:03.659506 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab73ad0-06db-4ed7-b036-53939a45ae28 None admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:03.660014 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab73ad0-06db-4ed7-b036-53939a45ae28 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:03.660558 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab73ad0-06db-4ed7-b036-53939a45ae28 None admin] PATH_INFO: `/v3/users` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:03.661942 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab73ad0-06db-4ed7-b036-53939a45ae28 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:03.665421 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab73ad0-06db-4ed7-b036-53939a45ae28 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:03.700237 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 88/186] 10.222.0.70 () {60 vars in 1132 bytes} [Mon Jul 11 14:26:03 2022] POST /identity/v3/users => generated 297 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:26:03.701706 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab73ad0-06db-4ed7-b036-53939a45ae28 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:03.729324 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807402c9-90ba-416a-a200-7bafd15ed105 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:03.734014 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:03.807361 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4dbc79-9553-4385-b0cf-6197e06b0858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:03.808890 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4dbc79-9553-4385-b0cf-6197e06b0858 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:03.809322 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4dbc79-9553-4385-b0cf-6197e06b0858 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:03.809791 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4dbc79-9553-4385-b0cf-6197e06b0858 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:03.879784 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab73ad0-06db-4ed7-b036-53939a45ae28 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:03.930237 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4dbc79-9553-4385-b0cf-6197e06b0858 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:03.931720 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4dbc79-9553-4385-b0cf-6197e06b0858 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:03.933442 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa444c8a-236d-47bb-bf1f-89ddcb4ea296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:03.935934 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa444c8a-236d-47bb-bf1f-89ddcb4ea296 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:03.936193 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa444c8a-236d-47bb-bf1f-89ddcb4ea296 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:03.936569 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa444c8a-236d-47bb-bf1f-89ddcb4ea296 None admin] PATH_INFO: `/v3/users/a9d1b2408846472eaeba7092085ce39b` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:03.954991 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa444c8a-236d-47bb-bf1f-89ddcb4ea296 None admin] RBAC: Authorizing `identity:get_user(user_id=a9d1b2408846472eaeba7092085ce39b)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:03.956542 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa444c8a-236d-47bb-bf1f-89ddcb4ea296 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:03.958553 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 89/187] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Jul 11 14:26:03 2022] GET /identity/v3/users/a9d1b2408846472eaeba7092085ce39b => generated 283 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:03.959155 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa444c8a-236d-47bb-bf1f-89ddcb4ea296 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:03.985646 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:04.067576 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:04.084245 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 99/188] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Jul 11 14:26:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 492 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 14:26:04.084245 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4dbc79-9553-4385-b0cf-6197e06b0858 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:04.118841 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa444c8a-236d-47bb-bf1f-89ddcb4ea296 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:04.170074 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d0a5e0-1b99-445d-8221-1600dc3066cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:04.170765 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d0a5e0-1b99-445d-8221-1600dc3066cd None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:04.171339 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d0a5e0-1b99-445d-8221-1600dc3066cd None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:04.171623 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d0a5e0-1b99-445d-8221-1600dc3066cd None admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:04.173153 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d0a5e0-1b99-445d-8221-1600dc3066cd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:04.173472 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d0a5e0-1b99-445d-8221-1600dc3066cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:04.175209 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d0a5e0-1b99-445d-8221-1600dc3066cd None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:04.189168 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 90/189] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Jul 11 14:26:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:04.190867 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c78237-d671-4d18-97a6-e8eaff6ac3e5 None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:04.191698 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c78237-d671-4d18-97a6-e8eaff6ac3e5 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:04.191988 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c78237-d671-4d18-97a6-e8eaff6ac3e5 None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:04.194286 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 91/190] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:26:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:26:04.195619 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c78237-d671-4d18-97a6-e8eaff6ac3e5 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:04.214532 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4dbc79-9553-4385-b0cf-6197e06b0858 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:04.280700 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c16714-5e43-4007-bb68-7938b50aec24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:04.282927 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c16714-5e43-4007-bb68-7938b50aec24 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:04.284021 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c16714-5e43-4007-bb68-7938b50aec24 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:04.284667 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c16714-5e43-4007-bb68-7938b50aec24 None admin] PATH_INFO: `/v3/projects/02bf3f49198a4e809a9a6d408d01baa9` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:04.288158 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c16714-5e43-4007-bb68-7938b50aec24 None admin] RBAC: Authorizing `identity:get_project(project_id=02bf3f49198a4e809a9a6d408d01baa9)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:04.291429 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c16714-5e43-4007-bb68-7938b50aec24 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:04.295321 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 100/191] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Jul 11 14:26:04 2022] GET /identity/v3/projects/02bf3f49198a4e809a9a6d408d01baa9 => generated 298 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:04.300813 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c16714-5e43-4007-bb68-7938b50aec24 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:04.318128 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:04.340971 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c78237-d671-4d18-97a6-e8eaff6ac3e5 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:04.394385 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b19276-fee3-4459-9738-ebc84378c44d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:04.395174 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b19276-fee3-4459-9738-ebc84378c44d None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:04.395466 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b19276-fee3-4459-9738-ebc84378c44d None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:04.396460 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b19276-fee3-4459-9738-ebc84378c44d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:04.401160 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:04.461067 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c16714-5e43-4007-bb68-7938b50aec24 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:04.494690 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b19276-fee3-4459-9738-ebc84378c44d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:04.496573 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b19276-fee3-4459-9738-ebc84378c44d None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:04.514981 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b55675a-311c-4dcd-9a8d-58cb04c40cc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:04.516875 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b55675a-311c-4dcd-9a8d-58cb04c40cc0 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:04.517720 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b55675a-311c-4dcd-9a8d-58cb04c40cc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:04.518307 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b55675a-311c-4dcd-9a8d-58cb04c40cc0 None admin] PATH_INFO: `/v3/projects/02bf3f49198a4e809a9a6d408d01baa9` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:04.520629 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b55675a-311c-4dcd-9a8d-58cb04c40cc0 None admin] RBAC: Authorizing `identity:get_project(project_id=02bf3f49198a4e809a9a6d408d01baa9)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:04.523580 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b55675a-311c-4dcd-9a8d-58cb04c40cc0 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:04.527407 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 101/192] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Jul 11 14:26:04 2022] GET /identity/v3/projects/02bf3f49198a4e809a9a6d408d01baa9 => generated 298 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:04.529282 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b55675a-311c-4dcd-9a8d-58cb04c40cc0 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:04.619399 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 92/193] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Jul 11 14:26:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 14:26:04.621381 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8eda5c-bd2c-45b0-a42b-aa819deda2d3 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:04.621857 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8eda5c-bd2c-45b0-a42b-aa819deda2d3 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:04.622312 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8eda5c-bd2c-45b0-a42b-aa819deda2d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:04.627435 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:04.644085 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-fa8eda5c-bd2c-45b0-a42b-aa819deda2d3 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:26:04.645859 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-fa8eda5c-bd2c-45b0-a42b-aa819deda2d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:26:04.656540 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b55675a-311c-4dcd-9a8d-58cb04c40cc0 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:04.681074 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:04.702896 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555ed174-e290-4a4e-bb6a-a576b19420e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:04.704092 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555ed174-e290-4a4e-bb6a-a576b19420e1 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:04.704838 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555ed174-e290-4a4e-bb6a-a576b19420e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:04.705259 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555ed174-e290-4a4e-bb6a-a576b19420e1 None admin] PATH_INFO: `/v3/users/a9d1b2408846472eaeba7092085ce39b` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:04.706762 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555ed174-e290-4a4e-bb6a-a576b19420e1 None admin] RBAC: Authorizing `identity:get_user(user_id=a9d1b2408846472eaeba7092085ce39b)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:04.708658 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555ed174-e290-4a4e-bb6a-a576b19420e1 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:04.710701 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 102/194] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Jul 11 14:26:04 2022] GET /identity/v3/users/a9d1b2408846472eaeba7092085ce39b => generated 283 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:04.712580 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555ed174-e290-4a4e-bb6a-a576b19420e1 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:04.732982 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 93/195] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:26:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:26:04.733817 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8eda5c-bd2c-45b0-a42b-aa819deda2d3 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:04.836516 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555ed174-e290-4a4e-bb6a-a576b19420e1 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:04.858483 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8eda5c-bd2c-45b0-a42b-aa819deda2d3 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:04.877545 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7328294e-0637-4b36-8463-fb160c078899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:04.878556 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7328294e-0637-4b36-8463-fb160c078899 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:04.879068 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7328294e-0637-4b36-8463-fb160c078899 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:04.879528 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7328294e-0637-4b36-8463-fb160c078899 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:04.880647 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7328294e-0637-4b36-8463-fb160c078899 None admin] RBAC: Adding query filter params (role.id=8eff41f243c843ed95505a488ca6eada, scope.project.id=02bf3f49198a4e809a9a6d408d01baa9, user.id=9196d98d4897499d92e1ce81c2f9bdf8) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:04.881179 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7328294e-0637-4b36-8463-fb160c078899 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:04.883138 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7328294e-0637-4b36-8463-fb160c078899 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:04.890670 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 103/196] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Jul 11 14:26:04 2022] GET /identity/v3/role_assignments?user.id=9196d98d4897499d92e1ce81c2f9bdf8&scope.project.id=02bf3f49198a4e809a9a6d408d01baa9&role.id=8eff41f243c843ed95505a488ca6eada => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:04.891933 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7328294e-0637-4b36-8463-fb160c078899 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:04.900618 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0b23ad-510e-4d8d-a4c0-a344d64413ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:04.901305 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0b23ad-510e-4d8d-a4c0-a344d64413ac None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:04.901588 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0b23ad-510e-4d8d-a4c0-a344d64413ac None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:04.901861 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0b23ad-510e-4d8d-a4c0-a344d64413ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:04.902730 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0b23ad-510e-4d8d-a4c0-a344d64413ac None admin] RBAC: Adding query filter params (role.id=b46df176b0fe479da63c318db225bed4, scope.project.id=02bf3f49198a4e809a9a6d408d01baa9, user.id=c2bda2fc12a24c48ba42c84873d8bfa1) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:04.903043 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0b23ad-510e-4d8d-a4c0-a344d64413ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:04.904792 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0b23ad-510e-4d8d-a4c0-a344d64413ac None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:04.910101 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:04.913136 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 94/197] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Jul 11 14:26:04 2022] GET /identity/v3/role_assignments?user.id=c2bda2fc12a24c48ba42c84873d8bfa1&scope.project.id=02bf3f49198a4e809a9a6d408d01baa9&role.id=b46df176b0fe479da63c318db225bed4 => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:04.916261 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0b23ad-510e-4d8d-a4c0-a344d64413ac None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:04.950160 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:05.064417 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0b23ad-510e-4d8d-a4c0-a344d64413ac None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:05.162146 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7328294e-0637-4b36-8463-fb160c078899 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:05.178993 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520470ea-e27d-4948-9a35-e0cec3dd120e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:05.179733 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520470ea-e27d-4948-9a35-e0cec3dd120e None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:05.180014 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520470ea-e27d-4948-9a35-e0cec3dd120e None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:05.180330 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520470ea-e27d-4948-9a35-e0cec3dd120e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:05.249545 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a60bda-6dab-4b46-bdfe-fa837fd283d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:05.250457 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a60bda-6dab-4b46-bdfe-fa837fd283d0 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:05.250739 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a60bda-6dab-4b46-bdfe-fa837fd283d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:05.251016 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a60bda-6dab-4b46-bdfe-fa837fd283d0 None admin] PATH_INFO: `/v3/projects/746cf064ee5344ddb5daa2377fd66d25` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:05.253582 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a60bda-6dab-4b46-bdfe-fa837fd283d0 None admin] RBAC: Authorizing `identity:get_project(project_id=746cf064ee5344ddb5daa2377fd66d25)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:05.255062 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a60bda-6dab-4b46-bdfe-fa837fd283d0 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:05.259252 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 104/198] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Jul 11 14:26:04 2022] GET /identity/v3/projects/746cf064ee5344ddb5daa2377fd66d25 => generated 302 bytes in 367 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:05.262867 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a60bda-6dab-4b46-bdfe-fa837fd283d0 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:05.343478 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520470ea-e27d-4948-9a35-e0cec3dd120e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:05.344964 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520470ea-e27d-4948-9a35-e0cec3dd120e None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:05.377921 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:05.408609 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:05.432782 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a60bda-6dab-4b46-bdfe-fa837fd283d0 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:05.480177 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 95/199] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Jul 11 14:26:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 561 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 14:26:05.480177 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520470ea-e27d-4948-9a35-e0cec3dd120e None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:05.488860 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928ba52c-5cc4-473a-b482-a6560682c406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:05.490474 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928ba52c-5cc4-473a-b482-a6560682c406 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:05.490997 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928ba52c-5cc4-473a-b482-a6560682c406 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:05.492097 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928ba52c-5cc4-473a-b482-a6560682c406 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:05.506834 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928ba52c-5cc4-473a-b482-a6560682c406 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:26:05.515811 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application [None req-928ba52c-5cc4-473a-b482-a6560682c406 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 14:26:05.515811 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:05.515811 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:26:05.515811 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:26:05.515811 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:26:05.515811 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:26:05.515811 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:26:05.515811 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:26:05.515811 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:26:05.515811 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:26:05.515811 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:26:05.515811 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:26:05.515811 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:26:05.515811 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:26:05.515811 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:26:05.515811 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:26:05.516795 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:26:05.516795 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:26:05.516795 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:26:05.516795 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:26:05.516795 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:26:05.516795 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:26:05.516795 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:26:05.516795 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:26:05.516795 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:26:05.516795 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:26:05.516795 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:26:05.516795 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application with Lock( Jul 11 14:26:05.516795 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:26:05.516795 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:26:05.516795 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:26:05.516795 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:26:05.517592 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:26:05.517592 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:26:05.517592 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:26:05.517592 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:26:05.517592 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:26:05.517592 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:26:05.517592 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:26:05.517592 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:26:05.517592 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:26:05.517592 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:26:05.517592 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 14:26:05.517592 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Jul 11 14:26:05.520148 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 105/200] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Jul 11 14:26:05 2022] GET /identity/v3/roles/reader => generated 84 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:26:05.521421 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928ba52c-5cc4-473a-b482-a6560682c406 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:05.606295 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520470ea-e27d-4948-9a35-e0cec3dd120e None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:05.636773 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:05.647964 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63aebaf7-5e53-480b-9ce5-b43d7e81b02f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:05.649231 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aebaf7-5e53-480b-9ce5-b43d7e81b02f None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:05.649704 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aebaf7-5e53-480b-9ce5-b43d7e81b02f None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:05.650159 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aebaf7-5e53-480b-9ce5-b43d7e81b02f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:05.651287 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63aebaf7-5e53-480b-9ce5-b43d7e81b02f None admin] RBAC: Adding query filter params (role.id=b46df176b0fe479da63c318db225bed4, scope.project.id=746cf064ee5344ddb5daa2377fd66d25, user.id=a9d1b2408846472eaeba7092085ce39b) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:05.651782 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63aebaf7-5e53-480b-9ce5-b43d7e81b02f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:05.651902 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928ba52c-5cc4-473a-b482-a6560682c406 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:05.653602 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63aebaf7-5e53-480b-9ce5-b43d7e81b02f None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:05.660699 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 96/201] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Jul 11 14:26:05 2022] GET /identity/v3/role_assignments?user.id=a9d1b2408846472eaeba7092085ce39b&scope.project.id=746cf064ee5344ddb5daa2377fd66d25&role.id=b46df176b0fe479da63c318db225bed4 => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:05.667598 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63aebaf7-5e53-480b-9ce5-b43d7e81b02f None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:05.730545 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e66283a-57c8-4db6-948c-a1eb0a1479ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:05.731448 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e66283a-57c8-4db6-948c-a1eb0a1479ff None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:05.731729 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e66283a-57c8-4db6-948c-a1eb0a1479ff None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:05.732006 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e66283a-57c8-4db6-948c-a1eb0a1479ff None admin] PATH_INFO: `/v3/projects/746cf064ee5344ddb5daa2377fd66d25` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:05.734285 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e66283a-57c8-4db6-948c-a1eb0a1479ff None admin] RBAC: Authorizing `identity:get_project(project_id=746cf064ee5344ddb5daa2377fd66d25)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:05.735779 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e66283a-57c8-4db6-948c-a1eb0a1479ff None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:05.737628 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 106/202] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Jul 11 14:26:05 2022] GET /identity/v3/projects/746cf064ee5344ddb5daa2377fd66d25 => generated 302 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:05.747318 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e66283a-57c8-4db6-948c-a1eb0a1479ff None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:05.764806 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:05.915962 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e66283a-57c8-4db6-948c-a1eb0a1479ff None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:05.922758 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63aebaf7-5e53-480b-9ce5-b43d7e81b02f None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:05.958583 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a033a601-a3fb-4279-ab66-9fe28acf0016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:05.959610 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a033a601-a3fb-4279-ab66-9fe28acf0016 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:05.960257 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a033a601-a3fb-4279-ab66-9fe28acf0016 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:05.961104 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a033a601-a3fb-4279-ab66-9fe28acf0016 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:05.962203 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a033a601-a3fb-4279-ab66-9fe28acf0016 None admin] RBAC: Adding query filter params (role.id=7d8b0827910944f29bfa3a92d6cb7c92, scope.project.id=746cf064ee5344ddb5daa2377fd66d25, user.id=a9d1b2408846472eaeba7092085ce39b) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:05.963785 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a033a601-a3fb-4279-ab66-9fe28acf0016 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:05.965556 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a033a601-a3fb-4279-ab66-9fe28acf0016 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:05.980300 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5921cc-f656-499a-a517-3a257a6e0091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:05.980300 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5921cc-f656-499a-a517-3a257a6e0091 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:05.980300 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5921cc-f656-499a-a517-3a257a6e0091 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:05.980300 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5921cc-f656-499a-a517-3a257a6e0091 None admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:05.980718 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5921cc-f656-499a-a517-3a257a6e0091 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:05.980718 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5921cc-f656-499a-a517-3a257a6e0091 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:05.981194 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5921cc-f656-499a-a517-3a257a6e0091 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:05.981695 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 107/203] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Jul 11 14:26:05 2022] GET /identity/v3/role_assignments?user.id=a9d1b2408846472eaeba7092085ce39b&scope.project.id=746cf064ee5344ddb5daa2377fd66d25&role.id=7d8b0827910944f29bfa3a92d6cb7c92 => generated 259 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:26:05.992607 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 97/204] 10.222.0.70 () {56 vars in 1101 bytes} [Mon Jul 11 14:26:05 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:06.002162 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a033a601-a3fb-4279-ab66-9fe28acf0016 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:06.110805 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:06.161701 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a033a601-a3fb-4279-ab66-9fe28acf0016 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:06.212874 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a9849e-5120-4623-9091-3e02acb8a832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:06.214042 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a9849e-5120-4623-9091-3e02acb8a832 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:06.214500 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a9849e-5120-4623-9091-3e02acb8a832 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:06.214965 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a9849e-5120-4623-9091-3e02acb8a832 None admin] PATH_INFO: `/v3/users/f2dd64eee9154f3e927c93902ba26fe4` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:06.216465 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a9849e-5120-4623-9091-3e02acb8a832 None admin] RBAC: Authorizing `identity:get_user(user_id=f2dd64eee9154f3e927c93902ba26fe4)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:06.218091 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a9849e-5120-4623-9091-3e02acb8a832 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:06.220700 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 108/205] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Jul 11 14:26:06 2022] GET /identity/v3/users/f2dd64eee9154f3e927c93902ba26fe4 => generated 289 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:06.229182 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5921cc-f656-499a-a517-3a257a6e0091 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:06.383295 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:06.460937 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5921cc-f656-499a-a517-3a257a6e0091 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:06.509124 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634d26b8-ccac-45ad-942d-c54ff466cfa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:06.509728 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634d26b8-ccac-45ad-942d-c54ff466cfa5 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:06.510016 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634d26b8-ccac-45ad-942d-c54ff466cfa5 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:06.510295 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634d26b8-ccac-45ad-942d-c54ff466cfa5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:06.624491 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634d26b8-ccac-45ad-942d-c54ff466cfa5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:06.626050 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634d26b8-ccac-45ad-942d-c54ff466cfa5 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:06.711692 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:06.744120 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3f76f6-ba7f-43a7-86f2-5a9bc8be2851 None None] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:06.744673 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3f76f6-ba7f-43a7-86f2-5a9bc8be2851 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:06.744783 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3f76f6-ba7f-43a7-86f2-5a9bc8be2851 None None] PATH_INFO: `/` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:06.746182 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 109/206] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:26:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 14:26:06.756233 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2478eafc-8dec-467b-952d-3c77c35bdf73 None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:06.756233 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2478eafc-8dec-467b-952d-3c77c35bdf73 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:06.756233 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2478eafc-8dec-467b-952d-3c77c35bdf73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:06.772777 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-2478eafc-8dec-467b-952d-3c77c35bdf73 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:26:06.774481 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-2478eafc-8dec-467b-952d-3c77c35bdf73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:26:06.795678 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 98/207] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Jul 11 14:26:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 568 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 11 14:26:06.803903 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634d26b8-ccac-45ad-942d-c54ff466cfa5 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:06.878398 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 110/208] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:26:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 14:26:06.946532 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2478eafc-8dec-467b-952d-3c77c35bdf73 None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:07.003777 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634d26b8-ccac-45ad-942d-c54ff466cfa5 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:07.028244 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:07.050051 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aceffd44-5cf7-4829-b881-3b16338c116d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:07.051327 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceffd44-5cf7-4829-b881-3b16338c116d None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:07.051888 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceffd44-5cf7-4829-b881-3b16338c116d None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:07.052417 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceffd44-5cf7-4829-b881-3b16338c116d None admin] PATH_INFO: `/v3/projects/02bf3f49198a4e809a9a6d408d01baa9` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:07.054504 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aceffd44-5cf7-4829-b881-3b16338c116d None admin] RBAC: Authorizing `identity:get_project(project_id=02bf3f49198a4e809a9a6d408d01baa9)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:07.056190 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aceffd44-5cf7-4829-b881-3b16338c116d None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:07.058396 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 99/209] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Jul 11 14:26:06 2022] GET /identity/v3/projects/02bf3f49198a4e809a9a6d408d01baa9 => generated 298 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:07.060092 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba5d390-6aa1-4b8a-878e-40e94cc9415d None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:07.060630 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba5d390-6aa1-4b8a-878e-40e94cc9415d None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:07.061179 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba5d390-6aa1-4b8a-878e-40e94cc9415d None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:07.062794 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 100/210] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:26:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:26:07.068073 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba5d390-6aa1-4b8a-878e-40e94cc9415d None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:07.068568 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2478eafc-8dec-467b-952d-3c77c35bdf73 None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:07.095950 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:07.115487 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75ebd75-5049-49b6-9837-a4c8896921ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:07.117170 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75ebd75-5049-49b6-9837-a4c8896921ea None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:07.117759 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75ebd75-5049-49b6-9837-a4c8896921ea None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:07.118072 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75ebd75-5049-49b6-9837-a4c8896921ea None admin] PATH_INFO: `/v3/roles/member` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:07.142249 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75ebd75-5049-49b6-9837-a4c8896921ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:26:07.153338 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application [None req-f75ebd75-5049-49b6-9837-a4c8896921ea None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 14:26:07.153338 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:07.153338 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:26:07.153338 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:26:07.153338 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:26:07.153338 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:26:07.153338 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:26:07.153338 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:26:07.153338 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:26:07.153338 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:26:07.153338 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:26:07.153338 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:26:07.153338 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:26:07.153338 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:26:07.153338 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:26:07.153338 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:26:07.154790 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:26:07.154790 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:26:07.154790 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:26:07.154790 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:26:07.154790 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:26:07.154790 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:26:07.154790 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:26:07.154790 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:26:07.154790 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:26:07.154790 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:26:07.154790 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:26:07.154790 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application with Lock( Jul 11 14:26:07.154790 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:26:07.154790 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:26:07.154790 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:26:07.154790 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:26:07.156394 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:26:07.156394 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:26:07.156394 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:26:07.156394 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:26:07.156394 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:26:07.156394 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:26:07.156394 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:26:07.156394 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:26:07.156394 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:26:07.156394 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:26:07.156394 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 14:26:07.156394 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Jul 11 14:26:07.156394 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 111/211] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Jul 11 14:26:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:26:07.157670 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5adb1a7-6943-4a78-aca1-fa4d89489f9c None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:07.157670 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5adb1a7-6943-4a78-aca1-fa4d89489f9c None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:07.157910 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5adb1a7-6943-4a78-aca1-fa4d89489f9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:07.184842 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-c5adb1a7-6943-4a78-aca1-fa4d89489f9c None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:26:07.186059 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-c5adb1a7-6943-4a78-aca1-fa4d89489f9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:26:07.242020 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba5d390-6aa1-4b8a-878e-40e94cc9415d None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:07.287298 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6421270b-6824-4ae0-b128-8f4531cada50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:07.288545 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6421270b-6824-4ae0-b128-8f4531cada50 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:07.289631 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6421270b-6824-4ae0-b128-8f4531cada50 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:07.289631 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6421270b-6824-4ae0-b128-8f4531cada50 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:07.290890 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6421270b-6824-4ae0-b128-8f4531cada50 None admin] RBAC: Adding query filter params (role.id=09e9dee5b1e848eaba8cef2325325d08, scope.project.id=02bf3f49198a4e809a9a6d408d01baa9, user.id=f2dd64eee9154f3e927c93902ba26fe4) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:07.291207 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6421270b-6824-4ae0-b128-8f4531cada50 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:07.296800 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6421270b-6824-4ae0-b128-8f4531cada50 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:07.297521 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 112/212] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:26:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:26:07.299207 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5adb1a7-6943-4a78-aca1-fa4d89489f9c None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:07.324758 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 101/213] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Jul 11 14:26:07 2022] GET /identity/v3/role_assignments?user.id=f2dd64eee9154f3e927c93902ba26fe4&scope.project.id=02bf3f49198a4e809a9a6d408d01baa9&role.id=09e9dee5b1e848eaba8cef2325325d08 => generated 608 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:07.337910 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6421270b-6824-4ae0-b128-8f4531cada50 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:07.422221 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:07.480436 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5adb1a7-6943-4a78-aca1-fa4d89489f9c None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:07.540754 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671b602c-ee7e-4458-b6cc-f6ea48d41dc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:07.541816 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671b602c-ee7e-4458-b6cc-f6ea48d41dc7 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:07.542315 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671b602c-ee7e-4458-b6cc-f6ea48d41dc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:07.542805 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671b602c-ee7e-4458-b6cc-f6ea48d41dc7 None admin] PATH_INFO: `/v3/roles` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:07.545099 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671b602c-ee7e-4458-b6cc-f6ea48d41dc7 None admin] RBAC: Adding query filter params (name=member) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:07.545978 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671b602c-ee7e-4458-b6cc-f6ea48d41dc7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:07.553001 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671b602c-ee7e-4458-b6cc-f6ea48d41dc7 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:07.553580 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:07.583650 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 113/214] 10.222.0.70 () {56 vars in 1101 bytes} [Mon Jul 11 14:26:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:07.594955 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671b602c-ee7e-4458-b6cc-f6ea48d41dc7 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:07.604877 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6421270b-6824-4ae0-b128-8f4531cada50 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:07.656280 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146d08a0-f789-4a43-bbb1-f69509288af5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:07.657732 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146d08a0-f789-4a43-bbb1-f69509288af5 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:07.658214 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146d08a0-f789-4a43-bbb1-f69509288af5 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:07.658683 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146d08a0-f789-4a43-bbb1-f69509288af5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:07.660949 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146d08a0-f789-4a43-bbb1-f69509288af5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:07.662839 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146d08a0-f789-4a43-bbb1-f69509288af5 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:07.665343 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 102/215] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 11 14:26:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:07.671059 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146d08a0-f789-4a43-bbb1-f69509288af5 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:07.807220 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671b602c-ee7e-4458-b6cc-f6ea48d41dc7 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:07.820095 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146d08a0-f789-4a43-bbb1-f69509288af5 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:07.848968 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:07.864903 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c641903-839a-4583-ad4c-a8fda8ee3529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:07.865891 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c641903-839a-4583-ad4c-a8fda8ee3529 None admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:07.867405 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c641903-839a-4583-ad4c-a8fda8ee3529 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:07.867872 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c641903-839a-4583-ad4c-a8fda8ee3529 None admin] PATH_INFO: `/v3/users` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:07.868812 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c641903-839a-4583-ad4c-a8fda8ee3529 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:07.870692 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c641903-839a-4583-ad4c-a8fda8ee3529 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:07.887946 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f1d9bc-ceb5-4652-b192-d650a2273315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:07.890412 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f1d9bc-ceb5-4652-b192-d650a2273315 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:07.890412 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f1d9bc-ceb5-4652-b192-d650a2273315 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:07.890412 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f1d9bc-ceb5-4652-b192-d650a2273315 None admin] PATH_INFO: `/v3/users/acda269970984c47906ad0c6b5707dcc` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:07.904825 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 103/216] 10.222.0.70 () {60 vars in 1132 bytes} [Mon Jul 11 14:26:07 2022] POST /identity/v3/users => generated 297 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:26:07.928252 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f1d9bc-ceb5-4652-b192-d650a2273315 None admin] RBAC: Authorizing `identity:get_user(user_id=acda269970984c47906ad0c6b5707dcc)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:07.931512 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f1d9bc-ceb5-4652-b192-d650a2273315 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:07.938704 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 114/217] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Jul 11 14:26:07 2022] GET /identity/v3/users/acda269970984c47906ad0c6b5707dcc => generated 297 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:07.944475 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c641903-839a-4583-ad4c-a8fda8ee3529 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:07.961490 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:08.075852 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c641903-839a-4583-ad4c-a8fda8ee3529 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:08.118426 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130a22a7-be67-4c2f-a370-ef577703f36f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:08.119369 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130a22a7-be67-4c2f-a370-ef577703f36f None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:08.119806 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130a22a7-be67-4c2f-a370-ef577703f36f None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:08.120240 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130a22a7-be67-4c2f-a370-ef577703f36f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:08.204506 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130a22a7-be67-4c2f-a370-ef577703f36f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:08.206282 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130a22a7-be67-4c2f-a370-ef577703f36f None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:08.220174 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:08.327192 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 104/218] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Jul 11 14:26:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 14:26:08.334033 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f1d9bc-ceb5-4652-b192-d650a2273315 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:08.463116 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f1d9bc-ceb5-4652-b192-d650a2273315 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:08.511143 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e16d89-d849-4666-a52d-a34e27c5c99e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:08.512031 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e16d89-d849-4666-a52d-a34e27c5c99e None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:08.512340 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e16d89-d849-4666-a52d-a34e27c5c99e None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:08.512615 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e16d89-d849-4666-a52d-a34e27c5c99e None admin] PATH_INFO: `/v3/projects/746cf064ee5344ddb5daa2377fd66d25` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:08.513858 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e16d89-d849-4666-a52d-a34e27c5c99e None admin] RBAC: Authorizing `identity:get_project(project_id=746cf064ee5344ddb5daa2377fd66d25)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:08.515314 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e16d89-d849-4666-a52d-a34e27c5c99e None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:08.517394 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 115/219] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Jul 11 14:26:08 2022] GET /identity/v3/projects/746cf064ee5344ddb5daa2377fd66d25 => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:26:08.524302 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130a22a7-be67-4c2f-a370-ef577703f36f None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:08.649329 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130a22a7-be67-4c2f-a370-ef577703f36f None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:08.661903 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:08.696910 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7723a756-7e3d-4496-8b3a-ad0a674154ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:08.697592 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7723a756-7e3d-4496-8b3a-ad0a674154ba None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:08.697869 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7723a756-7e3d-4496-8b3a-ad0a674154ba None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:08.698149 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7723a756-7e3d-4496-8b3a-ad0a674154ba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:08.698988 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7723a756-7e3d-4496-8b3a-ad0a674154ba None admin] RBAC: Adding query filter params (role.id=8eff41f243c843ed95505a488ca6eada, scope.project.id=746cf064ee5344ddb5daa2377fd66d25, user.id=acda269970984c47906ad0c6b5707dcc) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:08.699303 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7723a756-7e3d-4496-8b3a-ad0a674154ba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:08.700878 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7723a756-7e3d-4496-8b3a-ad0a674154ba None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:08.707981 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 105/220] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Jul 11 14:26:08 2022] GET /identity/v3/role_assignments?user.id=acda269970984c47906ad0c6b5707dcc&scope.project.id=746cf064ee5344ddb5daa2377fd66d25&role.id=8eff41f243c843ed95505a488ca6eada => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:09.603329 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2d05b7-d2a0-46e1-84fb-2687c7a7e8ee None None] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:09.604914 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2d05b7-d2a0-46e1-84fb-2687c7a7e8ee None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:09.605698 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2d05b7-d2a0-46e1-84fb-2687c7a7e8ee None None] PATH_INFO: `/` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:09.609049 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 116/221] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:26:09 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:26:09.627940 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516f0972-29ca-4b6e-922f-708f519aefba None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:09.628986 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516f0972-29ca-4b6e-922f-708f519aefba None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:09.629771 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516f0972-29ca-4b6e-922f-708f519aefba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:09.665942 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-516f0972-29ca-4b6e-922f-708f519aefba None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:26:09.669274 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-516f0972-29ca-4b6e-922f-708f519aefba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:26:09.775830 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf15c32-522a-437e-a695-d01fa5e8e482 None None] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:09.776790 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf15c32-522a-437e-a695-d01fa5e8e482 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:09.777531 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf15c32-522a-437e-a695-d01fa5e8e482 None None] PATH_INFO: `/` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:09.785029 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 117/222] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:26:09 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:26:09.790974 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1861650b-814a-4e48-a0f6-bc7b77aad8d4 None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:09.792017 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1861650b-814a-4e48-a0f6-bc7b77aad8d4 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:09.792839 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1861650b-814a-4e48-a0f6-bc7b77aad8d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:09.862284 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-1861650b-814a-4e48-a0f6-bc7b77aad8d4 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:26:09.864567 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-1861650b-814a-4e48-a0f6-bc7b77aad8d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:26:09.878090 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 106/223] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:26:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:26:09.917542 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516f0972-29ca-4b6e-922f-708f519aefba None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:10.018802 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:10.091502 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 118/224] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:26:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:26:10.141049 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516f0972-29ca-4b6e-922f-708f519aefba None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:10.146599 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:10.147997 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1861650b-814a-4e48-a0f6-bc7b77aad8d4 None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:10.281404 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febbc9f3-aee2-4cf2-ab05-9ffd44fbade3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:10.282756 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febbc9f3-aee2-4cf2-ab05-9ffd44fbade3 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:10.283250 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febbc9f3-aee2-4cf2-ab05-9ffd44fbade3 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:10.283742 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febbc9f3-aee2-4cf2-ab05-9ffd44fbade3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:10.304569 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1861650b-814a-4e48-a0f6-bc7b77aad8d4 None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:10.329696 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febbc9f3-aee2-4cf2-ab05-9ffd44fbade3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:26:10.344402 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-febbc9f3-aee2-4cf2-ab05-9ffd44fbade3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:26:10.344402 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:10.344402 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:26:10.344402 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:26:10.344402 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:26:10.344402 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:26:10.344402 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:26:10.344402 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:26:10.344402 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:26:10.344402 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:26:10.344402 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:26:10.344402 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:26:10.344402 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:26:10.344402 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:26:10.344402 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:26:10.344402 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:26:10.346137 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:26:10.346137 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:26:10.346137 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:26:10.346137 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:26:10.346137 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:26:10.346137 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:26:10.346137 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:26:10.346137 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:26:10.346137 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:26:10.346137 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:26:10.346137 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:26:10.346137 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( Jul 11 14:26:10.346137 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:26:10.346137 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:26:10.346137 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:26:10.346137 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:26:10.347641 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:26:10.347641 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:26:10.347641 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:26:10.347641 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:26:10.347641 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:26:10.347641 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:26:10.347641 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:26:10.347641 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:26:10.347641 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:26:10.347641 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:26:10.347641 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:26:10.347641 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Jul 11 14:26:10.347641 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 107/225] 10.222.0.70 () {56 vars in 1096 bytes} [Mon Jul 11 14:26:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 430 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:26:10.377809 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febbc9f3-aee2-4cf2-ab05-9ffd44fbade3 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:10.383204 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc5fd72-acfb-490f-b868-40b440ab18f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:10.384270 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc5fd72-acfb-490f-b868-40b440ab18f5 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:10.384772 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc5fd72-acfb-490f-b868-40b440ab18f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:10.385255 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc5fd72-acfb-490f-b868-40b440ab18f5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:10.406191 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc5fd72-acfb-490f-b868-40b440ab18f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:26:10.430754 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application [None req-1bc5fd72-acfb-490f-b868-40b440ab18f5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 14:26:10.430754 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:10.430754 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:26:10.430754 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:26:10.430754 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:26:10.430754 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:26:10.430754 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:26:10.430754 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:26:10.430754 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:26:10.430754 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:26:10.430754 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:26:10.430754 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:26:10.430754 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:26:10.430754 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:26:10.430754 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:26:10.430754 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:26:10.432496 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:26:10.432496 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:26:10.432496 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:26:10.432496 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:26:10.432496 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:26:10.432496 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:26:10.432496 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:26:10.432496 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:26:10.432496 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:26:10.432496 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:26:10.432496 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:26:10.432496 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application with Lock( Jul 11 14:26:10.432496 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:26:10.432496 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:26:10.432496 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:26:10.432496 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:26:10.434284 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:26:10.434284 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:26:10.434284 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:26:10.434284 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:26:10.434284 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:26:10.434284 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:26:10.434284 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:26:10.434284 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:26:10.434284 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:26:10.434284 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:26:10.434284 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 14:26:10.434284 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Jul 11 14:26:10.439039 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 119/226] 10.222.0.70 () {56 vars in 1114 bytes} [Mon Jul 11 14:26:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:26:10.449045 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc5fd72-acfb-490f-b868-40b440ab18f5 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:10.567494 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:10.708066 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc5fd72-acfb-490f-b868-40b440ab18f5 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:10.781605 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febbc9f3-aee2-4cf2-ab05-9ffd44fbade3 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:10.785865 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cbf0c2-d62d-4c35-a6a0-0e72c9ba58c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:10.787410 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cbf0c2-d62d-4c35-a6a0-0e72c9ba58c3 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:10.788745 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cbf0c2-d62d-4c35-a6a0-0e72c9ba58c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:10.792499 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cbf0c2-d62d-4c35-a6a0-0e72c9ba58c3 None admin] PATH_INFO: `/v3/roles` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:10.794399 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cbf0c2-d62d-4c35-a6a0-0e72c9ba58c3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:10.795194 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cbf0c2-d62d-4c35-a6a0-0e72c9ba58c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:10.798536 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cbf0c2-d62d-4c35-a6a0-0e72c9ba58c3 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:10.825918 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 120/227] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Jul 11 14:26:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 378 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:10.834043 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cbf0c2-d62d-4c35-a6a0-0e72c9ba58c3 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:10.935327 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b0066a-8c1c-4569-b09c-8aea49dd22e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:10.938549 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b0066a-8c1c-4569-b09c-8aea49dd22e7 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:10.941733 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b0066a-8c1c-4569-b09c-8aea49dd22e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:10.942593 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b0066a-8c1c-4569-b09c-8aea49dd22e7 None admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:10.946010 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b0066a-8c1c-4569-b09c-8aea49dd22e7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:10.949861 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b0066a-8c1c-4569-b09c-8aea49dd22e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:10.954999 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b0066a-8c1c-4569-b09c-8aea49dd22e7 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:10.996359 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 108/228] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Jul 11 14:26:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 614 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:11.026549 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b0066a-8c1c-4569-b09c-8aea49dd22e7 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:11.116393 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:11.126088 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cbf0c2-d62d-4c35-a6a0-0e72c9ba58c3 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:11.136786 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:11.208480 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e173c86-888a-4856-8863-a9ca91048da6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:11.211714 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e173c86-888a-4856-8863-a9ca91048da6 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:11.212701 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e173c86-888a-4856-8863-a9ca91048da6 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:11.213483 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e173c86-888a-4856-8863-a9ca91048da6 None admin] PATH_INFO: `/v3/users/a9d1b2408846472eaeba7092085ce39b` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:11.218049 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e173c86-888a-4856-8863-a9ca91048da6 None admin] RBAC: Authorizing `identity:get_user(user_id=a9d1b2408846472eaeba7092085ce39b)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:11.223727 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e173c86-888a-4856-8863-a9ca91048da6 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:11.229931 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 121/229] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Jul 11 14:26:10 2022] GET /identity/v3/users/a9d1b2408846472eaeba7092085ce39b => generated 283 bytes in 397 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:11.240881 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e173c86-888a-4856-8863-a9ca91048da6 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:11.394392 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b0066a-8c1c-4569-b09c-8aea49dd22e7 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:11.502654 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e173c86-888a-4856-8863-a9ca91048da6 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:11.505395 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1103dadd-bdd1-4fdb-9bf8-52567b76df0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:11.506931 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1103dadd-bdd1-4fdb-9bf8-52567b76df0c None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:11.507424 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1103dadd-bdd1-4fdb-9bf8-52567b76df0c None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:11.507881 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1103dadd-bdd1-4fdb-9bf8-52567b76df0c None admin] PATH_INFO: `/v3/users/a9d1b2408846472eaeba7092085ce39b` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:11.510262 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1103dadd-bdd1-4fdb-9bf8-52567b76df0c None admin] RBAC: Authorizing `identity:get_user(user_id=a9d1b2408846472eaeba7092085ce39b)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:11.513185 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1103dadd-bdd1-4fdb-9bf8-52567b76df0c None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:11.524748 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 109/230] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Jul 11 14:26:11 2022] GET /identity/v3/users/a9d1b2408846472eaeba7092085ce39b => generated 283 bytes in 499 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:26:11.526140 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1103dadd-bdd1-4fdb-9bf8-52567b76df0c None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:11.589577 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5a6d88-415c-418f-bd55-6d0745d940e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:11.591131 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5a6d88-415c-418f-bd55-6d0745d940e4 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:11.591648 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5a6d88-415c-418f-bd55-6d0745d940e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:11.592128 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5a6d88-415c-418f-bd55-6d0745d940e4 None admin] PATH_INFO: `/v3/projects/746cf064ee5344ddb5daa2377fd66d25` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:11.602258 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5a6d88-415c-418f-bd55-6d0745d940e4 None admin] RBAC: Authorizing `identity:get_project(project_id=746cf064ee5344ddb5daa2377fd66d25)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:11.605110 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5a6d88-415c-418f-bd55-6d0745d940e4 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:11.612251 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 122/231] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Jul 11 14:26:11 2022] GET /identity/v3/projects/746cf064ee5344ddb5daa2377fd66d25 => generated 302 bytes in 369 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:11.619552 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5a6d88-415c-418f-bd55-6d0745d940e4 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:11.696280 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:11.727694 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:11.751926 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1103dadd-bdd1-4fdb-9bf8-52567b76df0c None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:11.828015 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabaa2a7-5939-4159-b888-7c184f552aee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:11.829744 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabaa2a7-5939-4159-b888-7c184f552aee None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:11.830235 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabaa2a7-5939-4159-b888-7c184f552aee None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:11.830710 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabaa2a7-5939-4159-b888-7c184f552aee None admin] PATH_INFO: `/v3/projects/746cf064ee5344ddb5daa2377fd66d25` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:11.832366 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabaa2a7-5939-4159-b888-7c184f552aee None admin] RBAC: Authorizing `identity:get_project(project_id=746cf064ee5344ddb5daa2377fd66d25)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:11.834162 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabaa2a7-5939-4159-b888-7c184f552aee None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:11.837335 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 110/232] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Jul 11 14:26:11 2022] GET /identity/v3/projects/746cf064ee5344ddb5daa2377fd66d25 => generated 302 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:11.841438 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5a6d88-415c-418f-bd55-6d0745d940e4 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:11.844184 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabaa2a7-5939-4159-b888-7c184f552aee None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:11.911298 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa36810-5d5f-477e-9b9b-76cfbc5ab39a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:11.912872 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa36810-5d5f-477e-9b9b-76cfbc5ab39a None admin] REQUEST_METHOD: `PUT` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:11.913333 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa36810-5d5f-477e-9b9b-76cfbc5ab39a None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:11.913786 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa36810-5d5f-477e-9b9b-76cfbc5ab39a None admin] PATH_INFO: `/v3/projects/746cf064ee5344ddb5daa2377fd66d25/users/a9d1b2408846472eaeba7092085ce39b/roles/7d8b0827910944f29bfa3a92d6cb7c92` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:11.917906 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa36810-5d5f-477e-9b9b-76cfbc5ab39a None admin] RBAC: Authorizing `identity:create_grant(project_id=746cf064ee5344ddb5daa2377fd66d25, user_id=a9d1b2408846472eaeba7092085ce39b, role_id=7d8b0827910944f29bfa3a92d6cb7c92)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:11.920632 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa36810-5d5f-477e-9b9b-76cfbc5ab39a None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:11.953218 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 123/233] 10.222.0.70 () {58 vars in 1439 bytes} [Mon Jul 11 14:26:11 2022] PUT /identity/v3/projects/746cf064ee5344ddb5daa2377fd66d25/users/a9d1b2408846472eaeba7092085ce39b/roles/7d8b0827910944f29bfa3a92d6cb7c92 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:26:12.082000 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b523d45a-a4a9-47ce-9a6f-87ccc62a8dfb None None] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:12.082492 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b523d45a-a4a9-47ce-9a6f-87ccc62a8dfb None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:12.082975 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b523d45a-a4a9-47ce-9a6f-87ccc62a8dfb None None] PATH_INFO: `/` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:12.087203 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 124/234] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:26:12 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:26:12.091247 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabaa2a7-5939-4159-b888-7c184f552aee None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:12.094031 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8756ee60-58c3-444e-babd-213af9f68daf None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:12.094444 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8756ee60-58c3-444e-babd-213af9f68daf None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:12.094827 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8756ee60-58c3-444e-babd-213af9f68daf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:12.114475 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-8756ee60-58c3-444e-babd-213af9f68daf None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:26:12.115950 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-8756ee60-58c3-444e-babd-213af9f68daf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:26:12.190817 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2898ee40-df7d-475d-8301-a282c09d5f97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:12.191771 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2898ee40-df7d-475d-8301-a282c09d5f97 None admin] REQUEST_METHOD: `PUT` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:12.192058 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2898ee40-df7d-475d-8301-a282c09d5f97 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:12.192379 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2898ee40-df7d-475d-8301-a282c09d5f97 None admin] PATH_INFO: `/v3/projects/746cf064ee5344ddb5daa2377fd66d25/users/a9d1b2408846472eaeba7092085ce39b/roles/b46df176b0fe479da63c318db225bed4` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:12.197019 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2898ee40-df7d-475d-8301-a282c09d5f97 None admin] RBAC: Authorizing `identity:create_grant(project_id=746cf064ee5344ddb5daa2377fd66d25, user_id=a9d1b2408846472eaeba7092085ce39b, role_id=b46df176b0fe479da63c318db225bed4)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:12.200371 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2898ee40-df7d-475d-8301-a282c09d5f97 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:12.232521 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 111/235] 10.222.0.70 () {58 vars in 1439 bytes} [Mon Jul 11 14:26:11 2022] PUT /identity/v3/projects/746cf064ee5344ddb5daa2377fd66d25/users/a9d1b2408846472eaeba7092085ce39b/roles/b46df176b0fe479da63c318db225bed4 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:26:12.239455 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 125/236] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:26:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 14:26:12.270594 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2898ee40-df7d-475d-8301-a282c09d5f97 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:12.327122 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:12.500934 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2898ee40-df7d-475d-8301-a282c09d5f97 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:12.544289 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366c07d1-f7f1-4075-9ea0-0fab4223104e None None] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:12.544815 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366c07d1-f7f1-4075-9ea0-0fab4223104e None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:12.548279 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366c07d1-f7f1-4075-9ea0-0fab4223104e None None] PATH_INFO: `/` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:12.550181 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 126/237] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:26:12 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:26:12.551540 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4f3126-b4c7-406b-96d8-089097e78c58 None None] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:12.551832 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4f3126-b4c7-406b-96d8-089097e78c58 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:12.552113 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4f3126-b4c7-406b-96d8-089097e78c58 None None] PATH_INFO: `/` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:12.554837 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 127/238] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:26:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:26:12.563763 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e61fb8a-d855-45c7-8eb4-b66690404d0e None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:12.564107 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e61fb8a-d855-45c7-8eb4-b66690404d0e None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:12.564538 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e61fb8a-d855-45c7-8eb4-b66690404d0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:12.583218 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664d9b0e-2081-4e2e-b883-848ceaf35cf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:12.584058 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664d9b0e-2081-4e2e-b883-848ceaf35cf9 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:12.587534 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664d9b0e-2081-4e2e-b883-848ceaf35cf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:12.587882 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664d9b0e-2081-4e2e-b883-848ceaf35cf9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:12.590456 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-5e61fb8a-d855-45c7-8eb4-b66690404d0e None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:26:12.593666 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-5e61fb8a-d855-45c7-8eb4-b66690404d0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:26:12.603334 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664d9b0e-2081-4e2e-b883-848ceaf35cf9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:26:12.611384 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-664d9b0e-2081-4e2e-b883-848ceaf35cf9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 14:26:12.611384 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:12.611384 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:26:12.611384 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:26:12.611384 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:26:12.611384 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:26:12.611384 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:26:12.611384 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:26:12.611384 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:26:12.611384 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:26:12.611384 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:26:12.611384 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:26:12.611384 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:26:12.611384 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:26:12.611384 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:26:12.611384 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:26:12.618524 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:26:12.618524 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:26:12.618524 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:26:12.618524 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:26:12.618524 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:26:12.618524 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:26:12.618524 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:26:12.618524 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:26:12.618524 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:26:12.618524 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:26:12.618524 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:26:12.618524 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( Jul 11 14:26:12.618524 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:26:12.618524 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:26:12.618524 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:26:12.618524 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:26:12.620152 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:26:12.620152 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:26:12.620152 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:26:12.620152 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:26:12.620152 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:26:12.620152 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:26:12.620152 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:26:12.620152 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:26:12.620152 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:26:12.620152 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:26:12.620152 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 14:26:12.620152 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Jul 11 14:26:12.620152 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 112/239] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Jul 11 14:26:12 2022] GET /identity/v3/roles/reader => generated 84 bytes in 344 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:26:12.620152 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef1ce6e-87ec-4ee3-9a1f-26c280e31ddb None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:12.621623 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef1ce6e-87ec-4ee3-9a1f-26c280e31ddb None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:12.621623 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef1ce6e-87ec-4ee3-9a1f-26c280e31ddb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:12.641232 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-7ef1ce6e-87ec-4ee3-9a1f-26c280e31ddb None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:26:12.642547 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-7ef1ce6e-87ec-4ee3-9a1f-26c280e31ddb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:26:12.649725 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:12.746659 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 113/240] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:26:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:26:12.747935 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef1ce6e-87ec-4ee3-9a1f-26c280e31ddb None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:12.774783 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 128/241] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:26:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:26:12.784095 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:12.801356 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e61fb8a-d855-45c7-8eb4-b66690404d0e None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:12.949234 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e61fb8a-d855-45c7-8eb4-b66690404d0e None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:12.953430 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef1ce6e-87ec-4ee3-9a1f-26c280e31ddb None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:12.996721 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbac40e-4a66-40ba-9f71-d1236b5689d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:12.997685 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbac40e-4a66-40ba-9f71-d1236b5689d9 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:12.998088 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbac40e-4a66-40ba-9f71-d1236b5689d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:12.998487 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbac40e-4a66-40ba-9f71-d1236b5689d9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:13.011577 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbac40e-4a66-40ba-9f71-d1236b5689d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:26:13.020182 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application [None req-ecbac40e-4a66-40ba-9f71-d1236b5689d9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 14:26:13.020182 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:13.020182 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:26:13.020182 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:26:13.020182 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:26:13.020182 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:26:13.020182 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:26:13.020182 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:26:13.020182 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:26:13.020182 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:26:13.020182 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:26:13.020182 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:26:13.020182 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:26:13.020182 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:26:13.020182 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:26:13.020182 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:26:13.023517 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:26:13.023517 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:26:13.023517 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:26:13.023517 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:26:13.023517 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:26:13.023517 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:26:13.023517 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:26:13.023517 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:26:13.023517 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:26:13.023517 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:26:13.023517 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:26:13.023517 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application with Lock( Jul 11 14:26:13.023517 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:26:13.023517 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:26:13.023517 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:26:13.023517 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:26:13.026192 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:26:13.026192 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:26:13.026192 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:26:13.026192 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:26:13.026192 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:26:13.026192 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:26:13.026192 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:26:13.026192 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:26:13.026192 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:26:13.026192 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:26:13.026192 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 14:26:13.026192 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Jul 11 14:26:13.026192 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 129/242] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Jul 11 14:26:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:26:13.026192 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbac40e-4a66-40ba-9f71-d1236b5689d9 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:13.043308 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7726032f-e1d9-4270-9486-57af86d64baa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:13.044830 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7726032f-e1d9-4270-9486-57af86d64baa None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:13.045584 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7726032f-e1d9-4270-9486-57af86d64baa None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:13.046056 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:13.046589 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7726032f-e1d9-4270-9486-57af86d64baa None admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:13.048376 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7726032f-e1d9-4270-9486-57af86d64baa None admin] RBAC: Adding query filter params (name=reader) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:13.049261 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7726032f-e1d9-4270-9486-57af86d64baa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:13.051910 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7726032f-e1d9-4270-9486-57af86d64baa None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:13.075735 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 114/243] 10.222.0.70 () {56 vars in 1101 bytes} [Mon Jul 11 14:26:12 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:13.077835 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7726032f-e1d9-4270-9486-57af86d64baa None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:13.149910 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbac40e-4a66-40ba-9f71-d1236b5689d9 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:13.190180 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd52221-b633-4d93-9dae-cfb6524325bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:13.191040 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd52221-b633-4d93-9dae-cfb6524325bf None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:13.191322 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd52221-b633-4d93-9dae-cfb6524325bf None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:13.191592 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd52221-b633-4d93-9dae-cfb6524325bf None admin] PATH_INFO: `/v3/domains/default` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:13.193159 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd52221-b633-4d93-9dae-cfb6524325bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:13.195099 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd52221-b633-4d93-9dae-cfb6524325bf None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:13.202801 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 130/244] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 11 14:26:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:13.202801 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd52221-b633-4d93-9dae-cfb6524325bf None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:13.221463 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:13.263011 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7726032f-e1d9-4270-9486-57af86d64baa None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:13.312500 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827ea791-a0f4-4385-b9ac-b43cbb3e34d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:13.313412 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827ea791-a0f4-4385-b9ac-b43cbb3e34d5 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:13.313797 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827ea791-a0f4-4385-b9ac-b43cbb3e34d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:13.314174 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827ea791-a0f4-4385-b9ac-b43cbb3e34d5 None admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:13.315062 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827ea791-a0f4-4385-b9ac-b43cbb3e34d5 None admin] RBAC: Adding query filter params (name=member) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:13.315793 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827ea791-a0f4-4385-b9ac-b43cbb3e34d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:13.317385 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827ea791-a0f4-4385-b9ac-b43cbb3e34d5 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:13.332450 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 115/245] 10.222.0.70 () {56 vars in 1101 bytes} [Mon Jul 11 14:26:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:13.332450 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827ea791-a0f4-4385-b9ac-b43cbb3e34d5 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:13.398609 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:13.434760 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd52221-b633-4d93-9dae-cfb6524325bf None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:13.479303 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332ae318-d82f-46cb-ac20-d239eb2658cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:13.480613 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332ae318-d82f-46cb-ac20-d239eb2658cf None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:13.480960 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332ae318-d82f-46cb-ac20-d239eb2658cf None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:13.481299 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332ae318-d82f-46cb-ac20-d239eb2658cf None admin] PATH_INFO: `/v3/users/126a310efd0e46acbcf6f8d6434fd0ee` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:13.494573 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827ea791-a0f4-4385-b9ac-b43cbb3e34d5 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:13.499270 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332ae318-d82f-46cb-ac20-d239eb2658cf None admin] RBAC: Authorizing `identity:get_user(user_id=126a310efd0e46acbcf6f8d6434fd0ee)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:13.501868 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332ae318-d82f-46cb-ac20-d239eb2658cf None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:13.503745 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 131/246] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Jul 11 14:26:13 2022] GET /identity/v3/users/126a310efd0e46acbcf6f8d6434fd0ee => generated 297 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:13.504637 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332ae318-d82f-46cb-ac20-d239eb2658cf None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:13.578519 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50401c0-ac73-4e92-99c7-9ef741a03fb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:13.579892 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50401c0-ac73-4e92-99c7-9ef741a03fb7 None admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:13.580473 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50401c0-ac73-4e92-99c7-9ef741a03fb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:13.580953 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50401c0-ac73-4e92-99c7-9ef741a03fb7 None admin] PATH_INFO: `/v3/users` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:13.582271 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50401c0-ac73-4e92-99c7-9ef741a03fb7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:13.584712 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50401c0-ac73-4e92-99c7-9ef741a03fb7 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:13.595514 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:13.615483 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 116/247] 10.222.0.70 () {60 vars in 1132 bytes} [Mon Jul 11 14:26:13 2022] POST /identity/v3/users => generated 293 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:26:13.617162 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50401c0-ac73-4e92-99c7-9ef741a03fb7 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:13.742322 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332ae318-d82f-46cb-ac20-d239eb2658cf None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:13.750757 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50401c0-ac73-4e92-99c7-9ef741a03fb7 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:13.795716 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcff5726-22f9-4c54-b206-c70942a2e8c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:13.796795 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcff5726-22f9-4c54-b206-c70942a2e8c8 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:13.797472 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcff5726-22f9-4c54-b206-c70942a2e8c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:13.797962 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcff5726-22f9-4c54-b206-c70942a2e8c8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:13.872228 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafdf9f8-31d3-41c1-8e09-6aaecd9501cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:13.873475 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafdf9f8-31d3-41c1-8e09-6aaecd9501cd None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:13.873879 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafdf9f8-31d3-41c1-8e09-6aaecd9501cd None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:13.874375 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafdf9f8-31d3-41c1-8e09-6aaecd9501cd None admin] PATH_INFO: `/v3/users/acda269970984c47906ad0c6b5707dcc` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:13.875599 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:13.881705 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafdf9f8-31d3-41c1-8e09-6aaecd9501cd None admin] RBAC: Authorizing `identity:get_user(user_id=acda269970984c47906ad0c6b5707dcc)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:13.884429 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafdf9f8-31d3-41c1-8e09-6aaecd9501cd None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:13.887882 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 132/248] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Jul 11 14:26:13 2022] GET /identity/v3/users/acda269970984c47906ad0c6b5707dcc => generated 297 bytes in 383 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:13.888965 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcff5726-22f9-4c54-b206-c70942a2e8c8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:13.890710 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcff5726-22f9-4c54-b206-c70942a2e8c8 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:13.895200 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafdf9f8-31d3-41c1-8e09-6aaecd9501cd None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:13.931734 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:14.024112 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 117/249] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Jul 11 14:26:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 14:26:14.034536 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcff5726-22f9-4c54-b206-c70942a2e8c8 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:14.181177 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafdf9f8-31d3-41c1-8e09-6aaecd9501cd None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:14.266403 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08cc52f-42d5-4fb9-983e-ec16b98a0bd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:14.268774 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08cc52f-42d5-4fb9-983e-ec16b98a0bd7 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:14.269184 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08cc52f-42d5-4fb9-983e-ec16b98a0bd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:14.269575 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08cc52f-42d5-4fb9-983e-ec16b98a0bd7 None admin] PATH_INFO: `/v3/projects/746cf064ee5344ddb5daa2377fd66d25` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:14.271186 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08cc52f-42d5-4fb9-983e-ec16b98a0bd7 None admin] RBAC: Authorizing `identity:get_project(project_id=746cf064ee5344ddb5daa2377fd66d25)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:14.272884 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08cc52f-42d5-4fb9-983e-ec16b98a0bd7 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:14.275043 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 133/250] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Jul 11 14:26:13 2022] GET /identity/v3/projects/746cf064ee5344ddb5daa2377fd66d25 => generated 302 bytes in 381 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:14.276725 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:14.280841 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08cc52f-42d5-4fb9-983e-ec16b98a0bd7 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:14.298997 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcff5726-22f9-4c54-b206-c70942a2e8c8 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:14.358981 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15dbd9f-aa3d-44e5-846b-78ec3def02b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:14.362223 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15dbd9f-aa3d-44e5-846b-78ec3def02b8 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:14.362657 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15dbd9f-aa3d-44e5-846b-78ec3def02b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:14.363023 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15dbd9f-aa3d-44e5-846b-78ec3def02b8 None admin] PATH_INFO: `/v3/projects/746cf064ee5344ddb5daa2377fd66d25` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:14.365444 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15dbd9f-aa3d-44e5-846b-78ec3def02b8 None admin] RBAC: Authorizing `identity:get_project(project_id=746cf064ee5344ddb5daa2377fd66d25)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:14.368136 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15dbd9f-aa3d-44e5-846b-78ec3def02b8 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:14.370411 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 118/251] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Jul 11 14:26:14 2022] GET /identity/v3/projects/746cf064ee5344ddb5daa2377fd66d25 => generated 302 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:14.377336 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15dbd9f-aa3d-44e5-846b-78ec3def02b8 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:14.468896 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:14.514236 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08cc52f-42d5-4fb9-983e-ec16b98a0bd7 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:14.560712 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15dbd9f-aa3d-44e5-846b-78ec3def02b8 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:14.585830 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a2f20f-d6ab-4aae-bc00-2749a594daad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:14.587775 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a2f20f-d6ab-4aae-bc00-2749a594daad None admin] REQUEST_METHOD: `PUT` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:14.589354 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a2f20f-d6ab-4aae-bc00-2749a594daad None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:14.589869 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a2f20f-d6ab-4aae-bc00-2749a594daad None admin] PATH_INFO: `/v3/projects/746cf064ee5344ddb5daa2377fd66d25/users/acda269970984c47906ad0c6b5707dcc/roles/8eff41f243c843ed95505a488ca6eada` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:14.592504 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a2f20f-d6ab-4aae-bc00-2749a594daad None admin] RBAC: Authorizing `identity:create_grant(project_id=746cf064ee5344ddb5daa2377fd66d25, user_id=acda269970984c47906ad0c6b5707dcc, role_id=8eff41f243c843ed95505a488ca6eada)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:14.594593 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a2f20f-d6ab-4aae-bc00-2749a594daad None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:14.610904 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cfafc4-014a-4136-ad72-03adfeb82d31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:14.611636 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cfafc4-014a-4136-ad72-03adfeb82d31 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:14.611926 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cfafc4-014a-4136-ad72-03adfeb82d31 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:14.612293 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cfafc4-014a-4136-ad72-03adfeb82d31 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:14.613209 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 134/252] 10.222.0.70 () {58 vars in 1439 bytes} [Mon Jul 11 14:26:14 2022] PUT /identity/v3/projects/746cf064ee5344ddb5daa2377fd66d25/users/acda269970984c47906ad0c6b5707dcc/roles/8eff41f243c843ed95505a488ca6eada => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:26:14.616348 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cfafc4-014a-4136-ad72-03adfeb82d31 None admin] RBAC: Adding query filter params (role.id=09e9dee5b1e848eaba8cef2325325d08, scope.project.id=746cf064ee5344ddb5daa2377fd66d25, user.id=126a310efd0e46acbcf6f8d6434fd0ee) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:14.616348 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cfafc4-014a-4136-ad72-03adfeb82d31 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:14.616348 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cfafc4-014a-4136-ad72-03adfeb82d31 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:14.623483 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 119/253] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Jul 11 14:26:14 2022] GET /identity/v3/role_assignments?user.id=126a310efd0e46acbcf6f8d6434fd0ee&scope.project.id=746cf064ee5344ddb5daa2377fd66d25&role.id=09e9dee5b1e848eaba8cef2325325d08 => generated 259 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:14.964070 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7626f7d7-08fd-48bf-9860-3d34c7741241 None None] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:14.964440 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7626f7d7-08fd-48bf-9860-3d34c7741241 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:14.964783 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7626f7d7-08fd-48bf-9860-3d34c7741241 None None] PATH_INFO: `/` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:14.966529 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 135/254] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:26:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:26:14.974096 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736fd7b3-2620-4f7d-a5c6-c4addfeb28d6 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:14.974389 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736fd7b3-2620-4f7d-a5c6-c4addfeb28d6 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:14.974662 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736fd7b3-2620-4f7d-a5c6-c4addfeb28d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:15.001549 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-736fd7b3-2620-4f7d-a5c6-c4addfeb28d6 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:26:15.002784 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-736fd7b3-2620-4f7d-a5c6-c4addfeb28d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:26:15.024840 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:15.091574 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 120/255] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:26:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:26:15.181037 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7626f7d7-08fd-48bf-9860-3d34c7741241 None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:15.433086 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7626f7d7-08fd-48bf-9860-3d34c7741241 None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:15.498364 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2fd3c8-becd-4d2b-b46d-d898654ffa5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:15.499764 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2fd3c8-becd-4d2b-b46d-d898654ffa5d None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:15.500301 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2fd3c8-becd-4d2b-b46d-d898654ffa5d None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:15.500748 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2fd3c8-becd-4d2b-b46d-d898654ffa5d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:15.506055 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:15.523466 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2fd3c8-becd-4d2b-b46d-d898654ffa5d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:26:15.541514 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application [None req-7b2fd3c8-becd-4d2b-b46d-d898654ffa5d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 14:26:15.541514 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:15.541514 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:26:15.541514 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:26:15.541514 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:26:15.541514 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:26:15.541514 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:26:15.541514 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:26:15.541514 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:26:15.541514 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:26:15.541514 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:26:15.541514 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:26:15.541514 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:26:15.541514 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:26:15.541514 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:26:15.541514 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:26:15.542530 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:26:15.542530 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:26:15.542530 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:26:15.542530 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:26:15.542530 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:26:15.542530 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:26:15.542530 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:26:15.542530 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:26:15.542530 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:26:15.542530 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:26:15.542530 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:26:15.542530 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application with Lock( Jul 11 14:26:15.542530 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:26:15.542530 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:26:15.542530 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:26:15.542530 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:26:15.543365 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:26:15.543365 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:26:15.543365 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:26:15.543365 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:26:15.543365 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:26:15.543365 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:26:15.543365 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:26:15.543365 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:26:15.543365 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:26:15.543365 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:26:15.543365 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 14:26:15.543365 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Jul 11 14:26:15.544526 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 136/256] 10.222.0.70 () {56 vars in 1114 bytes} [Mon Jul 11 14:26:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 364 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:26:15.561827 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736fd7b3-2620-4f7d-a5c6-c4addfeb28d6 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:15.710226 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736fd7b3-2620-4f7d-a5c6-c4addfeb28d6 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:15.772449 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885d5e46-0372-487e-941b-d82be86ef3e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:15.773148 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885d5e46-0372-487e-941b-d82be86ef3e7 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:15.773469 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885d5e46-0372-487e-941b-d82be86ef3e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:15.773752 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885d5e46-0372-487e-941b-d82be86ef3e7 None admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:15.774525 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885d5e46-0372-487e-941b-d82be86ef3e7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:15.774832 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885d5e46-0372-487e-941b-d82be86ef3e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:15.783932 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885d5e46-0372-487e-941b-d82be86ef3e7 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:15.804238 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 121/257] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Jul 11 14:26:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:15.810469 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2fd3c8-becd-4d2b-b46d-d898654ffa5d None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:15.939746 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2fd3c8-becd-4d2b-b46d-d898654ffa5d None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:15.981247 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41efe29-0f9c-41d3-a535-1cb771982ff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:15.982046 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41efe29-0f9c-41d3-a535-1cb771982ff7 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:15.982325 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41efe29-0f9c-41d3-a535-1cb771982ff7 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:15.982597 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41efe29-0f9c-41d3-a535-1cb771982ff7 None admin] PATH_INFO: `/v3/users/a9d1b2408846472eaeba7092085ce39b` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:15.983821 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41efe29-0f9c-41d3-a535-1cb771982ff7 None admin] RBAC: Authorizing `identity:get_user(user_id=a9d1b2408846472eaeba7092085ce39b)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:15.985633 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41efe29-0f9c-41d3-a535-1cb771982ff7 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:15.987321 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 137/258] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Jul 11 14:26:15 2022] GET /identity/v3/users/a9d1b2408846472eaeba7092085ce39b => generated 283 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:15.996124 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885d5e46-0372-487e-941b-d82be86ef3e7 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:15.999395 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4030cc74-231e-44c6-b2db-911b0e4468bc None None] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:15.999743 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4030cc74-231e-44c6-b2db-911b0e4468bc None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:16.000019 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4030cc74-231e-44c6-b2db-911b0e4468bc None None] PATH_INFO: `/` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:16.011385 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 138/259] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:26:15 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 14:26:16.020034 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fc2b72-4349-4b81-92cc-a288d1083f10 None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:16.020397 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fc2b72-4349-4b81-92cc-a288d1083f10 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:16.020665 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fc2b72-4349-4b81-92cc-a288d1083f10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:16.048821 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:16.056921 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-b1fc2b72-4349-4b81-92cc-a288d1083f10 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:26:16.061347 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-b1fc2b72-4349-4b81-92cc-a288d1083f10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:26:16.288709 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:16.295904 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885d5e46-0372-487e-941b-d82be86ef3e7 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:16.317838 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 139/260] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:26:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:26:16.417254 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c29a936-0288-49c1-a740-1c0c28bb710a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:16.417537 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fc2b72-4349-4b81-92cc-a288d1083f10 None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:16.418454 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c29a936-0288-49c1-a740-1c0c28bb710a None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:16.418978 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c29a936-0288-49c1-a740-1c0c28bb710a None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:16.419497 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c29a936-0288-49c1-a740-1c0c28bb710a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:16.681525 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c29a936-0288-49c1-a740-1c0c28bb710a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:16.683061 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c29a936-0288-49c1-a740-1c0c28bb710a None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:16.687578 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fc2b72-4349-4b81-92cc-a288d1083f10 None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:16.757409 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:16.797669 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcb2566-1bb4-4a5e-856b-1a614b668505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:16.798496 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcb2566-1bb4-4a5e-856b-1a614b668505 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:16.798775 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcb2566-1bb4-4a5e-856b-1a614b668505 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:16.799055 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcb2566-1bb4-4a5e-856b-1a614b668505 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:16.823351 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcb2566-1bb4-4a5e-856b-1a614b668505 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:26:16.840461 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application [None req-4dcb2566-1bb4-4a5e-856b-1a614b668505 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:26:16.840461 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:16.840461 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:26:16.840461 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:26:16.840461 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:26:16.840461 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:26:16.840461 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:26:16.840461 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:26:16.840461 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:26:16.840461 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:26:16.840461 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:26:16.840461 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:26:16.840461 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:26:16.840461 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:26:16.840461 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:26:16.840461 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:26:16.842203 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:26:16.842203 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:26:16.842203 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:26:16.842203 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:26:16.842203 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:26:16.842203 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:26:16.842203 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:26:16.842203 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:26:16.842203 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:26:16.842203 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:26:16.842203 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:26:16.842203 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application with Lock( Jul 11 14:26:16.842203 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:26:16.842203 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:26:16.842203 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:26:16.842203 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:26:16.843824 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:26:16.843824 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:26:16.843824 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:26:16.843824 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:26:16.843824 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:26:16.843824 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:26:16.843824 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:26:16.843824 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:26:16.843824 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:26:16.843824 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:26:16.843824 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:26:16.843824 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Jul 11 14:26:16.854323 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 140/261] 10.222.0.70 () {56 vars in 1096 bytes} [Mon Jul 11 14:26:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 437 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:26:16.861288 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcb2566-1bb4-4a5e-856b-1a614b668505 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:16.923536 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 122/262] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Jul 11 14:26:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 930 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 11 14:26:16.930437 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c29a936-0288-49c1-a740-1c0c28bb710a None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:17.076718 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:17.188645 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcb2566-1bb4-4a5e-856b-1a614b668505 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:17.211873 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c29a936-0288-49c1-a740-1c0c28bb710a None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:17.285936 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ccf87d-d962-435a-aaa7-26ac9a86435b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:17.286644 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ccf87d-d962-435a-aaa7-26ac9a86435b None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:17.286926 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ccf87d-d962-435a-aaa7-26ac9a86435b None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:17.287203 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ccf87d-d962-435a-aaa7-26ac9a86435b None admin] PATH_INFO: `/v3/roles` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:17.288188 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ccf87d-d962-435a-aaa7-26ac9a86435b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:17.288574 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ccf87d-d962-435a-aaa7-26ac9a86435b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:17.291565 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ccf87d-d962-435a-aaa7-26ac9a86435b None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:17.307002 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:17.321478 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 141/263] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Jul 11 14:26:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 457 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:26:17.322841 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ccf87d-d962-435a-aaa7-26ac9a86435b None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:17.452781 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5814fb6d-83cc-4eb6-b6e5-dc6dca95715f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:17.454929 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5814fb6d-83cc-4eb6-b6e5-dc6dca95715f None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:17.455790 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5814fb6d-83cc-4eb6-b6e5-dc6dca95715f None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:17.460901 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5814fb6d-83cc-4eb6-b6e5-dc6dca95715f None admin] PATH_INFO: `/v3/projects/746cf064ee5344ddb5daa2377fd66d25` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:17.465551 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5814fb6d-83cc-4eb6-b6e5-dc6dca95715f None admin] RBAC: Authorizing `identity:get_project(project_id=746cf064ee5344ddb5daa2377fd66d25)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:17.472962 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5814fb6d-83cc-4eb6-b6e5-dc6dca95715f None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:17.476975 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 123/264] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Jul 11 14:26:16 2022] GET /identity/v3/projects/746cf064ee5344ddb5daa2377fd66d25 => generated 302 bytes in 547 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:26:17.493949 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5814fb6d-83cc-4eb6-b6e5-dc6dca95715f None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:17.497080 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ccf87d-d962-435a-aaa7-26ac9a86435b None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:17.516801 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:17.544250 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119d004f-1232-40f9-ab3c-675f35c22638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:17.544250 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119d004f-1232-40f9-ab3c-675f35c22638 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:17.544250 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119d004f-1232-40f9-ab3c-675f35c22638 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:17.544250 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119d004f-1232-40f9-ab3c-675f35c22638 None admin] PATH_INFO: `/v3/users/a9d1b2408846472eaeba7092085ce39b` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:17.547216 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119d004f-1232-40f9-ab3c-675f35c22638 None admin] RBAC: Authorizing `identity:get_user(user_id=a9d1b2408846472eaeba7092085ce39b)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:17.548896 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119d004f-1232-40f9-ab3c-675f35c22638 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:17.553412 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 142/265] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Jul 11 14:26:17 2022] GET /identity/v3/users/a9d1b2408846472eaeba7092085ce39b => generated 283 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:17.562055 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119d004f-1232-40f9-ab3c-675f35c22638 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:17.783996 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5814fb6d-83cc-4eb6-b6e5-dc6dca95715f None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:17.805063 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119d004f-1232-40f9-ab3c-675f35c22638 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:17.885146 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1331940e-03b0-456f-8c07-71f9b9f27db4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:17.886386 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1331940e-03b0-456f-8c07-71f9b9f27db4 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:17.886874 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1331940e-03b0-456f-8c07-71f9b9f27db4 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:17.887340 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1331940e-03b0-456f-8c07-71f9b9f27db4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:17.888742 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1331940e-03b0-456f-8c07-71f9b9f27db4 None admin] RBAC: Adding query filter params (role.id=7d8b0827910944f29bfa3a92d6cb7c92, scope.project.id=746cf064ee5344ddb5daa2377fd66d25, user.id=a9d1b2408846472eaeba7092085ce39b) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:17.889284 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1331940e-03b0-456f-8c07-71f9b9f27db4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:17.890977 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1331940e-03b0-456f-8c07-71f9b9f27db4 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:17.910549 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 124/266] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Jul 11 14:26:17 2022] GET /identity/v3/role_assignments?user.id=a9d1b2408846472eaeba7092085ce39b&scope.project.id=746cf064ee5344ddb5daa2377fd66d25&role.id=7d8b0827910944f29bfa3a92d6cb7c92 => generated 608 bytes in 418 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:17.921265 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e58abf7-af42-4af7-8b2d-d44ad35c7b4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:17.922610 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e58abf7-af42-4af7-8b2d-d44ad35c7b4f None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:17.923107 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e58abf7-af42-4af7-8b2d-d44ad35c7b4f None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:17.923600 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e58abf7-af42-4af7-8b2d-d44ad35c7b4f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:18.032907 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:18.063549 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e58abf7-af42-4af7-8b2d-d44ad35c7b4f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:18.065659 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e58abf7-af42-4af7-8b2d-d44ad35c7b4f None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:18.235362 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed350eb-8f0a-4e18-a6ea-4316ac8cd9f3 None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:18.242933 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed350eb-8f0a-4e18-a6ea-4316ac8cd9f3 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:18.243341 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed350eb-8f0a-4e18-a6ea-4316ac8cd9f3 None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:18.246530 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 125/267] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:26:18 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:26:18.259679 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84e75d0-5f2a-447f-bae3-6967c4261ce2 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:18.260183 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84e75d0-5f2a-447f-bae3-6967c4261ce2 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:18.260687 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84e75d0-5f2a-447f-bae3-6967c4261ce2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:18.263150 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 143/268] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Jul 11 14:26:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 703 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 14:26:18.269928 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e58abf7-af42-4af7-8b2d-d44ad35c7b4f None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:18.310977 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-a84e75d0-5f2a-447f-bae3-6967c4261ce2 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:26:18.312375 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-a84e75d0-5f2a-447f-bae3-6967c4261ce2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:26:18.405000 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:18.429748 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e58abf7-af42-4af7-8b2d-d44ad35c7b4f None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:18.511154 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:18.517043 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc730d4-e9b9-45c0-9f2f-41665a5f1f77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:18.518661 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc730d4-e9b9-45c0-9f2f-41665a5f1f77 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:18.519159 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc730d4-e9b9-45c0-9f2f-41665a5f1f77 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:18.519665 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc730d4-e9b9-45c0-9f2f-41665a5f1f77 None admin] PATH_INFO: `/v3/projects/746cf064ee5344ddb5daa2377fd66d25` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:18.533197 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc730d4-e9b9-45c0-9f2f-41665a5f1f77 None admin] RBAC: Authorizing `identity:get_project(project_id=746cf064ee5344ddb5daa2377fd66d25)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:18.536047 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc730d4-e9b9-45c0-9f2f-41665a5f1f77 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:18.552576 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 144/269] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Jul 11 14:26:18 2022] GET /identity/v3/projects/746cf064ee5344ddb5daa2377fd66d25 => generated 302 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:18.554712 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc730d4-e9b9-45c0-9f2f-41665a5f1f77 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:18.597238 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 126/270] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:26:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:26:18.639501 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84e75d0-5f2a-447f-bae3-6967c4261ce2 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:18.886947 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84e75d0-5f2a-447f-bae3-6967c4261ce2 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:18.887805 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc730d4-e9b9-45c0-9f2f-41665a5f1f77 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:18.982025 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6034beb3-13c1-4d65-86cd-8747314dc7da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:18.983462 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6034beb3-13c1-4d65-86cd-8747314dc7da None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:18.983953 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6034beb3-13c1-4d65-86cd-8747314dc7da None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:18.984441 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6034beb3-13c1-4d65-86cd-8747314dc7da None admin] PATH_INFO: `/v3/roles/member` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:19.007850 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5d1298-4889-43ea-b2be-ed2f99c5d469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:19.009012 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5d1298-4889-43ea-b2be-ed2f99c5d469 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:19.009496 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5d1298-4889-43ea-b2be-ed2f99c5d469 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:19.009979 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5d1298-4889-43ea-b2be-ed2f99c5d469 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:19.011595 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5d1298-4889-43ea-b2be-ed2f99c5d469 None admin] RBAC: Adding query filter params (role.id=b46df176b0fe479da63c318db225bed4, scope.project.id=746cf064ee5344ddb5daa2377fd66d25, user.id=a9d1b2408846472eaeba7092085ce39b) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:19.012151 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5d1298-4889-43ea-b2be-ed2f99c5d469 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:19.014871 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5d1298-4889-43ea-b2be-ed2f99c5d469 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:19.029380 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6034beb3-13c1-4d65-86cd-8747314dc7da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:26:19.044928 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-6034beb3-13c1-4d65-86cd-8747314dc7da None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 14:26:19.044928 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:19.044928 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:26:19.044928 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:26:19.044928 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:26:19.044928 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:26:19.044928 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:26:19.044928 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:26:19.044928 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:26:19.044928 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:26:19.044928 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:26:19.044928 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:26:19.044928 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:26:19.044928 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:26:19.044928 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:26:19.044928 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:26:19.045880 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:26:19.045880 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:26:19.045880 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:26:19.045880 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:26:19.045880 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:26:19.045880 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:26:19.045880 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:26:19.045880 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:26:19.045880 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:26:19.045880 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:26:19.045880 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:26:19.045880 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( Jul 11 14:26:19.045880 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:26:19.045880 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:26:19.045880 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:26:19.045880 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:26:19.047378 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:26:19.047378 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:26:19.047378 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:26:19.047378 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:26:19.047378 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:26:19.047378 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:26:19.047378 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:26:19.047378 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:26:19.047378 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:26:19.047378 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:26:19.047378 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 14:26:19.047378 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Jul 11 14:26:19.048643 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 127/271] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Jul 11 14:26:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 409 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:26:19.060578 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 145/272] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Jul 11 14:26:18 2022] GET /identity/v3/role_assignments?user.id=a9d1b2408846472eaeba7092085ce39b&scope.project.id=746cf064ee5344ddb5daa2377fd66d25&role.id=b46df176b0fe479da63c318db225bed4 => generated 608 bytes in 507 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:26:19.063989 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6034beb3-13c1-4d65-86cd-8747314dc7da None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:19.125125 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea153b9-02ea-487b-93e0-44313b93167c None None] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:19.125575 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea153b9-02ea-487b-93e0-44313b93167c None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:19.125785 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea153b9-02ea-487b-93e0-44313b93167c None None] PATH_INFO: `/` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:19.127394 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 146/273] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:26:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:26:19.133493 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafdb2d3-0bbf-4104-81ea-d8fbaa67ecc8 None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:19.133796 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafdb2d3-0bbf-4104-81ea-d8fbaa67ecc8 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:19.134063 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafdb2d3-0bbf-4104-81ea-d8fbaa67ecc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:19.157342 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-bafdb2d3-0bbf-4104-81ea-d8fbaa67ecc8 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:26:19.158728 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-bafdb2d3-0bbf-4104-81ea-d8fbaa67ecc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:26:19.160703 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:19.195267 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:19.253217 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6034beb3-13c1-4d65-86cd-8747314dc7da None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:19.317532 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05eb13d7-2c55-4d27-8f99-637c4cdbb90e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:19.319748 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05eb13d7-2c55-4d27-8f99-637c4cdbb90e None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:19.320602 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05eb13d7-2c55-4d27-8f99-637c4cdbb90e None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:19.321243 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05eb13d7-2c55-4d27-8f99-637c4cdbb90e None admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:19.322904 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05eb13d7-2c55-4d27-8f99-637c4cdbb90e None admin] RBAC: Adding query filter params (name=member) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:19.323742 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05eb13d7-2c55-4d27-8f99-637c4cdbb90e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:19.326856 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05eb13d7-2c55-4d27-8f99-637c4cdbb90e None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:19.346134 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 128/274] 10.222.0.70 () {56 vars in 1101 bytes} [Mon Jul 11 14:26:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:19.347824 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a55140-fc29-464f-91d2-b26b6b54160b None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:19.348324 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a55140-fc29-464f-91d2-b26b6b54160b None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:19.348771 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a55140-fc29-464f-91d2-b26b6b54160b None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:19.351714 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 129/275] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:26:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:26:19.352874 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a55140-fc29-464f-91d2-b26b6b54160b None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:19.363573 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 147/276] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:26:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 14:26:19.368348 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b67965-a51f-4c5e-9130-c1cda47ae3c1 None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:19.368348 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b67965-a51f-4c5e-9130-c1cda47ae3c1 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:19.368348 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b67965-a51f-4c5e-9130-c1cda47ae3c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:19.391202 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-06b67965-a51f-4c5e-9130-c1cda47ae3c1 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:26:19.397904 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-06b67965-a51f-4c5e-9130-c1cda47ae3c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:26:19.513260 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 148/277] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:26:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:26:19.514665 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b67965-a51f-4c5e-9130-c1cda47ae3c1 None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:19.523565 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:19.529348 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a55140-fc29-464f-91d2-b26b6b54160b None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:19.578358 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2c11e8-e912-453c-9f84-78e65b7bc613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:19.579403 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2c11e8-e912-453c-9f84-78e65b7bc613 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:19.579827 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2c11e8-e912-453c-9f84-78e65b7bc613 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:19.580233 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2c11e8-e912-453c-9f84-78e65b7bc613 None admin] PATH_INFO: `/v3/users/2fc242dc65c8451fabe1b25fe67ab305` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:19.605283 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2c11e8-e912-453c-9f84-78e65b7bc613 None admin] RBAC: Authorizing `identity:get_user(user_id=2fc242dc65c8451fabe1b25fe67ab305)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:19.607529 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2c11e8-e912-453c-9f84-78e65b7bc613 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:19.610333 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 130/278] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Jul 11 14:26:19 2022] GET /identity/v3/users/2fc242dc65c8451fabe1b25fe67ab305 => generated 293 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:19.614276 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23db7abc-4789-4b6f-a353-4b3b0b2caa39 None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:19.614778 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23db7abc-4789-4b6f-a353-4b3b0b2caa39 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:19.615309 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23db7abc-4789-4b6f-a353-4b3b0b2caa39 None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:19.620267 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 131/279] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:26:19 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:26:19.620267 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23db7abc-4789-4b6f-a353-4b3b0b2caa39 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:19.660115 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:19.691428 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b67965-a51f-4c5e-9130-c1cda47ae3c1 None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:19.739836 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d68ec71-5aa3-4f97-912e-910778521e0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:19.741873 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d68ec71-5aa3-4f97-912e-910778521e0b None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:19.742379 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d68ec71-5aa3-4f97-912e-910778521e0b None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:19.742859 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d68ec71-5aa3-4f97-912e-910778521e0b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:19.745194 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d68ec71-5aa3-4f97-912e-910778521e0b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:19.747566 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d68ec71-5aa3-4f97-912e-910778521e0b None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:19.749372 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 149/280] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 11 14:26:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:19.750164 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d68ec71-5aa3-4f97-912e-910778521e0b None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:19.775036 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23db7abc-4789-4b6f-a353-4b3b0b2caa39 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:19.831345 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f470711e-6837-4221-96fe-7e420988f1b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:19.832839 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f470711e-6837-4221-96fe-7e420988f1b6 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:19.833327 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f470711e-6837-4221-96fe-7e420988f1b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:19.833828 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f470711e-6837-4221-96fe-7e420988f1b6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:19.854333 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f470711e-6837-4221-96fe-7e420988f1b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:26:19.863008 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-f470711e-6837-4221-96fe-7e420988f1b6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 14:26:19.863008 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:19.863008 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:26:19.863008 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:26:19.863008 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:26:19.863008 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:26:19.863008 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:26:19.863008 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:26:19.863008 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:26:19.863008 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:26:19.863008 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:26:19.863008 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:26:19.863008 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:26:19.863008 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:26:19.863008 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:26:19.863008 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:26:19.865071 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:26:19.865071 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:26:19.865071 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:26:19.865071 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:26:19.865071 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:26:19.865071 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:26:19.865071 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:26:19.865071 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:26:19.865071 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:26:19.865071 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:26:19.865071 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:26:19.865071 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( Jul 11 14:26:19.865071 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:26:19.865071 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:26:19.865071 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:26:19.865071 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:26:19.867159 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:26:19.867159 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:26:19.867159 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:26:19.867159 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:26:19.867159 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:26:19.867159 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:26:19.867159 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:26:19.867159 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:26:19.867159 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:26:19.867159 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:26:19.867159 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 14:26:19.867159 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Jul 11 14:26:19.867159 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 132/281] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Jul 11 14:26:19 2022] GET /identity/v3/roles/reader => generated 84 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:26:19.867159 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4cda1b-8be6-4ec4-a695-278d21f8a705 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:19.868610 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4cda1b-8be6-4ec4-a695-278d21f8a705 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:19.868610 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4cda1b-8be6-4ec4-a695-278d21f8a705 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:19.886296 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d68ec71-5aa3-4f97-912e-910778521e0b None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:19.899377 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-1b4cda1b-8be6-4ec4-a695-278d21f8a705 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:26:19.902226 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-1b4cda1b-8be6-4ec4-a695-278d21f8a705 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:26:19.927370 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2444db0-1d3b-4855-9f6d-8efa3630c480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:19.928725 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2444db0-1d3b-4855-9f6d-8efa3630c480 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:19.929092 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2444db0-1d3b-4855-9f6d-8efa3630c480 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:19.929562 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2444db0-1d3b-4855-9f6d-8efa3630c480 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:19.929736 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:19.930624 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2444db0-1d3b-4855-9f6d-8efa3630c480 None admin] RBAC: Adding query filter params (role.id=8eff41f243c843ed95505a488ca6eada, user.id=2fc242dc65c8451fabe1b25fe67ab305, scope.system=all) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:19.930888 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2444db0-1d3b-4855-9f6d-8efa3630c480 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:19.932574 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2444db0-1d3b-4855-9f6d-8efa3630c480 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:19.938980 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 150/282] 10.222.0.70 () {56 vars in 1308 bytes} [Mon Jul 11 14:26:19 2022] GET /identity/v3/role_assignments?user.id=2fc242dc65c8451fabe1b25fe67ab305&scope.system=all&role.id=8eff41f243c843ed95505a488ca6eada => generated 226 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:19.939624 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2444db0-1d3b-4855-9f6d-8efa3630c480 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:19.968051 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:20.037949 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 133/283] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:26:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:26:20.039721 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4cda1b-8be6-4ec4-a695-278d21f8a705 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:20.147096 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2444db0-1d3b-4855-9f6d-8efa3630c480 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:20.204165 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e158280c-bb9b-47b4-9810-6bb06fa5a5db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:20.205315 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e158280c-bb9b-47b4-9810-6bb06fa5a5db None admin] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:20.205790 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e158280c-bb9b-47b4-9810-6bb06fa5a5db None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:20.206080 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e158280c-bb9b-47b4-9810-6bb06fa5a5db None admin] PATH_INFO: `/v3/users` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:20.207243 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e158280c-bb9b-47b4-9810-6bb06fa5a5db None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:20.208327 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e158280c-bb9b-47b4-9810-6bb06fa5a5db None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:20.213329 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4cda1b-8be6-4ec4-a695-278d21f8a705 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:20.245559 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 151/284] 10.222.0.70 () {60 vars in 1132 bytes} [Mon Jul 11 14:26:19 2022] POST /identity/v3/users => generated 293 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:26:20.253289 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e158280c-bb9b-47b4-9810-6bb06fa5a5db None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:20.285890 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10841aa9-edd0-4fa4-b1ea-6402750ee73f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:20.287039 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10841aa9-edd0-4fa4-b1ea-6402750ee73f None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:20.288133 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10841aa9-edd0-4fa4-b1ea-6402750ee73f None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:20.288582 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10841aa9-edd0-4fa4-b1ea-6402750ee73f None admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:20.290208 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10841aa9-edd0-4fa4-b1ea-6402750ee73f None admin] RBAC: Adding query filter params (name=reader) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:20.290520 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10841aa9-edd0-4fa4-b1ea-6402750ee73f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:20.293081 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10841aa9-edd0-4fa4-b1ea-6402750ee73f None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:20.315543 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 134/285] 10.222.0.70 () {56 vars in 1101 bytes} [Mon Jul 11 14:26:20 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:20.325422 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10841aa9-edd0-4fa4-b1ea-6402750ee73f None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:20.351774 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:20.410577 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:20.501325 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e158280c-bb9b-47b4-9810-6bb06fa5a5db None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:20.564370 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10841aa9-edd0-4fa4-b1ea-6402750ee73f None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:20.576031 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda48012-554a-4155-a246-428d5ccd9954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:20.577604 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda48012-554a-4155-a246-428d5ccd9954 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:20.578095 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda48012-554a-4155-a246-428d5ccd9954 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:20.578583 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda48012-554a-4155-a246-428d5ccd9954 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:20.609811 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda48012-554a-4155-a246-428d5ccd9954 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:26:20.623069 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application [None req-cda48012-554a-4155-a246-428d5ccd9954 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 14:26:20.623069 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:20.623069 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:26:20.623069 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:26:20.623069 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:26:20.623069 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:26:20.623069 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:26:20.623069 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:26:20.623069 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:26:20.623069 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:26:20.623069 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:26:20.623069 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:26:20.623069 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:26:20.623069 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:26:20.623069 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:26:20.623069 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:26:20.625255 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:26:20.625255 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:26:20.625255 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:26:20.625255 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:26:20.625255 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:26:20.625255 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:26:20.625255 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:26:20.625255 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:26:20.625255 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:26:20.625255 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:26:20.625255 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:26:20.625255 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application with Lock( Jul 11 14:26:20.625255 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:26:20.625255 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:26:20.625255 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:26:20.625255 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:26:20.627869 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:26:20.627869 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:26:20.627869 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:26:20.627869 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:26:20.627869 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:26:20.627869 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:26:20.627869 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:26:20.627869 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:26:20.627869 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:26:20.627869 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:26:20.627869 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 14:26:20.627869 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Jul 11 14:26:20.627869 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 152/286] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Jul 11 14:26:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 380 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:26:20.636707 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda48012-554a-4155-a246-428d5ccd9954 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:20.652736 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4978614-1e61-464e-8e50-4c281192b57c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:20.654088 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4978614-1e61-464e-8e50-4c281192b57c None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:20.654386 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4978614-1e61-464e-8e50-4c281192b57c None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:20.654642 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4978614-1e61-464e-8e50-4c281192b57c None admin] PATH_INFO: `/v3/users/126a310efd0e46acbcf6f8d6434fd0ee` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:20.657730 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4978614-1e61-464e-8e50-4c281192b57c None admin] RBAC: Authorizing `identity:get_user(user_id=126a310efd0e46acbcf6f8d6434fd0ee)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:20.659388 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4978614-1e61-464e-8e50-4c281192b57c None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:20.661601 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 135/287] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Jul 11 14:26:20 2022] GET /identity/v3/users/126a310efd0e46acbcf6f8d6434fd0ee => generated 297 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:26:20.675180 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4978614-1e61-464e-8e50-4c281192b57c None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:20.884157 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:20.898297 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda48012-554a-4155-a246-428d5ccd9954 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:20.969417 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4978614-1e61-464e-8e50-4c281192b57c None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:20.996806 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:21.023432 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce65d3a5-332f-49a8-b961-10ef9211b3fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:21.024571 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce65d3a5-332f-49a8-b961-10ef9211b3fc None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:21.025052 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce65d3a5-332f-49a8-b961-10ef9211b3fc None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:21.025517 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce65d3a5-332f-49a8-b961-10ef9211b3fc None admin] PATH_INFO: `/v3/roles` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:21.033218 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce65d3a5-332f-49a8-b961-10ef9211b3fc None admin] RBAC: Adding query filter params (name=member) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:21.033746 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce65d3a5-332f-49a8-b961-10ef9211b3fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:21.036141 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce65d3a5-332f-49a8-b961-10ef9211b3fc None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:21.076482 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 153/288] 10.222.0.70 () {56 vars in 1101 bytes} [Mon Jul 11 14:26:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 441 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:21.082308 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b0011a-0edd-423f-895a-f1dcd23d845f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:21.083848 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b0011a-0edd-423f-895a-f1dcd23d845f None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:21.084396 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b0011a-0edd-423f-895a-f1dcd23d845f None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:21.084874 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b0011a-0edd-423f-895a-f1dcd23d845f None admin] PATH_INFO: `/v3/projects/746cf064ee5344ddb5daa2377fd66d25` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:21.087166 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b0011a-0edd-423f-895a-f1dcd23d845f None admin] RBAC: Authorizing `identity:get_project(project_id=746cf064ee5344ddb5daa2377fd66d25)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:21.089889 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b0011a-0edd-423f-895a-f1dcd23d845f None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:21.093136 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 136/289] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Jul 11 14:26:20 2022] GET /identity/v3/projects/746cf064ee5344ddb5daa2377fd66d25 => generated 302 bytes in 418 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:21.104572 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce65d3a5-332f-49a8-b961-10ef9211b3fc None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:21.106192 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b0011a-0edd-423f-895a-f1dcd23d845f None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:21.311269 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b0011a-0edd-423f-895a-f1dcd23d845f None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:21.377245 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd29c8ce-f719-416d-bf49-9e5dae928e98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:21.378846 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd29c8ce-f719-416d-bf49-9e5dae928e98 None admin] REQUEST_METHOD: `PUT` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:21.379352 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd29c8ce-f719-416d-bf49-9e5dae928e98 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:21.381584 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd29c8ce-f719-416d-bf49-9e5dae928e98 None admin] PATH_INFO: `/v3/projects/746cf064ee5344ddb5daa2377fd66d25/users/126a310efd0e46acbcf6f8d6434fd0ee/roles/09e9dee5b1e848eaba8cef2325325d08` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:21.383870 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd29c8ce-f719-416d-bf49-9e5dae928e98 None admin] RBAC: Authorizing `identity:create_grant(project_id=746cf064ee5344ddb5daa2377fd66d25, user_id=126a310efd0e46acbcf6f8d6434fd0ee, role_id=09e9dee5b1e848eaba8cef2325325d08)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:21.386966 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd29c8ce-f719-416d-bf49-9e5dae928e98 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:21.414359 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 137/290] 10.222.0.70 () {58 vars in 1439 bytes} [Mon Jul 11 14:26:21 2022] PUT /identity/v3/projects/746cf064ee5344ddb5daa2377fd66d25/users/126a310efd0e46acbcf6f8d6434fd0ee/roles/09e9dee5b1e848eaba8cef2325325d08 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:26:21.485255 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce65d3a5-332f-49a8-b961-10ef9211b3fc None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:21.588476 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f167cd46-10c8-431c-a8b3-40117e10acfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:21.590006 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f167cd46-10c8-431c-a8b3-40117e10acfc None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:21.590493 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f167cd46-10c8-431c-a8b3-40117e10acfc None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:21.590973 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f167cd46-10c8-431c-a8b3-40117e10acfc None admin] PATH_INFO: `/v3/users/acda269970984c47906ad0c6b5707dcc` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:21.593536 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f167cd46-10c8-431c-a8b3-40117e10acfc None admin] RBAC: Authorizing `identity:get_user(user_id=acda269970984c47906ad0c6b5707dcc)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:21.596273 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f167cd46-10c8-431c-a8b3-40117e10acfc None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:21.599388 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 154/291] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Jul 11 14:26:21 2022] GET /identity/v3/users/acda269970984c47906ad0c6b5707dcc => generated 297 bytes in 496 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:21.609131 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd29c8ce-f719-416d-bf49-9e5dae928e98 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:21.639718 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:21.789988 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd29c8ce-f719-416d-bf49-9e5dae928e98 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:21.838667 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92388ca-f51b-421d-9eaf-830a611d5c14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:21.839241 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92388ca-f51b-421d-9eaf-830a611d5c14 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:21.839524 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92388ca-f51b-421d-9eaf-830a611d5c14 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:21.839802 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92388ca-f51b-421d-9eaf-830a611d5c14 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:21.927514 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92388ca-f51b-421d-9eaf-830a611d5c14 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:21.930744 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92388ca-f51b-421d-9eaf-830a611d5c14 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:21.940768 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:22.052590 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 138/292] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Jul 11 14:26:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 14:26:22.060111 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f167cd46-10c8-431c-a8b3-40117e10acfc None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:22.191267 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:22.296333 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f167cd46-10c8-431c-a8b3-40117e10acfc None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:22.380604 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352abf69-557e-461e-af44-bf127c4e24ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:22.381726 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352abf69-557e-461e-af44-bf127c4e24ed None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:22.382014 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352abf69-557e-461e-af44-bf127c4e24ed None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:22.382295 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352abf69-557e-461e-af44-bf127c4e24ed None admin] PATH_INFO: `/v3/projects/746cf064ee5344ddb5daa2377fd66d25` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:22.386310 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352abf69-557e-461e-af44-bf127c4e24ed None admin] RBAC: Authorizing `identity:get_project(project_id=746cf064ee5344ddb5daa2377fd66d25)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:22.387838 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352abf69-557e-461e-af44-bf127c4e24ed None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:22.390104 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 155/293] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Jul 11 14:26:22 2022] GET /identity/v3/projects/746cf064ee5344ddb5daa2377fd66d25 => generated 302 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:26:22.399936 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92388ca-f51b-421d-9eaf-830a611d5c14 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:22.671589 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92388ca-f51b-421d-9eaf-830a611d5c14 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:22.685135 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:22.728693 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006243eb-ebb9-4e78-b11a-d90cd609a306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:22.729387 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006243eb-ebb9-4e78-b11a-d90cd609a306 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:22.729674 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006243eb-ebb9-4e78-b11a-d90cd609a306 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:22.729959 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006243eb-ebb9-4e78-b11a-d90cd609a306 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:22.730853 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006243eb-ebb9-4e78-b11a-d90cd609a306 None admin] RBAC: Adding query filter params (role.id=8eff41f243c843ed95505a488ca6eada, scope.project.id=746cf064ee5344ddb5daa2377fd66d25, user.id=acda269970984c47906ad0c6b5707dcc) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:22.731173 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006243eb-ebb9-4e78-b11a-d90cd609a306 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:22.732780 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006243eb-ebb9-4e78-b11a-d90cd609a306 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:22.741436 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 139/294] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Jul 11 14:26:22 2022] GET /identity/v3/role_assignments?user.id=acda269970984c47906ad0c6b5707dcc&scope.project.id=746cf064ee5344ddb5daa2377fd66d25&role.id=8eff41f243c843ed95505a488ca6eada => generated 608 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:23.233391 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b854b0-4fe6-4a03-8530-35a62b21660f None None] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:23.234936 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b854b0-4fe6-4a03-8530-35a62b21660f None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:23.235737 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b854b0-4fe6-4a03-8530-35a62b21660f None None] PATH_INFO: `/` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:23.239016 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 156/295] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:26:23 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:26:23.248846 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514c1214-943d-4778-9b56-297fbd4017ba None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:23.249304 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514c1214-943d-4778-9b56-297fbd4017ba None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:23.249775 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514c1214-943d-4778-9b56-297fbd4017ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:23.290465 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-514c1214-943d-4778-9b56-297fbd4017ba None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:26:23.292622 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-514c1214-943d-4778-9b56-297fbd4017ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:26:23.448096 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 140/296] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:26:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:26:23.479743 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b854b0-4fe6-4a03-8530-35a62b21660f None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:23.601379 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b854b0-4fe6-4a03-8530-35a62b21660f None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:23.631328 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:23.639723 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e141f0af-0270-40a2-986d-479be08bcb57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:23.644848 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e141f0af-0270-40a2-986d-479be08bcb57 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:23.645702 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e141f0af-0270-40a2-986d-479be08bcb57 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:23.647108 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e141f0af-0270-40a2-986d-479be08bcb57 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:23.661209 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e141f0af-0270-40a2-986d-479be08bcb57 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:26:23.670535 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application [None req-e141f0af-0270-40a2-986d-479be08bcb57 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 14:26:23.670535 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:23.670535 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:26:23.670535 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:26:23.670535 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:26:23.670535 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:26:23.670535 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:26:23.670535 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:26:23.670535 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:26:23.670535 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:26:23.670535 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:26:23.670535 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:26:23.670535 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:26:23.670535 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:26:23.670535 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:26:23.670535 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:26:23.671450 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:26:23.671450 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:26:23.671450 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:26:23.671450 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:26:23.671450 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:26:23.671450 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:26:23.671450 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:26:23.671450 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:26:23.671450 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:26:23.671450 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:26:23.671450 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:26:23.671450 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application with Lock( Jul 11 14:26:23.671450 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:26:23.671450 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:26:23.671450 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:26:23.671450 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:26:23.672785 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:26:23.672785 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:26:23.672785 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:26:23.672785 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:26:23.672785 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:26:23.672785 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:26:23.672785 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:26:23.672785 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:26:23.672785 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:26:23.672785 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:26:23.672785 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 14:26:23.672785 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Jul 11 14:26:23.674943 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 157/297] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Jul 11 14:26:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:26:23.681712 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514c1214-943d-4778-9b56-297fbd4017ba None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:23.838017 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:23.841962 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514c1214-943d-4778-9b56-297fbd4017ba None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:23.887262 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e7c73f-643f-41af-9b2e-de80e1dad3ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:23.887962 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e7c73f-643f-41af-9b2e-de80e1dad3ee None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:23.888279 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e7c73f-643f-41af-9b2e-de80e1dad3ee None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:23.888560 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e7c73f-643f-41af-9b2e-de80e1dad3ee None admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:23.889332 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e7c73f-643f-41af-9b2e-de80e1dad3ee None admin] RBAC: Adding query filter params (name=member) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:23.889639 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e7c73f-643f-41af-9b2e-de80e1dad3ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:23.891057 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e7c73f-643f-41af-9b2e-de80e1dad3ee None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:23.902371 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 141/298] 10.222.0.70 () {56 vars in 1101 bytes} [Mon Jul 11 14:26:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:26:23.907644 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e141f0af-0270-40a2-986d-479be08bcb57 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:23.972241 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdbb0f1-224a-485f-832e-1dae8f8a4a6a None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:23.972577 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdbb0f1-224a-485f-832e-1dae8f8a4a6a None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:23.972834 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdbb0f1-224a-485f-832e-1dae8f8a4a6a None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:23.975059 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 142/299] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:26:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 14:26:23.980362 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a821f1-e476-4df9-9b4d-133fd3f9b218 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:23.980653 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a821f1-e476-4df9-9b4d-133fd3f9b218 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:23.980935 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a821f1-e476-4df9-9b4d-133fd3f9b218 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:23.999810 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-78a821f1-e476-4df9-9b4d-133fd3f9b218 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:26:24.001162 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-78a821f1-e476-4df9-9b4d-133fd3f9b218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:26:24.091367 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e141f0af-0270-40a2-986d-479be08bcb57 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:24.131043 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 143/300] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:26:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 14:26:24.139750 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be00c24-1908-4085-8593-44f607895203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:24.140756 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be00c24-1908-4085-8593-44f607895203 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:24.141107 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be00c24-1908-4085-8593-44f607895203 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:24.141396 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be00c24-1908-4085-8593-44f607895203 None admin] PATH_INFO: `/v3/users/2fc242dc65c8451fabe1b25fe67ab305` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:24.142702 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be00c24-1908-4085-8593-44f607895203 None admin] RBAC: Authorizing `identity:get_user(user_id=2fc242dc65c8451fabe1b25fe67ab305)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:24.144427 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be00c24-1908-4085-8593-44f607895203 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:24.147327 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 158/301] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Jul 11 14:26:23 2022] GET /identity/v3/users/2fc242dc65c8451fabe1b25fe67ab305 => generated 293 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:24.158993 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a821f1-e476-4df9-9b4d-133fd3f9b218 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:24.168239 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be00c24-1908-4085-8593-44f607895203 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:24.229258 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:24.280066 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:24.287549 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be00c24-1908-4085-8593-44f607895203 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:24.293741 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a821f1-e476-4df9-9b4d-133fd3f9b218 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:24.326826 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4e34ed-6b4b-43f7-abbf-35b6de6c8f5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:24.327873 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4e34ed-6b4b-43f7-abbf-35b6de6c8f5a None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:24.327873 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4e34ed-6b4b-43f7-abbf-35b6de6c8f5a None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:24.327873 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4e34ed-6b4b-43f7-abbf-35b6de6c8f5a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:24.330262 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4e34ed-6b4b-43f7-abbf-35b6de6c8f5a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:24.331773 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4e34ed-6b4b-43f7-abbf-35b6de6c8f5a None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:24.333579 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 159/302] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 11 14:26:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:24.334838 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec78317f-50e9-45c2-a1f8-fe948cac5ba3 None None] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:24.335122 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec78317f-50e9-45c2-a1f8-fe948cac5ba3 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:24.335746 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec78317f-50e9-45c2-a1f8-fe948cac5ba3 None None] PATH_INFO: `/` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:24.337600 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 160/303] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:26:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:26:24.338798 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0d90fc-4dd3-438f-8ca3-a71a5a16a9ae None None] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:24.339129 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0d90fc-4dd3-438f-8ca3-a71a5a16a9ae None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:24.339670 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0d90fc-4dd3-438f-8ca3-a71a5a16a9ae None None] PATH_INFO: `/` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:24.341153 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 161/304] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:26:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:26:24.341927 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0d90fc-4dd3-438f-8ca3-a71a5a16a9ae None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:24.342269 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066f3b99-ccc0-41e0-9c40-5bd00ae95523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:24.343156 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066f3b99-ccc0-41e0-9c40-5bd00ae95523 None admin] REQUEST_METHOD: `PUT` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:24.343437 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066f3b99-ccc0-41e0-9c40-5bd00ae95523 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:24.343713 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066f3b99-ccc0-41e0-9c40-5bd00ae95523 None admin] PATH_INFO: `/v3/system/users/2fc242dc65c8451fabe1b25fe67ab305/roles/8eff41f243c843ed95505a488ca6eada` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:24.346767 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066f3b99-ccc0-41e0-9c40-5bd00ae95523 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=2fc242dc65c8451fabe1b25fe67ab305, role_id=8eff41f243c843ed95505a488ca6eada)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:24.348361 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066f3b99-ccc0-41e0-9c40-5bd00ae95523 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:24.358872 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 144/305] 10.222.0.70 () {58 vars in 1334 bytes} [Mon Jul 11 14:26:24 2022] PUT /identity/v3/system/users/2fc242dc65c8451fabe1b25fe67ab305/roles/8eff41f243c843ed95505a488ca6eada => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:26:24.360057 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3079c6-7a6a-4a2a-aee9-fa5ad77fb99a None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:24.360379 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3079c6-7a6a-4a2a-aee9-fa5ad77fb99a None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:24.360656 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3079c6-7a6a-4a2a-aee9-fa5ad77fb99a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:24.384169 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-5a3079c6-7a6a-4a2a-aee9-fa5ad77fb99a None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:26:24.385638 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-5a3079c6-7a6a-4a2a-aee9-fa5ad77fb99a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:26:24.480503 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 145/306] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:26:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:26:24.482311 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14301ebc-7177-4d5a-bd57-0702327d611b None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:24.482668 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14301ebc-7177-4d5a-bd57-0702327d611b None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:24.482953 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14301ebc-7177-4d5a-bd57-0702327d611b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:24.503703 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-14301ebc-7177-4d5a-bd57-0702327d611b None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:26:24.505022 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-14301ebc-7177-4d5a-bd57-0702327d611b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:26:24.517695 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0d90fc-4dd3-438f-8ca3-a71a5a16a9ae None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:24.540489 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:24.567424 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2d36cf-1ab0-47b7-88df-70c71cfc189c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:24.568716 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2d36cf-1ab0-47b7-88df-70c71cfc189c None admin] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:24.569158 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2d36cf-1ab0-47b7-88df-70c71cfc189c None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:24.569438 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2d36cf-1ab0-47b7-88df-70c71cfc189c None admin] PATH_INFO: `/v3/groups` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:24.570244 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2d36cf-1ab0-47b7-88df-70c71cfc189c None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:24.571779 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2d36cf-1ab0-47b7-88df-70c71cfc189c None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:24.600419 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 162/307] 10.222.0.70 () {60 vars in 1134 bytes} [Mon Jul 11 14:26:24 2022] POST /identity/v3/groups => generated 229 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:26:24.603084 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2d36cf-1ab0-47b7-88df-70c71cfc189c None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:24.624295 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 146/308] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:26:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:26:24.666599 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14301ebc-7177-4d5a-bd57-0702327d611b None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:24.698161 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:24.795535 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2d36cf-1ab0-47b7-88df-70c71cfc189c None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:24.860911 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a786ea-1f54-43d1-be43-8176b1392d49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:24.862101 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a786ea-1f54-43d1-be43-8176b1392d49 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:24.862387 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a786ea-1f54-43d1-be43-8176b1392d49 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:24.862667 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a786ea-1f54-43d1-be43-8176b1392d49 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:24.865459 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14301ebc-7177-4d5a-bd57-0702327d611b None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:24.878644 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a786ea-1f54-43d1-be43-8176b1392d49 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:26:24.889110 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application [None req-45a786ea-1f54-43d1-be43-8176b1392d49 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 14:26:24.889110 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:24.889110 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:26:24.889110 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:26:24.889110 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:26:24.889110 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:26:24.889110 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:26:24.889110 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:26:24.889110 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:26:24.889110 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:26:24.889110 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:26:24.889110 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:26:24.889110 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:26:24.889110 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:26:24.889110 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:26:24.889110 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:26:24.890068 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:26:24.890068 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:26:24.890068 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:26:24.890068 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:26:24.890068 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:26:24.890068 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:26:24.890068 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:26:24.890068 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:26:24.890068 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:26:24.890068 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:26:24.890068 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:26:24.890068 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application with Lock( Jul 11 14:26:24.890068 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:26:24.890068 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:26:24.890068 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:26:24.890068 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:26:24.890845 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:26:24.890845 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:26:24.890845 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:26:24.890845 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:26:24.890845 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:26:24.890845 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:26:24.890845 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:26:24.890845 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:26:24.890845 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:26:24.890845 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:26:24.890845 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 14:26:24.890845 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Jul 11 14:26:24.892328 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 163/309] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Jul 11 14:26:24 2022] GET /identity/v3/roles/reader => generated 84 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:26:24.897978 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a786ea-1f54-43d1-be43-8176b1392d49 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:24.950870 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20779c4-f2d3-4b03-9f7b-f8a169c5f53c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:24.952494 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20779c4-f2d3-4b03-9f7b-f8a169c5f53c None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:24.953317 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20779c4-f2d3-4b03-9f7b-f8a169c5f53c None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:24.954094 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20779c4-f2d3-4b03-9f7b-f8a169c5f53c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:24.970044 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20779c4-f2d3-4b03-9f7b-f8a169c5f53c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:26:24.977608 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:24.979831 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-b20779c4-f2d3-4b03-9f7b-f8a169c5f53c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 14:26:24.979831 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:24.979831 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:26:24.979831 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:26:24.979831 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:26:24.979831 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:26:24.979831 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:26:24.979831 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:26:24.979831 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:26:24.979831 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:26:24.979831 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:26:24.979831 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:26:24.979831 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:26:24.979831 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:26:24.979831 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:26:24.979831 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:26:24.981697 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:26:24.981697 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:26:24.981697 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:26:24.981697 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:26:24.981697 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:26:24.981697 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:26:24.981697 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:26:24.981697 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:26:24.981697 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:26:24.981697 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:26:24.981697 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:26:24.981697 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( Jul 11 14:26:24.981697 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:26:24.981697 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:26:24.981697 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:26:24.981697 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:26:24.983125 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:26:24.983125 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:26:24.983125 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:26:24.983125 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:26:24.983125 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:26:24.983125 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:26:24.983125 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:26:24.983125 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:26:24.983125 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:26:24.983125 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:26:24.983125 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 14:26:24.983125 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Jul 11 14:26:24.983125 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 147/310] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Jul 11 14:26:24 2022] GET /identity/v3/roles/reader => generated 84 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:26:24.994749 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20779c4-f2d3-4b03-9f7b-f8a169c5f53c None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:25.095199 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a786ea-1f54-43d1-be43-8176b1392d49 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:25.152502 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fdadba-56fb-43d2-935a-793c1c48af31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:25.154113 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fdadba-56fb-43d2-935a-793c1c48af31 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:25.154926 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fdadba-56fb-43d2-935a-793c1c48af31 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:25.155675 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fdadba-56fb-43d2-935a-793c1c48af31 None admin] PATH_INFO: `/v3/roles` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:25.157404 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fdadba-56fb-43d2-935a-793c1c48af31 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:25.158247 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fdadba-56fb-43d2-935a-793c1c48af31 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:25.161268 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fdadba-56fb-43d2-935a-793c1c48af31 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:25.162464 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:25.184745 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 164/311] 10.222.0.70 () {56 vars in 1101 bytes} [Mon Jul 11 14:26:24 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:25.188239 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fdadba-56fb-43d2-935a-793c1c48af31 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:25.196935 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20779c4-f2d3-4b03-9f7b-f8a169c5f53c None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:25.263742 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574f35e9-a1f3-4e65-bc43-7aab6f301296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:25.264927 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574f35e9-a1f3-4e65-bc43-7aab6f301296 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:25.265467 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574f35e9-a1f3-4e65-bc43-7aab6f301296 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:25.265963 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574f35e9-a1f3-4e65-bc43-7aab6f301296 None admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:25.267001 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574f35e9-a1f3-4e65-bc43-7aab6f301296 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:25.267581 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574f35e9-a1f3-4e65-bc43-7aab6f301296 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:25.269289 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574f35e9-a1f3-4e65-bc43-7aab6f301296 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:25.284540 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 148/312] 10.222.0.70 () {56 vars in 1101 bytes} [Mon Jul 11 14:26:24 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:26:25.285921 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574f35e9-a1f3-4e65-bc43-7aab6f301296 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:25.348482 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:25.354185 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fdadba-56fb-43d2-935a-793c1c48af31 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:25.395421 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c68867b-f469-412a-8d27-014cb95bb434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:25.397098 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c68867b-f469-412a-8d27-014cb95bb434 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:25.397971 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c68867b-f469-412a-8d27-014cb95bb434 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:25.398789 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c68867b-f469-412a-8d27-014cb95bb434 None admin] PATH_INFO: `/v3/users/b5b0be47ff8b4207b06e612e972bddec` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:25.419983 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c68867b-f469-412a-8d27-014cb95bb434 None admin] RBAC: Authorizing `identity:get_user(user_id=b5b0be47ff8b4207b06e612e972bddec)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:25.421757 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c68867b-f469-412a-8d27-014cb95bb434 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:25.424431 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 165/313] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Jul 11 14:26:25 2022] GET /identity/v3/users/b5b0be47ff8b4207b06e612e972bddec => generated 293 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:25.429809 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574f35e9-a1f3-4e65-bc43-7aab6f301296 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:25.430305 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c68867b-f469-412a-8d27-014cb95bb434 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:25.479364 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748ef767-327e-4f6c-ae70-4de47d834eff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:25.480668 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748ef767-327e-4f6c-ae70-4de47d834eff None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:25.481592 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748ef767-327e-4f6c-ae70-4de47d834eff None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:25.482679 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748ef767-327e-4f6c-ae70-4de47d834eff None admin] PATH_INFO: `/v3/users/126a310efd0e46acbcf6f8d6434fd0ee` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:25.484701 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748ef767-327e-4f6c-ae70-4de47d834eff None admin] RBAC: Authorizing `identity:get_user(user_id=126a310efd0e46acbcf6f8d6434fd0ee)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:25.487206 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748ef767-327e-4f6c-ae70-4de47d834eff None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:25.490428 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 149/314] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Jul 11 14:26:25 2022] GET /identity/v3/users/126a310efd0e46acbcf6f8d6434fd0ee => generated 297 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:25.495446 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748ef767-327e-4f6c-ae70-4de47d834eff None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:25.513987 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:25.570475 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c68867b-f469-412a-8d27-014cb95bb434 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:25.620958 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe1610f-8b29-4106-b65d-a5f52e51b354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:25.621616 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe1610f-8b29-4106-b65d-a5f52e51b354 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:25.621943 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe1610f-8b29-4106-b65d-a5f52e51b354 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:25.622195 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe1610f-8b29-4106-b65d-a5f52e51b354 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:25.623000 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe1610f-8b29-4106-b65d-a5f52e51b354 None admin] RBAC: Adding query filter params (role.id=09e9dee5b1e848eaba8cef2325325d08, user.id=b5b0be47ff8b4207b06e612e972bddec, scope.system=all) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:25.623308 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe1610f-8b29-4106-b65d-a5f52e51b354 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:25.624766 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe1610f-8b29-4106-b65d-a5f52e51b354 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:25.633663 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 166/315] 10.222.0.70 () {56 vars in 1308 bytes} [Mon Jul 11 14:26:25 2022] GET /identity/v3/role_assignments?user.id=b5b0be47ff8b4207b06e612e972bddec&scope.system=all&role.id=09e9dee5b1e848eaba8cef2325325d08 => generated 226 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:26:25.645293 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748ef767-327e-4f6c-ae70-4de47d834eff None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:25.693119 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac195904-e66a-4242-8885-66fa0ecbbf7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:25.694329 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac195904-e66a-4242-8885-66fa0ecbbf7f None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:25.694881 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac195904-e66a-4242-8885-66fa0ecbbf7f None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:25.695442 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac195904-e66a-4242-8885-66fa0ecbbf7f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:25.783431 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac195904-e66a-4242-8885-66fa0ecbbf7f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:25.785440 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac195904-e66a-4242-8885-66fa0ecbbf7f None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:25.797443 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:25.961635 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 150/316] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Jul 11 14:26:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 14:26:25.970580 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe1610f-8b29-4106-b65d-a5f52e51b354 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:26.017131 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:26.168909 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe1610f-8b29-4106-b65d-a5f52e51b354 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:26.235084 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaaf4ae-c650-4f04-83d5-916c9225cea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:26.236568 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaaf4ae-c650-4f04-83d5-916c9225cea8 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:26.237065 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaaf4ae-c650-4f04-83d5-916c9225cea8 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:26.237555 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaaf4ae-c650-4f04-83d5-916c9225cea8 None admin] PATH_INFO: `/v3/projects/746cf064ee5344ddb5daa2377fd66d25` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:26.239751 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfaaf4ae-c650-4f04-83d5-916c9225cea8 None admin] RBAC: Authorizing `identity:get_project(project_id=746cf064ee5344ddb5daa2377fd66d25)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:26.242609 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfaaf4ae-c650-4f04-83d5-916c9225cea8 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:26.246436 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 167/317] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Jul 11 14:26:25 2022] GET /identity/v3/projects/746cf064ee5344ddb5daa2377fd66d25 => generated 302 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:26:26.256594 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac195904-e66a-4242-8885-66fa0ecbbf7f None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:26.456682 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac195904-e66a-4242-8885-66fa0ecbbf7f None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:26.472755 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:26.526545 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35eaca79-e737-4a0f-815e-a848d253ebbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:26.527670 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eaca79-e737-4a0f-815e-a848d253ebbe None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:26.532238 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eaca79-e737-4a0f-815e-a848d253ebbe None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:26.532238 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eaca79-e737-4a0f-815e-a848d253ebbe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:26.532238 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35eaca79-e737-4a0f-815e-a848d253ebbe None admin] RBAC: Adding query filter params (role.id=09e9dee5b1e848eaba8cef2325325d08, scope.project.id=746cf064ee5344ddb5daa2377fd66d25, user.id=126a310efd0e46acbcf6f8d6434fd0ee) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:26.532238 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35eaca79-e737-4a0f-815e-a848d253ebbe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:26.533873 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35eaca79-e737-4a0f-815e-a848d253ebbe None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:26.546544 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 151/318] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Jul 11 14:26:26 2022] GET /identity/v3/role_assignments?user.id=126a310efd0e46acbcf6f8d6434fd0ee&scope.project.id=746cf064ee5344ddb5daa2377fd66d25&role.id=09e9dee5b1e848eaba8cef2325325d08 => generated 608 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:26.766377 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b27738e-7408-4a42-b5ad-bae99ecd286a None None] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:26.767106 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b27738e-7408-4a42-b5ad-bae99ecd286a None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:26.767106 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b27738e-7408-4a42-b5ad-bae99ecd286a None None] PATH_INFO: `/` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:26.768644 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 168/319] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:26:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 14:26:26.775459 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4787053f-54e3-4dc9-9f03-de0f7ed38f72 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:26.775964 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4787053f-54e3-4dc9-9f03-de0f7ed38f72 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:26.776497 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4787053f-54e3-4dc9-9f03-de0f7ed38f72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:26.806661 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-4787053f-54e3-4dc9-9f03-de0f7ed38f72 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:26:26.808930 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-4787053f-54e3-4dc9-9f03-de0f7ed38f72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:26:26.840451 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1557bf5c-57c0-40d9-b0c3-fa202e026bbd None None] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:26.840786 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1557bf5c-57c0-40d9-b0c3-fa202e026bbd None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:26.841015 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1557bf5c-57c0-40d9-b0c3-fa202e026bbd None None] PATH_INFO: `/` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:26.842537 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 169/320] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:26:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:26:26.848321 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df11d923-36c7-4567-a978-3ded812691ff None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:26.848946 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df11d923-36c7-4567-a978-3ded812691ff None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:26.849534 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df11d923-36c7-4567-a978-3ded812691ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:26.872437 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-df11d923-36c7-4567-a978-3ded812691ff None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:26:26.874636 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-df11d923-36c7-4567-a978-3ded812691ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:26:26.926712 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 152/321] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:26:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:26:26.958395 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 170/322] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:26:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 14:26:26.965616 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4787053f-54e3-4dc9-9f03-de0f7ed38f72 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:26.982041 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df11d923-36c7-4567-a978-3ded812691ff None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:27.020093 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:27.106061 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:27.111025 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4787053f-54e3-4dc9-9f03-de0f7ed38f72 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:27.122024 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df11d923-36c7-4567-a978-3ded812691ff None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:27.165029 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15604bb5-2982-4748-95aa-13846b2004aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:27.166284 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15604bb5-2982-4748-95aa-13846b2004aa None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:27.166752 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15604bb5-2982-4748-95aa-13846b2004aa None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:27.167215 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15604bb5-2982-4748-95aa-13846b2004aa None admin] PATH_INFO: `/v3/roles/member` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:27.168989 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa9988b-5cdb-4964-b4f0-508099d2cafe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:27.170136 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa9988b-5cdb-4964-b4f0-508099d2cafe None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:27.170580 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa9988b-5cdb-4964-b4f0-508099d2cafe None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:27.171023 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa9988b-5cdb-4964-b4f0-508099d2cafe None admin] PATH_INFO: `/v3/domains/default` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:27.172805 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa9988b-5cdb-4964-b4f0-508099d2cafe None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:27.175342 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa9988b-5cdb-4964-b4f0-508099d2cafe None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:27.183837 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 171/323] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 11 14:26:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:27.184997 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15604bb5-2982-4748-95aa-13846b2004aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:26:27.185457 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa9988b-5cdb-4964-b4f0-508099d2cafe None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:27.199027 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-15604bb5-2982-4748-95aa-13846b2004aa None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 14:26:27.199027 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:27.199027 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:26:27.199027 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:26:27.199027 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:26:27.199027 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:26:27.199027 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:26:27.199027 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:26:27.199027 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:26:27.199027 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:26:27.199027 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:26:27.199027 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:26:27.199027 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:26:27.199027 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:26:27.199027 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:26:27.199027 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:26:27.200089 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:26:27.200089 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:26:27.200089 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:26:27.200089 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:26:27.200089 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:26:27.200089 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:26:27.200089 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:26:27.200089 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:26:27.200089 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:26:27.200089 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:26:27.200089 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:26:27.200089 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( Jul 11 14:26:27.200089 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:26:27.200089 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:26:27.200089 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:26:27.200089 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:26:27.200986 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:26:27.200986 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:26:27.200986 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:26:27.200986 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:26:27.200986 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:26:27.200986 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:26:27.200986 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:26:27.200986 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:26:27.200986 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:26:27.200986 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:26:27.200986 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 14:26:27.200986 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Jul 11 14:26:27.200986 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 153/324] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Jul 11 14:26:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:26:27.210583 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15604bb5-2982-4748-95aa-13846b2004aa None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:27.310975 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:27.332855 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa9988b-5cdb-4964-b4f0-508099d2cafe None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:27.357870 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15604bb5-2982-4748-95aa-13846b2004aa None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:27.394330 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f25005-b5dd-420c-91b2-94b0c6deec89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:27.395371 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f25005-b5dd-420c-91b2-94b0c6deec89 None admin] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:27.397102 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f25005-b5dd-420c-91b2-94b0c6deec89 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:27.397520 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f25005-b5dd-420c-91b2-94b0c6deec89 None admin] PATH_INFO: `/v3/groups` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:27.398870 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f25005-b5dd-420c-91b2-94b0c6deec89 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:27.401216 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f25005-b5dd-420c-91b2-94b0c6deec89 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:27.421728 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af38f33c-f8a6-4d40-a243-a79a7b424e95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:27.422762 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af38f33c-f8a6-4d40-a243-a79a7b424e95 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:27.423232 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af38f33c-f8a6-4d40-a243-a79a7b424e95 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:27.423664 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af38f33c-f8a6-4d40-a243-a79a7b424e95 None admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:27.436252 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 172/325] 10.222.0.70 () {60 vars in 1134 bytes} [Mon Jul 11 14:26:27 2022] POST /identity/v3/groups => generated 226 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:26:27.436526 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af38f33c-f8a6-4d40-a243-a79a7b424e95 None admin] RBAC: Adding query filter params (name=member) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:27.436526 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af38f33c-f8a6-4d40-a243-a79a7b424e95 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:27.436526 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af38f33c-f8a6-4d40-a243-a79a7b424e95 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:27.449639 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 154/326] 10.222.0.70 () {56 vars in 1101 bytes} [Mon Jul 11 14:26:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:26:27.461523 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f25005-b5dd-420c-91b2-94b0c6deec89 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:27.674642 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f25005-b5dd-420c-91b2-94b0c6deec89 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:27.742768 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e75c54-7ffe-411e-a886-f6a39c38c435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:27.744383 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e75c54-7ffe-411e-a886-f6a39c38c435 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:27.744896 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e75c54-7ffe-411e-a886-f6a39c38c435 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:27.745419 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e75c54-7ffe-411e-a886-f6a39c38c435 None admin] PATH_INFO: `/v3/users/2fc242dc65c8451fabe1b25fe67ab305` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:27.747845 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e75c54-7ffe-411e-a886-f6a39c38c435 None admin] RBAC: Authorizing `identity:get_user(user_id=2fc242dc65c8451fabe1b25fe67ab305)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:27.750742 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e75c54-7ffe-411e-a886-f6a39c38c435 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:27.753815 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 173/327] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Jul 11 14:26:27 2022] GET /identity/v3/users/2fc242dc65c8451fabe1b25fe67ab305 => generated 293 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:27.762333 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af38f33c-f8a6-4d40-a243-a79a7b424e95 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:27.797154 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:27.907102 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af38f33c-f8a6-4d40-a243-a79a7b424e95 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:27.982414 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62b2388-93bc-435f-888f-0fae97e7535a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:27.983455 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62b2388-93bc-435f-888f-0fae97e7535a None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:27.983938 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62b2388-93bc-435f-888f-0fae97e7535a None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:27.984524 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62b2388-93bc-435f-888f-0fae97e7535a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:27.986235 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62b2388-93bc-435f-888f-0fae97e7535a None admin] RBAC: Adding query filter params (role.id=8eff41f243c843ed95505a488ca6eada, user.id=2fc242dc65c8451fabe1b25fe67ab305, scope.system=all) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:27.986758 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62b2388-93bc-435f-888f-0fae97e7535a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:27.989362 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62b2388-93bc-435f-888f-0fae97e7535a None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:28.018425 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 155/328] 10.222.0.70 () {56 vars in 1308 bytes} [Mon Jul 11 14:26:27 2022] GET /identity/v3/role_assignments?user.id=2fc242dc65c8451fabe1b25fe67ab305&scope.system=all&role.id=8eff41f243c843ed95505a488ca6eada => generated 510 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:28.657655 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d4d247-bc95-4f5b-aa81-921a573889d8 None None] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:28.658411 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d4d247-bc95-4f5b-aa81-921a573889d8 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:28.658411 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d4d247-bc95-4f5b-aa81-921a573889d8 None None] PATH_INFO: `/` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:28.659849 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 174/329] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:26:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:26:28.666365 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d1e350-ea5b-4900-93d6-039e523f2858 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:28.666756 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d1e350-ea5b-4900-93d6-039e523f2858 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:28.666991 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d1e350-ea5b-4900-93d6-039e523f2858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:28.686870 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-47d1e350-ea5b-4900-93d6-039e523f2858 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:26:28.688522 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-47d1e350-ea5b-4900-93d6-039e523f2858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:26:28.823121 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 156/330] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:26:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 14:26:28.859166 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d4d247-bc95-4f5b-aa81-921a573889d8 None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:28.900507 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:29.015800 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d4d247-bc95-4f5b-aa81-921a573889d8 None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:29.060336 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cb1594-03fa-4f0c-9ee2-5b919c315533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:29.061592 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cb1594-03fa-4f0c-9ee2-5b919c315533 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:29.062076 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cb1594-03fa-4f0c-9ee2-5b919c315533 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:29.062599 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cb1594-03fa-4f0c-9ee2-5b919c315533 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:29.077446 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cb1594-03fa-4f0c-9ee2-5b919c315533 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:26:29.085862 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application [None req-24cb1594-03fa-4f0c-9ee2-5b919c315533 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 14:26:29.085862 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:29.085862 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:26:29.085862 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:26:29.085862 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:26:29.085862 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:26:29.085862 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:26:29.085862 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:26:29.085862 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:26:29.085862 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:26:29.085862 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:26:29.085862 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:26:29.085862 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:26:29.085862 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:26:29.085862 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:26:29.085862 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:26:29.086809 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:26:29.086809 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:26:29.086809 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:26:29.086809 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:26:29.086809 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:26:29.086809 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:26:29.086809 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:26:29.086809 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:26:29.086809 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:26:29.086809 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:26:29.086809 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:26:29.086809 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application with Lock( Jul 11 14:26:29.086809 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:26:29.086809 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:26:29.086809 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:26:29.086809 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:26:29.087615 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:26:29.087615 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:26:29.087615 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:26:29.087615 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:26:29.087615 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:26:29.087615 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:26:29.087615 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:26:29.087615 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:26:29.087615 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:26:29.087615 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:26:29.087615 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 14:26:29.087615 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Jul 11 14:26:29.090168 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 175/331] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Jul 11 14:26:28 2022] GET /identity/v3/roles/reader => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:26:29.097934 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d1e350-ea5b-4900-93d6-039e523f2858 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:29.128862 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:29.305976 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d1e350-ea5b-4900-93d6-039e523f2858 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:29.347948 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e10e65-5da1-4013-9756-234e3b36d5bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:29.349053 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e10e65-5da1-4013-9756-234e3b36d5bb None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:29.350145 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e10e65-5da1-4013-9756-234e3b36d5bb None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:29.350616 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e10e65-5da1-4013-9756-234e3b36d5bb None admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:29.351572 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e10e65-5da1-4013-9756-234e3b36d5bb None admin] RBAC: Adding query filter params (name=reader) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:29.352084 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e10e65-5da1-4013-9756-234e3b36d5bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:29.353720 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e10e65-5da1-4013-9756-234e3b36d5bb None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:29.369840 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 157/332] 10.222.0.70 () {56 vars in 1101 bytes} [Mon Jul 11 14:26:29 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:29.376398 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cb1594-03fa-4f0c-9ee2-5b919c315533 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:29.588123 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:29.657512 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cb1594-03fa-4f0c-9ee2-5b919c315533 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:29.738573 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33132f7-41c7-4a4f-a6af-27e7e738085c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:29.739478 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33132f7-41c7-4a4f-a6af-27e7e738085c None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:29.740353 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33132f7-41c7-4a4f-a6af-27e7e738085c None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:29.740634 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33132f7-41c7-4a4f-a6af-27e7e738085c None admin] PATH_INFO: `/v3/users/b5b0be47ff8b4207b06e612e972bddec` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:29.742383 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33132f7-41c7-4a4f-a6af-27e7e738085c None admin] RBAC: Authorizing `identity:get_user(user_id=b5b0be47ff8b4207b06e612e972bddec)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:29.743881 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33132f7-41c7-4a4f-a6af-27e7e738085c None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:29.746024 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 176/333] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Jul 11 14:26:29 2022] GET /identity/v3/users/b5b0be47ff8b4207b06e612e972bddec => generated 293 bytes in 371 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:26:29.753393 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e10e65-5da1-4013-9756-234e3b36d5bb None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:29.876106 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:29.921436 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e10e65-5da1-4013-9756-234e3b36d5bb None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:29.972513 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1098be0-83ff-4b6e-ab0f-f42d3208c108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:29.973798 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1098be0-83ff-4b6e-ab0f-f42d3208c108 None admin] REQUEST_METHOD: `PUT` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:29.974893 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1098be0-83ff-4b6e-ab0f-f42d3208c108 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:29.975381 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1098be0-83ff-4b6e-ab0f-f42d3208c108 None admin] PATH_INFO: `/v3/system/users/b5b0be47ff8b4207b06e612e972bddec/roles/09e9dee5b1e848eaba8cef2325325d08` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:29.977415 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1098be0-83ff-4b6e-ab0f-f42d3208c108 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=b5b0be47ff8b4207b06e612e972bddec, role_id=09e9dee5b1e848eaba8cef2325325d08)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:29.979102 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1098be0-83ff-4b6e-ab0f-f42d3208c108 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:29.989987 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 158/334] 10.222.0.70 () {58 vars in 1334 bytes} [Mon Jul 11 14:26:29 2022] PUT /identity/v3/system/users/b5b0be47ff8b4207b06e612e972bddec/roles/09e9dee5b1e848eaba8cef2325325d08 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:26:31.316749 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563778de-7072-4ddd-a719-ea91d2a8b9bf None None] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:31.317542 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563778de-7072-4ddd-a719-ea91d2a8b9bf None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:31.317542 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563778de-7072-4ddd-a719-ea91d2a8b9bf None None] PATH_INFO: `/` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:31.318760 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 177/335] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:26:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:26:31.324566 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49726cf2-e00b-4cb7-b39f-a1779047e189 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:31.325296 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49726cf2-e00b-4cb7-b39f-a1779047e189 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:31.325296 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49726cf2-e00b-4cb7-b39f-a1779047e189 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:31.359956 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-49726cf2-e00b-4cb7-b39f-a1779047e189 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:26:31.361899 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-49726cf2-e00b-4cb7-b39f-a1779047e189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:26:31.466596 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 159/336] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:26:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:26:31.508706 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563778de-7072-4ddd-a719-ea91d2a8b9bf None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:31.667599 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563778de-7072-4ddd-a719-ea91d2a8b9bf None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:31.719000 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d577bfb-d845-46cb-960e-2047de32686a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:31.719814 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d577bfb-d845-46cb-960e-2047de32686a None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:31.720093 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d577bfb-d845-46cb-960e-2047de32686a None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:31.720399 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d577bfb-d845-46cb-960e-2047de32686a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:31.734576 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f303a6-b99e-49fc-9e2c-988534bb0a5e None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:31.734962 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f303a6-b99e-49fc-9e2c-988534bb0a5e None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:31.735195 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f303a6-b99e-49fc-9e2c-988534bb0a5e None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:31.736563 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d577bfb-d845-46cb-960e-2047de32686a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:26:31.736865 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 160/337] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:26:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 14:26:31.745597 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application [None req-0d577bfb-d845-46cb-960e-2047de32686a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 14:26:31.745597 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:31.745597 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:26:31.745597 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:26:31.745597 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:26:31.745597 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:26:31.745597 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:26:31.745597 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:26:31.745597 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:26:31.745597 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:26:31.745597 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:26:31.745597 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:26:31.745597 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:26:31.745597 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:26:31.745597 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:26:31.745597 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:26:31.747209 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:26:31.747209 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:26:31.747209 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:26:31.747209 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:26:31.747209 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:26:31.747209 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:26:31.747209 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:26:31.747209 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:26:31.747209 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:26:31.747209 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:26:31.747209 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:26:31.747209 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application with Lock( Jul 11 14:26:31.747209 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:26:31.747209 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:26:31.747209 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:26:31.747209 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:26:31.749929 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:26:31.749929 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:26:31.749929 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:26:31.749929 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:26:31.749929 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:26:31.749929 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:26:31.749929 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:26:31.749929 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:26:31.749929 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:26:31.749929 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:26:31.749929 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 14:26:31.749929 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Jul 11 14:26:31.749929 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 178/338] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Jul 11 14:26:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:26:31.757511 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f303a6-b99e-49fc-9e2c-988534bb0a5e None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:31.758863 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1010b709-3546-4084-9abc-f05580cef963 None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:31.759136 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1010b709-3546-4084-9abc-f05580cef963 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:31.759415 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1010b709-3546-4084-9abc-f05580cef963 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:31.780612 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:31.790790 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-1010b709-3546-4084-9abc-f05580cef963 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:26:31.792004 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-1010b709-3546-4084-9abc-f05580cef963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:26:31.922440 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 179/339] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:26:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 14:26:31.945528 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:31.993996 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f303a6-b99e-49fc-9e2c-988534bb0a5e None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:32.005252 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1010b709-3546-4084-9abc-f05580cef963 None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:32.043956 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c716fe53-b5b4-4ca5-9382-825a52c150dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:32.044670 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c716fe53-b5b4-4ca5-9382-825a52c150dd None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:32.044957 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c716fe53-b5b4-4ca5-9382-825a52c150dd None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:32.045235 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c716fe53-b5b4-4ca5-9382-825a52c150dd None admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:32.046001 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c716fe53-b5b4-4ca5-9382-825a52c150dd None admin] RBAC: Adding query filter params (name=member) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:32.046308 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c716fe53-b5b4-4ca5-9382-825a52c150dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:32.047707 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c716fe53-b5b4-4ca5-9382-825a52c150dd None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:32.064379 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 161/340] 10.222.0.70 () {56 vars in 1101 bytes} [Mon Jul 11 14:26:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:32.072380 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c716fe53-b5b4-4ca5-9382-825a52c150dd None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:32.200190 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1010b709-3546-4084-9abc-f05580cef963 None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:32.322837 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e53bf52-49da-4137-9fbc-6bfe0610d5dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:32.324299 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e53bf52-49da-4137-9fbc-6bfe0610d5dc None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:32.325056 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e53bf52-49da-4137-9fbc-6bfe0610d5dc None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:32.325748 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e53bf52-49da-4137-9fbc-6bfe0610d5dc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:32.327255 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c716fe53-b5b4-4ca5-9382-825a52c150dd None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:32.329526 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:32.360910 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e53bf52-49da-4137-9fbc-6bfe0610d5dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:26:32.376385 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:32.384750 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application [None req-4e53bf52-49da-4137-9fbc-6bfe0610d5dc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 14:26:32.384750 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:32.384750 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:26:32.384750 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:26:32.384750 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:26:32.384750 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:26:32.384750 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:26:32.384750 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:26:32.384750 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:26:32.384750 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:26:32.384750 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:26:32.384750 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:26:32.384750 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:26:32.384750 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:26:32.384750 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:26:32.384750 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:26:32.386764 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:26:32.386764 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:26:32.386764 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:26:32.386764 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:26:32.386764 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:26:32.386764 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:26:32.386764 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:26:32.386764 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:26:32.386764 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:26:32.386764 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:26:32.386764 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:26:32.386764 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application with Lock( Jul 11 14:26:32.386764 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:26:32.386764 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:26:32.386764 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:26:32.386764 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:26:32.392035 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:26:32.392035 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:26:32.392035 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:26:32.392035 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:26:32.392035 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:26:32.392035 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:26:32.392035 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:26:32.392035 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:26:32.392035 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:26:32.392035 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:26:32.392035 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 14:26:32.392035 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Jul 11 14:26:32.393431 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab86f09-0bd0-493d-807c-d3a284d5a61f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:32.393431 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab86f09-0bd0-493d-807c-d3a284d5a61f None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:32.393431 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab86f09-0bd0-493d-807c-d3a284d5a61f None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:32.393431 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab86f09-0bd0-493d-807c-d3a284d5a61f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:32.397169 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 180/341] 10.222.0.70 () {56 vars in 1114 bytes} [Mon Jul 11 14:26:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 392 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:26:32.408628 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e53bf52-49da-4137-9fbc-6bfe0610d5dc None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:32.506543 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab86f09-0bd0-493d-807c-d3a284d5a61f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:32.507920 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab86f09-0bd0-493d-807c-d3a284d5a61f None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:32.666355 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e53bf52-49da-4137-9fbc-6bfe0610d5dc None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:32.738173 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7888ea8e-3128-4fe1-9f48-f43b6961a8a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:32.740959 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7888ea8e-3128-4fe1-9f48-f43b6961a8a3 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:32.741908 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7888ea8e-3128-4fe1-9f48-f43b6961a8a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:32.742610 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7888ea8e-3128-4fe1-9f48-f43b6961a8a3 None admin] PATH_INFO: `/v3/roles` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:32.744116 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7888ea8e-3128-4fe1-9f48-f43b6961a8a3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:32.744847 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7888ea8e-3128-4fe1-9f48-f43b6961a8a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:32.747717 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7888ea8e-3128-4fe1-9f48-f43b6961a8a3 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:32.765470 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 181/343] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Jul 11 14:26:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:26:32.765724 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 162/343] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Jul 11 14:26:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 693 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 11 14:26:32.769303 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f0cd13-d3c4-41dc-9b15-71c0aac3b543 None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:32.769303 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f0cd13-d3c4-41dc-9b15-71c0aac3b543 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:32.769303 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f0cd13-d3c4-41dc-9b15-71c0aac3b543 None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:32.771416 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7888ea8e-3128-4fe1-9f48-f43b6961a8a3 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:32.779773 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 163/344] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:26:32 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:26:32.789582 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c41665e-8e51-4128-9850-7fb5e6185950 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:32.790255 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c41665e-8e51-4128-9850-7fb5e6185950 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:32.790874 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c41665e-8e51-4128-9850-7fb5e6185950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:32.841700 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-1c41665e-8e51-4128-9850-7fb5e6185950 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:26:32.842763 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-1c41665e-8e51-4128-9850-7fb5e6185950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:26:32.895786 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:32.915249 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:32.990426 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7888ea8e-3128-4fe1-9f48-f43b6961a8a3 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:33.003267 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 164/345] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:26:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:26:33.004162 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c41665e-8e51-4128-9850-7fb5e6185950 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:33.030552 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21050a83-9d99-4e26-842b-7534413ad935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:33.031327 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21050a83-9d99-4e26-842b-7534413ad935 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:33.031608 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21050a83-9d99-4e26-842b-7534413ad935 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:33.031876 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21050a83-9d99-4e26-842b-7534413ad935 None admin] PATH_INFO: `/v3/projects/02bf3f49198a4e809a9a6d408d01baa9` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:33.033771 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21050a83-9d99-4e26-842b-7534413ad935 None admin] RBAC: Authorizing `identity:get_project(project_id=02bf3f49198a4e809a9a6d408d01baa9)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:33.035333 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21050a83-9d99-4e26-842b-7534413ad935 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:33.038400 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 182/346] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Jul 11 14:26:32 2022] GET /identity/v3/projects/02bf3f49198a4e809a9a6d408d01baa9 => generated 298 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:33.043949 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21050a83-9d99-4e26-842b-7534413ad935 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:33.189097 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c41665e-8e51-4128-9850-7fb5e6185950 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:33.206385 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21050a83-9d99-4e26-842b-7534413ad935 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:33.231729 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e74c476-91a1-426c-a95f-c63a158d1c31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:33.232437 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e74c476-91a1-426c-a95f-c63a158d1c31 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:33.232717 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e74c476-91a1-426c-a95f-c63a158d1c31 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:33.232994 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e74c476-91a1-426c-a95f-c63a158d1c31 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:33.276848 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:33.284872 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:33.311006 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7332df-0851-4381-ba09-39502ff12143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:33.312594 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7332df-0851-4381-ba09-39502ff12143 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:33.313106 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7332df-0851-4381-ba09-39502ff12143 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:33.313609 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7332df-0851-4381-ba09-39502ff12143 None admin] PATH_INFO: `/v3/groups/f7a013e97dd848a98ff628c919d30efd` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:33.336258 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e74c476-91a1-426c-a95f-c63a158d1c31 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:33.337703 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e74c476-91a1-426c-a95f-c63a158d1c31 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:33.343482 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7332df-0851-4381-ba09-39502ff12143 None admin] RBAC: Authorizing `identity:get_group(group_id=f7a013e97dd848a98ff628c919d30efd)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:33.346336 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7332df-0851-4381-ba09-39502ff12143 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:33.350092 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 183/347] 10.222.0.70 () {56 vars in 1180 bytes} [Mon Jul 11 14:26:33 2022] GET /identity/v3/groups/f7a013e97dd848a98ff628c919d30efd => generated 226 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:33.357842 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7332df-0851-4381-ba09-39502ff12143 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:33.525997 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 165/348] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Jul 11 14:26:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 522 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 14:26:33.526991 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e74c476-91a1-426c-a95f-c63a158d1c31 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:33.608748 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:33.675718 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7332df-0851-4381-ba09-39502ff12143 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:33.678392 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e74c476-91a1-426c-a95f-c63a158d1c31 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:33.729353 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c968732a-f34b-4372-a612-29abe75e4892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:33.730032 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c968732a-f34b-4372-a612-29abe75e4892 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:33.730309 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c968732a-f34b-4372-a612-29abe75e4892 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:33.730585 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c968732a-f34b-4372-a612-29abe75e4892 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:33.731425 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c968732a-f34b-4372-a612-29abe75e4892 None admin] RBAC: Adding query filter params (group.id=f7a013e97dd848a98ff628c919d30efd, role.id=8eff41f243c843ed95505a488ca6eada, scope.project.id=02bf3f49198a4e809a9a6d408d01baa9) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:33.731739 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c968732a-f34b-4372-a612-29abe75e4892 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:33.733222 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c968732a-f34b-4372-a612-29abe75e4892 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:33.741620 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 166/349] 10.222.0.70 () {56 vars in 1376 bytes} [Mon Jul 11 14:26:33 2022] GET /identity/v3/role_assignments?group.id=f7a013e97dd848a98ff628c919d30efd&scope.project.id=02bf3f49198a4e809a9a6d408d01baa9&role.id=8eff41f243c843ed95505a488ca6eada => generated 260 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:33.742507 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c968732a-f34b-4372-a612-29abe75e4892 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:33.826488 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5210ce55-336b-4bc6-8047-a5b4639b137c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:33.827905 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5210ce55-336b-4bc6-8047-a5b4639b137c None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:33.828348 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5210ce55-336b-4bc6-8047-a5b4639b137c None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:33.828837 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5210ce55-336b-4bc6-8047-a5b4639b137c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:33.854045 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5210ce55-336b-4bc6-8047-a5b4639b137c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:26:33.878445 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application [None req-5210ce55-336b-4bc6-8047-a5b4639b137c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 14:26:33.878445 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:33.878445 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:26:33.878445 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:26:33.878445 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:26:33.878445 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:26:33.878445 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:26:33.878445 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:26:33.878445 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:26:33.878445 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:26:33.878445 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:26:33.878445 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:26:33.878445 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:26:33.878445 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:26:33.878445 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:26:33.878445 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:26:33.880905 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:26:33.880905 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:26:33.880905 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:26:33.880905 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:26:33.880905 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:26:33.880905 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:26:33.880905 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:26:33.880905 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:26:33.880905 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:26:33.880905 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:26:33.880905 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:26:33.880905 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application with Lock( Jul 11 14:26:33.880905 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:26:33.880905 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:26:33.880905 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:26:33.880905 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:26:33.883389 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:26:33.883389 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:26:33.883389 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:26:33.883389 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:26:33.883389 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:26:33.883389 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:26:33.883389 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:26:33.883389 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:26:33.883389 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:26:33.883389 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:26:33.883389 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 14:26:33.883389 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Jul 11 14:26:33.891774 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 184/350] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Jul 11 14:26:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 541 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:26:33.900760 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5210ce55-336b-4bc6-8047-a5b4639b137c None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:33.967938 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c968732a-f34b-4372-a612-29abe75e4892 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:34.004521 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:34.034237 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d348a0d1-b6c0-4bc1-98da-69a6699e7725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:34.035080 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d348a0d1-b6c0-4bc1-98da-69a6699e7725 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:34.035370 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d348a0d1-b6c0-4bc1-98da-69a6699e7725 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:34.035648 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d348a0d1-b6c0-4bc1-98da-69a6699e7725 None admin] PATH_INFO: `/v3/projects/02bf3f49198a4e809a9a6d408d01baa9` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:34.037721 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d348a0d1-b6c0-4bc1-98da-69a6699e7725 None admin] RBAC: Authorizing `identity:get_project(project_id=02bf3f49198a4e809a9a6d408d01baa9)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:34.039031 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d348a0d1-b6c0-4bc1-98da-69a6699e7725 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:34.044638 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 167/351] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Jul 11 14:26:33 2022] GET /identity/v3/projects/02bf3f49198a4e809a9a6d408d01baa9 => generated 298 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:34.053139 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d348a0d1-b6c0-4bc1-98da-69a6699e7725 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:34.063886 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:34.227367 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5210ce55-336b-4bc6-8047-a5b4639b137c None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:34.294186 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b597ac5e-4569-461f-83af-76fc0190b81d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:34.295266 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b597ac5e-4569-461f-83af-76fc0190b81d None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:34.295786 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b597ac5e-4569-461f-83af-76fc0190b81d None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:34.296235 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b597ac5e-4569-461f-83af-76fc0190b81d None admin] PATH_INFO: `/v3/roles` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:34.297608 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b597ac5e-4569-461f-83af-76fc0190b81d None admin] RBAC: Adding query filter params (name=member) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:34.298127 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b597ac5e-4569-461f-83af-76fc0190b81d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:34.300655 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b597ac5e-4569-461f-83af-76fc0190b81d None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:34.315722 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 185/352] 10.222.0.70 () {56 vars in 1101 bytes} [Mon Jul 11 14:26:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 416 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:34.318768 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8482fc6-b80a-4d14-b596-f646bf1324a5 None None] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:34.319643 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8482fc6-b80a-4d14-b596-f646bf1324a5 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:34.319643 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8482fc6-b80a-4d14-b596-f646bf1324a5 None None] PATH_INFO: `/` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:34.322941 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d348a0d1-b6c0-4bc1-98da-69a6699e7725 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:34.330174 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 186/353] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:26:34 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:26:34.331529 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8482fc6-b80a-4d14-b596-f646bf1324a5 None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:34.397723 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee14a16-10eb-4f8b-8b03-1000c11e97ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:34.399135 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee14a16-10eb-4f8b-8b03-1000c11e97ed None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:34.399616 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee14a16-10eb-4f8b-8b03-1000c11e97ed None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:34.400124 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee14a16-10eb-4f8b-8b03-1000c11e97ed None admin] PATH_INFO: `/v3/groups/f7a013e97dd848a98ff628c919d30efd` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:34.402343 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee14a16-10eb-4f8b-8b03-1000c11e97ed None admin] RBAC: Authorizing `identity:get_group(group_id=f7a013e97dd848a98ff628c919d30efd)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:34.405314 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee14a16-10eb-4f8b-8b03-1000c11e97ed None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:34.408891 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 168/354] 10.222.0.70 () {56 vars in 1180 bytes} [Mon Jul 11 14:26:34 2022] GET /identity/v3/groups/f7a013e97dd848a98ff628c919d30efd => generated 226 bytes in 357 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:34.411164 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddd8102-0ac3-4d40-a0c8-7e57490d2551 None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:34.413158 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddd8102-0ac3-4d40-a0c8-7e57490d2551 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:34.413920 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddd8102-0ac3-4d40-a0c8-7e57490d2551 None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:34.416613 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 169/355] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:26:34 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:26:34.418891 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c72e35-b67b-4c23-9090-e936d2bd9096 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:34.419592 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c72e35-b67b-4c23-9090-e936d2bd9096 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:34.420310 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c72e35-b67b-4c23-9090-e936d2bd9096 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:34.440664 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-b6c72e35-b67b-4c23-9090-e936d2bd9096 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:26:34.441898 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-b6c72e35-b67b-4c23-9090-e936d2bd9096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:26:34.520633 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8482fc6-b80a-4d14-b596-f646bf1324a5 None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:34.535365 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:34.537576 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:34.563252 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 170/356] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:26:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:26:34.564154 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c72e35-b67b-4c23-9090-e936d2bd9096 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:34.579208 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57194984-1002-45a4-8bd9-cbef4141ef00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:34.580391 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57194984-1002-45a4-8bd9-cbef4141ef00 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:34.580901 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57194984-1002-45a4-8bd9-cbef4141ef00 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:34.581404 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57194984-1002-45a4-8bd9-cbef4141ef00 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:34.681919 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57194984-1002-45a4-8bd9-cbef4141ef00 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:34.683696 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57194984-1002-45a4-8bd9-cbef4141ef00 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:34.731827 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c72e35-b67b-4c23-9090-e936d2bd9096 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:34.782322 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70632129-f3e1-49d4-8d3e-f44077ae0019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:34.782897 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70632129-f3e1-49d4-8d3e-f44077ae0019 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:34.783190 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70632129-f3e1-49d4-8d3e-f44077ae0019 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:34.783456 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70632129-f3e1-49d4-8d3e-f44077ae0019 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:34.784349 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70632129-f3e1-49d4-8d3e-f44077ae0019 None admin] RBAC: Adding query filter params (group.id=f7a013e97dd848a98ff628c919d30efd, role.id=7d8b0827910944f29bfa3a92d6cb7c92, scope.project.id=02bf3f49198a4e809a9a6d408d01baa9) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:34.784664 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70632129-f3e1-49d4-8d3e-f44077ae0019 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:34.786804 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70632129-f3e1-49d4-8d3e-f44077ae0019 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:34.795662 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 171/357] 10.222.0.70 () {56 vars in 1376 bytes} [Mon Jul 11 14:26:34 2022] GET /identity/v3/role_assignments?group.id=f7a013e97dd848a98ff628c919d30efd&scope.project.id=02bf3f49198a4e809a9a6d408d01baa9&role.id=7d8b0827910944f29bfa3a92d6cb7c92 => generated 260 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:34.797188 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c83152-3de9-4cec-91aa-91114f3924a8 None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:34.797477 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c83152-3de9-4cec-91aa-91114f3924a8 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:34.797877 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c83152-3de9-4cec-91aa-91114f3924a8 None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:34.800370 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 172/358] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:26:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:26:34.801436 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa90db8-1afa-4fcb-929d-c5aa83203aa0 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:34.801717 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa90db8-1afa-4fcb-929d-c5aa83203aa0 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:34.803132 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa90db8-1afa-4fcb-929d-c5aa83203aa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:34.827870 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-7fa90db8-1afa-4fcb-929d-c5aa83203aa0 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:26:34.829226 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-7fa90db8-1afa-4fcb-929d-c5aa83203aa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:26:34.857092 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 187/359] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Jul 11 14:26:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 526 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 14:26:34.857718 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57194984-1002-45a4-8bd9-cbef4141ef00 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:34.877017 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:34.929270 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:34.960920 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 173/360] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:26:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:26:34.962680 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ffdefa-4cf0-438c-805a-66d10575f9da None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:34.963379 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ffdefa-4cf0-438c-805a-66d10575f9da None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:34.963871 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ffdefa-4cf0-438c-805a-66d10575f9da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:35.005585 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-79ffdefa-4cf0-438c-805a-66d10575f9da None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:26:35.006852 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-79ffdefa-4cf0-438c-805a-66d10575f9da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:26:35.034925 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57194984-1002-45a4-8bd9-cbef4141ef00 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:35.083719 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c45de1-c2ee-43d3-926a-1bfc16e2f49d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:35.084567 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c45de1-c2ee-43d3-926a-1bfc16e2f49d None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:35.084848 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c45de1-c2ee-43d3-926a-1bfc16e2f49d None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:35.085108 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c45de1-c2ee-43d3-926a-1bfc16e2f49d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:35.099710 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c45de1-c2ee-43d3-926a-1bfc16e2f49d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:26:35.111813 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application [None req-d4c45de1-c2ee-43d3-926a-1bfc16e2f49d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 14:26:35.111813 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:35.111813 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:26:35.111813 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:26:35.111813 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:26:35.111813 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:26:35.111813 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:26:35.111813 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:26:35.111813 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:26:35.111813 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:26:35.111813 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:26:35.111813 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:26:35.111813 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:26:35.111813 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:26:35.111813 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:26:35.111813 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:26:35.112923 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:26:35.112923 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:26:35.112923 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:26:35.112923 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:26:35.112923 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:26:35.112923 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:26:35.112923 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:26:35.112923 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:26:35.112923 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:26:35.112923 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:26:35.112923 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:26:35.112923 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application with Lock( Jul 11 14:26:35.112923 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:26:35.112923 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:26:35.112923 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:26:35.112923 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:26:35.113915 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:26:35.113915 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:26:35.113915 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:26:35.113915 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:26:35.113915 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:26:35.113915 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:26:35.113915 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:26:35.113915 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:26:35.113915 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:26:35.113915 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:26:35.113915 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 14:26:35.113915 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Jul 11 14:26:35.122654 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 188/361] 10.222.0.70 () {56 vars in 1114 bytes} [Mon Jul 11 14:26:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:26:35.123363 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c45de1-c2ee-43d3-926a-1bfc16e2f49d None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:35.157389 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 174/362] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:26:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:26:35.158702 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ffdefa-4cf0-438c-805a-66d10575f9da None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:35.243464 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:35.309720 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c45de1-c2ee-43d3-926a-1bfc16e2f49d None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:35.366399 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ffdefa-4cf0-438c-805a-66d10575f9da None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:35.370368 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c4e3f6-6f16-4d66-a166-564a6a116063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:35.371891 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c4e3f6-6f16-4d66-a166-564a6a116063 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:35.372384 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c4e3f6-6f16-4d66-a166-564a6a116063 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:35.373838 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c4e3f6-6f16-4d66-a166-564a6a116063 None admin] PATH_INFO: `/v3/projects/746cf064ee5344ddb5daa2377fd66d25` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:35.376026 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c4e3f6-6f16-4d66-a166-564a6a116063 None admin] RBAC: Authorizing `identity:get_project(project_id=746cf064ee5344ddb5daa2377fd66d25)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:35.378510 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c4e3f6-6f16-4d66-a166-564a6a116063 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:35.384410 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 189/363] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Jul 11 14:26:35 2022] GET /identity/v3/projects/746cf064ee5344ddb5daa2377fd66d25 => generated 302 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:35.386841 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c4e3f6-6f16-4d66-a166-564a6a116063 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:35.392678 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:35.432231 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6eec02-bb83-45c4-af3c-71f0c909bd7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:35.434373 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6eec02-bb83-45c4-af3c-71f0c909bd7c None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:35.434658 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6eec02-bb83-45c4-af3c-71f0c909bd7c None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:35.434929 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6eec02-bb83-45c4-af3c-71f0c909bd7c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:35.449441 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6eec02-bb83-45c4-af3c-71f0c909bd7c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:26:35.457899 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-5f6eec02-bb83-45c4-af3c-71f0c909bd7c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:26:35.457899 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:35.457899 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:26:35.457899 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:26:35.457899 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:26:35.457899 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:26:35.457899 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:26:35.457899 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:26:35.457899 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:26:35.457899 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:26:35.457899 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:26:35.457899 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:26:35.457899 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:26:35.457899 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:26:35.457899 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:26:35.457899 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:26:35.459439 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:26:35.459439 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:26:35.459439 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:26:35.459439 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:26:35.459439 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:26:35.459439 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:26:35.459439 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:26:35.459439 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:26:35.459439 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:26:35.459439 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:26:35.459439 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:26:35.459439 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( Jul 11 14:26:35.459439 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:26:35.459439 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:26:35.459439 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:26:35.459439 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:26:35.460290 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:26:35.460290 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:26:35.460290 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:26:35.460290 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:26:35.460290 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:26:35.460290 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:26:35.460290 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:26:35.460290 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:26:35.460290 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:26:35.460290 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:26:35.460290 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:26:35.460290 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Jul 11 14:26:35.460290 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 175/364] 10.222.0.70 () {56 vars in 1096 bytes} [Mon Jul 11 14:26:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:26:35.460951 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6eec02-bb83-45c4-af3c-71f0c909bd7c None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:35.536995 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c4e3f6-6f16-4d66-a166-564a6a116063 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:35.601581 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8be9e96-1cc2-4355-a373-fa4765b89d1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:35.602651 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8be9e96-1cc2-4355-a373-fa4765b89d1d None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:35.603142 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8be9e96-1cc2-4355-a373-fa4765b89d1d None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:35.603623 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8be9e96-1cc2-4355-a373-fa4765b89d1d None admin] PATH_INFO: `/v3/roles` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:35.604651 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8be9e96-1cc2-4355-a373-fa4765b89d1d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:35.605167 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8be9e96-1cc2-4355-a373-fa4765b89d1d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:35.606776 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8be9e96-1cc2-4355-a373-fa4765b89d1d None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:35.612788 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:35.618147 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6eec02-bb83-45c4-af3c-71f0c909bd7c None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:35.622499 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 190/365] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Jul 11 14:26:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:35.623593 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8be9e96-1cc2-4355-a373-fa4765b89d1d None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:35.684027 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce6510e-fd67-4a56-ab0b-5e8f622a8ec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:35.685308 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce6510e-fd67-4a56-ab0b-5e8f622a8ec3 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:35.685808 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce6510e-fd67-4a56-ab0b-5e8f622a8ec3 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:35.686418 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce6510e-fd67-4a56-ab0b-5e8f622a8ec3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:35.706873 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce6510e-fd67-4a56-ab0b-5e8f622a8ec3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:26:35.723441 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-dce6510e-fd67-4a56-ab0b-5e8f622a8ec3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 14:26:35.723441 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:35.723441 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:26:35.723441 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:26:35.723441 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:26:35.723441 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:26:35.723441 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:26:35.723441 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:26:35.723441 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:26:35.723441 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:26:35.723441 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:26:35.723441 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:26:35.723441 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:26:35.723441 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:26:35.723441 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:26:35.723441 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:26:35.725173 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:26:35.725173 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:26:35.725173 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:26:35.725173 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:26:35.725173 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:26:35.725173 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:26:35.725173 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:26:35.725173 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:26:35.725173 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:26:35.725173 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:26:35.725173 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:26:35.725173 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( Jul 11 14:26:35.725173 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:26:35.725173 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:26:35.725173 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:26:35.725173 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:26:35.725955 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:26:35.725955 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:26:35.725955 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:26:35.725955 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:26:35.725955 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:26:35.725955 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:26:35.725955 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:26:35.725955 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:26:35.725955 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:26:35.725955 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:26:35.725955 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 14:26:35.725955 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Jul 11 14:26:35.725955 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 176/366] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Jul 11 14:26:35 2022] GET /identity/v3/roles/reader => generated 84 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:26:35.728226 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce6510e-fd67-4a56-ab0b-5e8f622a8ec3 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:35.761668 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8be9e96-1cc2-4355-a373-fa4765b89d1d None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:35.794543 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:35.805150 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45389f06-a906-4f17-afb3-dc3a1ea275aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:35.806429 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45389f06-a906-4f17-afb3-dc3a1ea275aa None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:35.806955 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45389f06-a906-4f17-afb3-dc3a1ea275aa None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:35.807480 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45389f06-a906-4f17-afb3-dc3a1ea275aa None admin] PATH_INFO: `/v3/groups/f7a013e97dd848a98ff628c919d30efd` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:35.809256 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45389f06-a906-4f17-afb3-dc3a1ea275aa None admin] RBAC: Authorizing `identity:get_group(group_id=f7a013e97dd848a98ff628c919d30efd)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:35.810993 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45389f06-a906-4f17-afb3-dc3a1ea275aa None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:35.812914 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 191/367] 10.222.0.70 () {56 vars in 1180 bytes} [Mon Jul 11 14:26:35 2022] GET /identity/v3/groups/f7a013e97dd848a98ff628c919d30efd => generated 226 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:35.814126 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45389f06-a906-4f17-afb3-dc3a1ea275aa None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:35.894968 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:35.915099 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce6510e-fd67-4a56-ab0b-5e8f622a8ec3 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:35.939238 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45389f06-a906-4f17-afb3-dc3a1ea275aa None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:35.953051 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468f7a04-3701-45cf-aee5-3ab8e084ccec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:35.953735 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468f7a04-3701-45cf-aee5-3ab8e084ccec None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:35.954017 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468f7a04-3701-45cf-aee5-3ab8e084ccec None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:35.954294 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468f7a04-3701-45cf-aee5-3ab8e084ccec None admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:35.955047 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468f7a04-3701-45cf-aee5-3ab8e084ccec None admin] RBAC: Adding query filter params (name=admin) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:35.955360 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468f7a04-3701-45cf-aee5-3ab8e084ccec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:35.956971 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468f7a04-3701-45cf-aee5-3ab8e084ccec None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:35.967762 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 177/368] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Jul 11 14:26:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:35.968798 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468f7a04-3701-45cf-aee5-3ab8e084ccec None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:35.985250 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46586e40-ee02-4e3d-b22f-8211be38e728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:35.986300 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46586e40-ee02-4e3d-b22f-8211be38e728 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:35.986788 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46586e40-ee02-4e3d-b22f-8211be38e728 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:35.987292 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46586e40-ee02-4e3d-b22f-8211be38e728 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:36.070934 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46586e40-ee02-4e3d-b22f-8211be38e728 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:36.072847 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46586e40-ee02-4e3d-b22f-8211be38e728 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:36.082497 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:36.092476 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468f7a04-3701-45cf-aee5-3ab8e084ccec None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:36.133570 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c93a3d-70e5-4bc6-ba6e-33d5771c2d66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:36.134248 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c93a3d-70e5-4bc6-ba6e-33d5771c2d66 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:36.134530 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c93a3d-70e5-4bc6-ba6e-33d5771c2d66 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:36.134806 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c93a3d-70e5-4bc6-ba6e-33d5771c2d66 None admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:36.135565 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c93a3d-70e5-4bc6-ba6e-33d5771c2d66 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:36.135869 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c93a3d-70e5-4bc6-ba6e-33d5771c2d66 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:36.138285 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c93a3d-70e5-4bc6-ba6e-33d5771c2d66 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:36.148073 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 178/369] 10.222.0.70 () {56 vars in 1101 bytes} [Mon Jul 11 14:26:35 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:36.150374 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c93a3d-70e5-4bc6-ba6e-33d5771c2d66 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:36.156560 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:36.199239 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 192/370] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Jul 11 14:26:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 14:26:36.206427 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46586e40-ee02-4e3d-b22f-8211be38e728 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:36.279977 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c93a3d-70e5-4bc6-ba6e-33d5771c2d66 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:36.320642 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3fca84-efa2-4aef-abbd-0873de5092af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:36.321318 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3fca84-efa2-4aef-abbd-0873de5092af None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:36.321602 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3fca84-efa2-4aef-abbd-0873de5092af None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:36.321877 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3fca84-efa2-4aef-abbd-0873de5092af None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:36.322724 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3fca84-efa2-4aef-abbd-0873de5092af None admin] RBAC: Adding query filter params (group.id=f7a013e97dd848a98ff628c919d30efd, role.id=8eff41f243c843ed95505a488ca6eada, scope.project.id=746cf064ee5344ddb5daa2377fd66d25) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:36.323035 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3fca84-efa2-4aef-abbd-0873de5092af None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:36.324542 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3fca84-efa2-4aef-abbd-0873de5092af None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:36.338044 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 179/371] 10.222.0.70 () {56 vars in 1376 bytes} [Mon Jul 11 14:26:36 2022] GET /identity/v3/role_assignments?group.id=f7a013e97dd848a98ff628c919d30efd&scope.project.id=746cf064ee5344ddb5daa2377fd66d25&role.id=8eff41f243c843ed95505a488ca6eada => generated 260 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:36.338044 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3fca84-efa2-4aef-abbd-0873de5092af None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:36.354585 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46586e40-ee02-4e3d-b22f-8211be38e728 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:36.361295 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:36.437645 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f47fa1-3b77-4d81-90c6-681c66aa4bfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:36.438321 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f47fa1-3b77-4d81-90c6-681c66aa4bfe None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:36.438602 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f47fa1-3b77-4d81-90c6-681c66aa4bfe None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:36.438870 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f47fa1-3b77-4d81-90c6-681c66aa4bfe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:36.507772 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:36.539776 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3fca84-efa2-4aef-abbd-0873de5092af None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:36.572916 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f47fa1-3b77-4d81-90c6-681c66aa4bfe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:36.576368 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f47fa1-3b77-4d81-90c6-681c66aa4bfe None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:36.605886 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af4ab2f-51d2-4c06-b469-76bc54f217c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:36.607215 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af4ab2f-51d2-4c06-b469-76bc54f217c0 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:36.607596 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af4ab2f-51d2-4c06-b469-76bc54f217c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:36.607974 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af4ab2f-51d2-4c06-b469-76bc54f217c0 None admin] PATH_INFO: `/v3/users/b5b0be47ff8b4207b06e612e972bddec` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:36.610143 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af4ab2f-51d2-4c06-b469-76bc54f217c0 None admin] RBAC: Authorizing `identity:get_user(user_id=b5b0be47ff8b4207b06e612e972bddec)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:36.612268 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af4ab2f-51d2-4c06-b469-76bc54f217c0 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:36.615576 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 180/372] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Jul 11 14:26:36 2022] GET /identity/v3/users/b5b0be47ff8b4207b06e612e972bddec => generated 293 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:36.616798 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af4ab2f-51d2-4c06-b469-76bc54f217c0 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:36.727105 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 193/373] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Jul 11 14:26:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 527 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 14:26:36.728886 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fde4ed6-f856-4765-b2bd-c7c77c6ba89b None None] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:36.729391 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fde4ed6-f856-4765-b2bd-c7c77c6ba89b None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:36.729876 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fde4ed6-f856-4765-b2bd-c7c77c6ba89b None None] PATH_INFO: `/` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:36.731741 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 194/374] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:26:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:26:36.732732 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fde4ed6-f856-4765-b2bd-c7c77c6ba89b None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:36.735081 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:36.762515 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af4ab2f-51d2-4c06-b469-76bc54f217c0 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:36.825112 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c14de0-ad4d-4c11-b00b-5cd750190107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:36.827565 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c14de0-ad4d-4c11-b00b-5cd750190107 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:36.828612 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c14de0-ad4d-4c11-b00b-5cd750190107 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:36.829273 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c14de0-ad4d-4c11-b00b-5cd750190107 None admin] PATH_INFO: `/v3/projects/746cf064ee5344ddb5daa2377fd66d25` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:36.831843 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c14de0-ad4d-4c11-b00b-5cd750190107 None admin] RBAC: Authorizing `identity:get_project(project_id=746cf064ee5344ddb5daa2377fd66d25)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:36.832894 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:36.835885 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c14de0-ad4d-4c11-b00b-5cd750190107 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:36.839676 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 181/375] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Jul 11 14:26:36 2022] GET /identity/v3/projects/746cf064ee5344ddb5daa2377fd66d25 => generated 302 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:36.842230 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51021088-6e90-4768-bb0b-887a056e2c1f None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:36.842940 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51021088-6e90-4768-bb0b-887a056e2c1f None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:36.843544 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51021088-6e90-4768-bb0b-887a056e2c1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:36.885834 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-51021088-6e90-4768-bb0b-887a056e2c1f None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:26:36.889394 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-51021088-6e90-4768-bb0b-887a056e2c1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:26:36.895083 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fde4ed6-f856-4765-b2bd-c7c77c6ba89b None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:36.953578 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee740bb5-d31b-424c-b0a4-9f88677beb16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:36.955368 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee740bb5-d31b-424c-b0a4-9f88677beb16 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:36.956070 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee740bb5-d31b-424c-b0a4-9f88677beb16 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:36.956897 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee740bb5-d31b-424c-b0a4-9f88677beb16 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:36.959368 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee740bb5-d31b-424c-b0a4-9f88677beb16 None admin] RBAC: Adding query filter params (role.id=09e9dee5b1e848eaba8cef2325325d08, user.id=b5b0be47ff8b4207b06e612e972bddec, scope.system=all) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:36.960107 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee740bb5-d31b-424c-b0a4-9f88677beb16 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:36.962903 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee740bb5-d31b-424c-b0a4-9f88677beb16 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:36.989274 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 195/376] 10.222.0.70 () {56 vars in 1308 bytes} [Mon Jul 11 14:26:36 2022] GET /identity/v3/role_assignments?user.id=b5b0be47ff8b4207b06e612e972bddec&scope.system=all&role.id=09e9dee5b1e848eaba8cef2325325d08 => generated 510 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:37.000245 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee740bb5-d31b-424c-b0a4-9f88677beb16 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:37.027520 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 182/377] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:26:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:26:37.028445 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51021088-6e90-4768-bb0b-887a056e2c1f None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:37.240617 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:37.276186 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee740bb5-d31b-424c-b0a4-9f88677beb16 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:37.283843 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51021088-6e90-4768-bb0b-887a056e2c1f None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:37.307494 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:37.327046 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38977466-d530-4efa-bf02-d8c5124df359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:37.327929 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38977466-d530-4efa-bf02-d8c5124df359 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:37.328246 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38977466-d530-4efa-bf02-d8c5124df359 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:37.328516 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38977466-d530-4efa-bf02-d8c5124df359 None admin] PATH_INFO: `/v3/projects/3a62c198ecd94c498e9bd153b3d4226c` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:37.334174 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38977466-d530-4efa-bf02-d8c5124df359 None admin] RBAC: Authorizing `identity:get_project(project_id=3a62c198ecd94c498e9bd153b3d4226c)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:37.336056 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38977466-d530-4efa-bf02-d8c5124df359 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:37.338427 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 196/378] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Jul 11 14:26:36 2022] GET /identity/v3/projects/3a62c198ecd94c498e9bd153b3d4226c => generated 344 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:37.339471 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38977466-d530-4efa-bf02-d8c5124df359 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:37.363655 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9df894-1c83-46f7-b8f6-1744290d3852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:37.365515 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9df894-1c83-46f7-b8f6-1744290d3852 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:37.366136 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9df894-1c83-46f7-b8f6-1744290d3852 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:37.366778 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9df894-1c83-46f7-b8f6-1744290d3852 None admin] PATH_INFO: `/v3/groups/f7a013e97dd848a98ff628c919d30efd` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:37.369218 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9df894-1c83-46f7-b8f6-1744290d3852 None admin] RBAC: Authorizing `identity:get_group(group_id=f7a013e97dd848a98ff628c919d30efd)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:37.372017 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9df894-1c83-46f7-b8f6-1744290d3852 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:37.380463 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 183/379] 10.222.0.70 () {56 vars in 1180 bytes} [Mon Jul 11 14:26:37 2022] GET /identity/v3/groups/f7a013e97dd848a98ff628c919d30efd => generated 226 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:37.380463 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9df894-1c83-46f7-b8f6-1744290d3852 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:37.514246 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38977466-d530-4efa-bf02-d8c5124df359 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:37.570538 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9df894-1c83-46f7-b8f6-1744290d3852 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:37.599719 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdfcd3a-7310-4599-8354-5e9b1c84314f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:37.602197 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdfcd3a-7310-4599-8354-5e9b1c84314f None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:37.602197 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdfcd3a-7310-4599-8354-5e9b1c84314f None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:37.602539 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdfcd3a-7310-4599-8354-5e9b1c84314f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:37.622420 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdfcd3a-7310-4599-8354-5e9b1c84314f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:26:37.634158 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application [None req-9cdfcd3a-7310-4599-8354-5e9b1c84314f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 14:26:37.634158 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:37.634158 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:26:37.634158 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:26:37.634158 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:26:37.634158 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:26:37.634158 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:26:37.634158 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:26:37.634158 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:26:37.634158 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:26:37.634158 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:26:37.634158 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:26:37.634158 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:26:37.634158 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:26:37.634158 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:26:37.634158 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:26:37.635891 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:26:37.635891 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:26:37.635891 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:26:37.635891 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:26:37.635891 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:26:37.635891 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:26:37.635891 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:26:37.635891 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:26:37.635891 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:26:37.635891 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:26:37.635891 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:26:37.635891 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application with Lock( Jul 11 14:26:37.635891 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:26:37.635891 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:26:37.635891 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:26:37.635891 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:26:37.637662 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:26:37.637662 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:26:37.637662 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:26:37.637662 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:26:37.637662 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:26:37.637662 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:26:37.637662 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:26:37.637662 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:26:37.637662 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:26:37.637662 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:26:37.637662 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 14:26:37.637662 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Jul 11 14:26:37.638429 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9459af66-8ccf-4353-8556-b608153818b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:37.638429 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9459af66-8ccf-4353-8556-b608153818b6 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:37.638429 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9459af66-8ccf-4353-8556-b608153818b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:37.638429 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9459af66-8ccf-4353-8556-b608153818b6 None admin] PATH_INFO: `/v3/groups/151fdd7d8679421c811416d3a12ed8b7` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:37.640193 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 197/380] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Jul 11 14:26:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:26:37.641716 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdfcd3a-7310-4599-8354-5e9b1c84314f None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:37.648069 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9459af66-8ccf-4353-8556-b608153818b6 None admin] RBAC: Authorizing `identity:get_group(group_id=151fdd7d8679421c811416d3a12ed8b7)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:37.650802 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9459af66-8ccf-4353-8556-b608153818b6 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:37.652954 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 184/381] 10.222.0.70 () {56 vars in 1180 bytes} [Mon Jul 11 14:26:37 2022] GET /identity/v3/groups/151fdd7d8679421c811416d3a12ed8b7 => generated 229 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:37.654478 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fba8020-aa91-45ff-9181-8436acc0e538 None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:37.654771 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fba8020-aa91-45ff-9181-8436acc0e538 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:37.655684 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fba8020-aa91-45ff-9181-8436acc0e538 None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:37.657381 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 185/382] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:26:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:26:37.658604 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fba8020-aa91-45ff-9181-8436acc0e538 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:37.687795 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:37.749666 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:37.811500 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fba8020-aa91-45ff-9181-8436acc0e538 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:37.827202 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdfcd3a-7310-4599-8354-5e9b1c84314f None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:37.877204 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61b4a4b-7d27-413e-ae4c-a56209667df0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:37.878000 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61b4a4b-7d27-413e-ae4c-a56209667df0 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:37.878295 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61b4a4b-7d27-413e-ae4c-a56209667df0 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:37.878579 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61b4a4b-7d27-413e-ae4c-a56209667df0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:37.879484 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61b4a4b-7d27-413e-ae4c-a56209667df0 None admin] RBAC: Adding query filter params (group.id=f7a013e97dd848a98ff628c919d30efd, role.id=7d8b0827910944f29bfa3a92d6cb7c92, scope.project.id=746cf064ee5344ddb5daa2377fd66d25) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:37.879803 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61b4a4b-7d27-413e-ae4c-a56209667df0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:37.881642 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61b4a4b-7d27-413e-ae4c-a56209667df0 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:37.889698 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21bf7e4-da72-44c7-bb1e-7206f97c947a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:37.890886 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21bf7e4-da72-44c7-bb1e-7206f97c947a None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:37.891395 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21bf7e4-da72-44c7-bb1e-7206f97c947a None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:37.892108 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21bf7e4-da72-44c7-bb1e-7206f97c947a None admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:37.892313 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 198/383] 10.222.0.70 () {56 vars in 1376 bytes} [Mon Jul 11 14:26:37 2022] GET /identity/v3/role_assignments?group.id=f7a013e97dd848a98ff628c919d30efd&scope.project.id=746cf064ee5344ddb5daa2377fd66d25&role.id=7d8b0827910944f29bfa3a92d6cb7c92 => generated 260 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:37.893140 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61b4a4b-7d27-413e-ae4c-a56209667df0 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:37.894325 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21bf7e4-da72-44c7-bb1e-7206f97c947a None admin] RBAC: Adding query filter params (name=member) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:37.895101 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21bf7e4-da72-44c7-bb1e-7206f97c947a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:37.898561 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21bf7e4-da72-44c7-bb1e-7206f97c947a None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:37.916828 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 186/384] 10.222.0.70 () {56 vars in 1101 bytes} [Mon Jul 11 14:26:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:37.921360 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df24ec9-0dc3-40c8-aa56-aab5bd963d8d None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:37.922563 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df24ec9-0dc3-40c8-aa56-aab5bd963d8d None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:37.923545 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df24ec9-0dc3-40c8-aa56-aab5bd963d8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:37.957485 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-1df24ec9-0dc3-40c8-aa56-aab5bd963d8d None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:26:37.963931 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-1df24ec9-0dc3-40c8-aa56-aab5bd963d8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:26:38.068351 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61b4a4b-7d27-413e-ae4c-a56209667df0 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:38.082089 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 187/385] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:26:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:26:38.082739 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df24ec9-0dc3-40c8-aa56-aab5bd963d8d None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:38.105137 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:38.111246 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:38.128444 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ad3bc9-c9d0-47c0-aa04-73ef2ca0a57d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:38.129452 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ad3bc9-c9d0-47c0-aa04-73ef2ca0a57d None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:38.130566 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ad3bc9-c9d0-47c0-aa04-73ef2ca0a57d None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:38.130996 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ad3bc9-c9d0-47c0-aa04-73ef2ca0a57d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:38.132007 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ad3bc9-c9d0-47c0-aa04-73ef2ca0a57d None admin] RBAC: Adding query filter params (group.id=151fdd7d8679421c811416d3a12ed8b7, role.id=b46df176b0fe479da63c318db225bed4, scope.project.id=3a62c198ecd94c498e9bd153b3d4226c) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:38.132518 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ad3bc9-c9d0-47c0-aa04-73ef2ca0a57d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:38.133997 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ad3bc9-c9d0-47c0-aa04-73ef2ca0a57d None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:38.141705 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 199/386] 10.222.0.70 () {56 vars in 1376 bytes} [Mon Jul 11 14:26:37 2022] GET /identity/v3/role_assignments?group.id=151fdd7d8679421c811416d3a12ed8b7&scope.project.id=3a62c198ecd94c498e9bd153b3d4226c&role.id=b46df176b0fe479da63c318db225bed4 => generated 260 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:38.142365 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ad3bc9-c9d0-47c0-aa04-73ef2ca0a57d None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:38.277566 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df24ec9-0dc3-40c8-aa56-aab5bd963d8d None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:38.386134 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9260a9f0-8844-43cd-a1ab-55c12ff24293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:38.386945 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9260a9f0-8844-43cd-a1ab-55c12ff24293 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:38.387219 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9260a9f0-8844-43cd-a1ab-55c12ff24293 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:38.387498 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9260a9f0-8844-43cd-a1ab-55c12ff24293 None admin] PATH_INFO: `/v3/groups/f7a013e97dd848a98ff628c919d30efd` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:38.389139 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9260a9f0-8844-43cd-a1ab-55c12ff24293 None admin] RBAC: Authorizing `identity:get_group(group_id=f7a013e97dd848a98ff628c919d30efd)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:38.390643 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9260a9f0-8844-43cd-a1ab-55c12ff24293 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:38.393742 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 188/387] 10.222.0.70 () {56 vars in 1180 bytes} [Mon Jul 11 14:26:38 2022] GET /identity/v3/groups/f7a013e97dd848a98ff628c919d30efd => generated 226 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:38.400112 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9260a9f0-8844-43cd-a1ab-55c12ff24293 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:38.424158 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ad3bc9-c9d0-47c0-aa04-73ef2ca0a57d None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:38.490447 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a23090-d435-4f3c-8dbe-523c691ee58c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:38.492421 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a23090-d435-4f3c-8dbe-523c691ee58c None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:38.493249 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a23090-d435-4f3c-8dbe-523c691ee58c None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:38.494125 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a23090-d435-4f3c-8dbe-523c691ee58c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:38.516642 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a23090-d435-4f3c-8dbe-523c691ee58c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:26:38.534398 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application [None req-48a23090-d435-4f3c-8dbe-523c691ee58c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 14:26:38.534398 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:38.534398 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:26:38.534398 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:26:38.534398 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:26:38.534398 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:26:38.534398 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:26:38.534398 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:26:38.534398 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:26:38.534398 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:26:38.534398 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:26:38.534398 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:26:38.534398 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:26:38.534398 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:26:38.534398 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:26:38.534398 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:26:38.543990 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:26:38.543990 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:26:38.543990 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:26:38.543990 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:26:38.543990 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:26:38.543990 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:26:38.543990 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:26:38.543990 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:26:38.543990 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:26:38.543990 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:26:38.543990 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:26:38.543990 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application with Lock( Jul 11 14:26:38.543990 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:26:38.543990 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:26:38.543990 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:26:38.543990 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:26:38.545953 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:26:38.545953 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:26:38.545953 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:26:38.545953 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:26:38.545953 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:26:38.545953 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:26:38.545953 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:26:38.545953 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:26:38.545953 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:26:38.545953 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:26:38.545953 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 14:26:38.545953 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Jul 11 14:26:38.545953 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 200/388] 10.222.0.70 () {56 vars in 1114 bytes} [Mon Jul 11 14:26:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 396 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:26:38.545953 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a23090-d435-4f3c-8dbe-523c691ee58c None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:38.602617 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:38.662668 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:38.679200 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a23090-d435-4f3c-8dbe-523c691ee58c None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:38.721224 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7e2237-05a9-4b41-ad7e-3720d7ab3d01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:38.722139 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7e2237-05a9-4b41-ad7e-3720d7ab3d01 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:38.722435 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7e2237-05a9-4b41-ad7e-3720d7ab3d01 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:38.722712 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7e2237-05a9-4b41-ad7e-3720d7ab3d01 None admin] PATH_INFO: `/v3/roles` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:38.724070 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7e2237-05a9-4b41-ad7e-3720d7ab3d01 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:38.724430 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7e2237-05a9-4b41-ad7e-3720d7ab3d01 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:38.726481 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7e2237-05a9-4b41-ad7e-3720d7ab3d01 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:38.740782 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 201/389] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Jul 11 14:26:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:26:38.743192 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7e2237-05a9-4b41-ad7e-3720d7ab3d01 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:38.774261 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9260a9f0-8844-43cd-a1ab-55c12ff24293 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:38.865386 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7e2237-05a9-4b41-ad7e-3720d7ab3d01 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:38.868816 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:38.897008 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91b1ad3-19b6-4abf-932f-45086efbce66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:38.897915 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91b1ad3-19b6-4abf-932f-45086efbce66 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:38.898210 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91b1ad3-19b6-4abf-932f-45086efbce66 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:38.898473 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91b1ad3-19b6-4abf-932f-45086efbce66 None admin] PATH_INFO: `/v3/projects/02bf3f49198a4e809a9a6d408d01baa9` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:38.905113 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91b1ad3-19b6-4abf-932f-45086efbce66 None admin] RBAC: Authorizing `identity:get_project(project_id=02bf3f49198a4e809a9a6d408d01baa9)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:38.906616 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91b1ad3-19b6-4abf-932f-45086efbce66 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:38.907243 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2103df72-9f62-403c-b69a-819063d08e5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:38.908318 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2103df72-9f62-403c-b69a-819063d08e5d None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:38.908466 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 189/390] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Jul 11 14:26:38 2022] GET /identity/v3/projects/02bf3f49198a4e809a9a6d408d01baa9 => generated 298 bytes in 509 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:38.908905 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2103df72-9f62-403c-b69a-819063d08e5d None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:38.909329 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2103df72-9f62-403c-b69a-819063d08e5d None admin] PATH_INFO: `/v3/groups/f7a013e97dd848a98ff628c919d30efd` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:38.910839 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2103df72-9f62-403c-b69a-819063d08e5d None admin] RBAC: Authorizing `identity:get_group(group_id=f7a013e97dd848a98ff628c919d30efd)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:38.913121 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2103df72-9f62-403c-b69a-819063d08e5d None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:38.915336 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 202/391] 10.222.0.70 () {56 vars in 1180 bytes} [Mon Jul 11 14:26:38 2022] GET /identity/v3/groups/f7a013e97dd848a98ff628c919d30efd => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:38.919877 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91b1ad3-19b6-4abf-932f-45086efbce66 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:38.921199 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2103df72-9f62-403c-b69a-819063d08e5d None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:39.039562 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2103df72-9f62-403c-b69a-819063d08e5d None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:39.108339 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55e1a24-400f-4a10-b836-90301826429c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:39.109545 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55e1a24-400f-4a10-b836-90301826429c None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:39.110003 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55e1a24-400f-4a10-b836-90301826429c None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:39.110423 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55e1a24-400f-4a10-b836-90301826429c None admin] PATH_INFO: `/v3/projects/02bf3f49198a4e809a9a6d408d01baa9` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:39.111899 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55e1a24-400f-4a10-b836-90301826429c None admin] RBAC: Authorizing `identity:get_project(project_id=02bf3f49198a4e809a9a6d408d01baa9)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:39.113542 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55e1a24-400f-4a10-b836-90301826429c None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:39.116003 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 203/392] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Jul 11 14:26:38 2022] GET /identity/v3/projects/02bf3f49198a4e809a9a6d408d01baa9 => generated 298 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:39.126152 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91b1ad3-19b6-4abf-932f-45086efbce66 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:39.127360 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55e1a24-400f-4a10-b836-90301826429c None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:39.186043 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:39.189647 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6e70b8-2896-4e31-a681-d80f69d624c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:39.190572 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6e70b8-2896-4e31-a681-d80f69d624c7 None admin] REQUEST_METHOD: `PUT` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:39.190882 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6e70b8-2896-4e31-a681-d80f69d624c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:39.191186 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6e70b8-2896-4e31-a681-d80f69d624c7 None admin] PATH_INFO: `/v3/projects/02bf3f49198a4e809a9a6d408d01baa9/groups/f7a013e97dd848a98ff628c919d30efd/roles/8eff41f243c843ed95505a488ca6eada` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:39.197925 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6e70b8-2896-4e31-a681-d80f69d624c7 None admin] RBAC: Authorizing `identity:create_grant(project_id=02bf3f49198a4e809a9a6d408d01baa9, group_id=f7a013e97dd848a98ff628c919d30efd, role_id=8eff41f243c843ed95505a488ca6eada)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:39.199443 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6e70b8-2896-4e31-a681-d80f69d624c7 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:39.228700 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 190/393] 10.222.0.70 () {58 vars in 1442 bytes} [Mon Jul 11 14:26:38 2022] PUT /identity/v3/projects/02bf3f49198a4e809a9a6d408d01baa9/groups/f7a013e97dd848a98ff628c919d30efd/roles/8eff41f243c843ed95505a488ca6eada => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:26:39.258722 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55e1a24-400f-4a10-b836-90301826429c None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:39.303840 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfd1246-6e4e-49af-aedf-ff344898f1b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:39.305122 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfd1246-6e4e-49af-aedf-ff344898f1b0 None admin] REQUEST_METHOD: `PUT` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:39.305553 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfd1246-6e4e-49af-aedf-ff344898f1b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:39.305973 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfd1246-6e4e-49af-aedf-ff344898f1b0 None admin] PATH_INFO: `/v3/projects/02bf3f49198a4e809a9a6d408d01baa9/groups/f7a013e97dd848a98ff628c919d30efd/roles/7d8b0827910944f29bfa3a92d6cb7c92` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:39.306592 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356af96b-810f-4594-a2fa-73a4d94544d1 None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:39.307161 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356af96b-810f-4594-a2fa-73a4d94544d1 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:39.307730 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356af96b-810f-4594-a2fa-73a4d94544d1 None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:39.309362 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfd1246-6e4e-49af-aedf-ff344898f1b0 None admin] RBAC: Authorizing `identity:create_grant(project_id=02bf3f49198a4e809a9a6d408d01baa9, group_id=f7a013e97dd848a98ff628c919d30efd, role_id=7d8b0827910944f29bfa3a92d6cb7c92)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:39.310148 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 191/394] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:26:39 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:26:39.311262 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfd1246-6e4e-49af-aedf-ff344898f1b0 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:39.324230 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc26c82-cf5a-4a89-91bc-19d5d351101b None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:39.324230 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc26c82-cf5a-4a89-91bc-19d5d351101b None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:39.324230 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc26c82-cf5a-4a89-91bc-19d5d351101b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:39.336081 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 204/395] 10.222.0.70 () {58 vars in 1442 bytes} [Mon Jul 11 14:26:39 2022] PUT /identity/v3/projects/02bf3f49198a4e809a9a6d408d01baa9/groups/f7a013e97dd848a98ff628c919d30efd/roles/7d8b0827910944f29bfa3a92d6cb7c92 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:26:39.347570 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:39.363903 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-edc26c82-cf5a-4a89-91bc-19d5d351101b None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:26:39.367808 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-edc26c82-cf5a-4a89-91bc-19d5d351101b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:26:39.512981 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 192/396] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:26:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:26:39.547689 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfd1246-6e4e-49af-aedf-ff344898f1b0 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:39.741646 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:39.748710 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfd1246-6e4e-49af-aedf-ff344898f1b0 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:39.818880 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b655efb6-0ce8-4289-871d-639d9b7f8fd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:39.820155 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b655efb6-0ce8-4289-871d-639d9b7f8fd7 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:39.820687 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b655efb6-0ce8-4289-871d-639d9b7f8fd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:39.821174 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b655efb6-0ce8-4289-871d-639d9b7f8fd7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:39.839496 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b655efb6-0ce8-4289-871d-639d9b7f8fd7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:26:39.847772 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application [None req-b655efb6-0ce8-4289-871d-639d9b7f8fd7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 14:26:39.847772 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:39.847772 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:26:39.847772 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:26:39.847772 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:26:39.847772 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:26:39.847772 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:26:39.847772 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:26:39.847772 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:26:39.847772 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:26:39.847772 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:26:39.847772 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:26:39.847772 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:26:39.847772 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:26:39.847772 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:26:39.847772 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:26:39.849438 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:26:39.849438 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:26:39.849438 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:26:39.849438 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:26:39.849438 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:26:39.849438 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:26:39.849438 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:26:39.849438 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:26:39.849438 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:26:39.849438 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:26:39.849438 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:26:39.849438 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application with Lock( Jul 11 14:26:39.849438 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:26:39.849438 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:26:39.849438 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:26:39.849438 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:26:39.850275 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:26:39.850275 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:26:39.850275 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:26:39.850275 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:26:39.850275 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:26:39.850275 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:26:39.850275 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:26:39.850275 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:26:39.850275 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:26:39.850275 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:26:39.850275 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 14:26:39.850275 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Jul 11 14:26:39.852812 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 205/397] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Jul 11 14:26:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:26:39.858440 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc26c82-cf5a-4a89-91bc-19d5d351101b None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:40.028919 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc26c82-cf5a-4a89-91bc-19d5d351101b None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:40.090290 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b095a37-bffc-4037-99b4-e8321d186428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:40.090932 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b095a37-bffc-4037-99b4-e8321d186428 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:40.091220 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b095a37-bffc-4037-99b4-e8321d186428 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:40.091502 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b095a37-bffc-4037-99b4-e8321d186428 None admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:40.092328 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b095a37-bffc-4037-99b4-e8321d186428 None admin] RBAC: Adding query filter params (name=member) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:40.092666 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b095a37-bffc-4037-99b4-e8321d186428 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:40.094087 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b095a37-bffc-4037-99b4-e8321d186428 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:40.101677 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:40.110311 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 193/398] 10.222.0.70 () {56 vars in 1101 bytes} [Mon Jul 11 14:26:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:40.115712 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b655efb6-0ce8-4289-871d-639d9b7f8fd7 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:40.321996 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b655efb6-0ce8-4289-871d-639d9b7f8fd7 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:40.386345 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0590319-b1a8-4fcf-834c-55ab78bf0c68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:40.387706 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0590319-b1a8-4fcf-834c-55ab78bf0c68 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:40.388234 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0590319-b1a8-4fcf-834c-55ab78bf0c68 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:40.388742 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0590319-b1a8-4fcf-834c-55ab78bf0c68 None admin] PATH_INFO: `/v3/groups/f7a013e97dd848a98ff628c919d30efd` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:40.390953 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0590319-b1a8-4fcf-834c-55ab78bf0c68 None admin] RBAC: Authorizing `identity:get_group(group_id=f7a013e97dd848a98ff628c919d30efd)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:40.393876 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0590319-b1a8-4fcf-834c-55ab78bf0c68 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:40.397736 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 206/399] 10.222.0.70 () {56 vars in 1180 bytes} [Mon Jul 11 14:26:40 2022] GET /identity/v3/groups/f7a013e97dd848a98ff628c919d30efd => generated 226 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:26:40.405681 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b095a37-bffc-4037-99b4-e8321d186428 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:40.594862 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b095a37-bffc-4037-99b4-e8321d186428 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:40.653585 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb53da08-8b68-46c4-ae13-529513cc7afa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:40.654496 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb53da08-8b68-46c4-ae13-529513cc7afa None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:40.654784 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb53da08-8b68-46c4-ae13-529513cc7afa None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:40.655066 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb53da08-8b68-46c4-ae13-529513cc7afa None admin] PATH_INFO: `/v3/projects/746cf064ee5344ddb5daa2377fd66d25` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:40.656538 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb53da08-8b68-46c4-ae13-529513cc7afa None admin] RBAC: Authorizing `identity:get_project(project_id=746cf064ee5344ddb5daa2377fd66d25)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:40.658186 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb53da08-8b68-46c4-ae13-529513cc7afa None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:40.660457 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 194/400] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Jul 11 14:26:40 2022] GET /identity/v3/projects/746cf064ee5344ddb5daa2377fd66d25 => generated 302 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:40.666707 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0590319-b1a8-4fcf-834c-55ab78bf0c68 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:40.745120 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:40.916186 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0590319-b1a8-4fcf-834c-55ab78bf0c68 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:40.953613 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687b59a7-3ac5-4668-b150-e0d68aa83a11 None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:40.954125 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687b59a7-3ac5-4668-b150-e0d68aa83a11 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:40.954581 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687b59a7-3ac5-4668-b150-e0d68aa83a11 None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:40.958971 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 195/401] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:26:40 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:26:40.966110 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61475c6c-f8ca-4473-be1a-e1a124404f05 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:40.966609 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61475c6c-f8ca-4473-be1a-e1a124404f05 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:40.967095 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61475c6c-f8ca-4473-be1a-e1a124404f05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:40.996364 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-61475c6c-f8ca-4473-be1a-e1a124404f05 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:26:40.998553 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-61475c6c-f8ca-4473-be1a-e1a124404f05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:26:41.003435 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e815e28d-14f3-4327-9a74-64706435f93a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:41.005178 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e815e28d-14f3-4327-9a74-64706435f93a None admin] REQUEST_METHOD: `PUT` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:41.005661 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e815e28d-14f3-4327-9a74-64706435f93a None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:41.006166 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e815e28d-14f3-4327-9a74-64706435f93a None admin] PATH_INFO: `/v3/projects/746cf064ee5344ddb5daa2377fd66d25/groups/f7a013e97dd848a98ff628c919d30efd/roles/8eff41f243c843ed95505a488ca6eada` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:41.011841 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e815e28d-14f3-4327-9a74-64706435f93a None admin] RBAC: Authorizing `identity:create_grant(project_id=746cf064ee5344ddb5daa2377fd66d25, group_id=f7a013e97dd848a98ff628c919d30efd, role_id=8eff41f243c843ed95505a488ca6eada)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:41.014729 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e815e28d-14f3-4327-9a74-64706435f93a None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:41.064505 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 207/402] 10.222.0.70 () {58 vars in 1442 bytes} [Mon Jul 11 14:26:40 2022] PUT /identity/v3/projects/746cf064ee5344ddb5daa2377fd66d25/groups/f7a013e97dd848a98ff628c919d30efd/roles/8eff41f243c843ed95505a488ca6eada => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:26:41.113298 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:41.120452 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 196/403] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:26:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 14:26:41.190901 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e815e28d-14f3-4327-9a74-64706435f93a None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:41.323457 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:41.346261 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e815e28d-14f3-4327-9a74-64706435f93a None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:41.403124 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980b0165-2c8d-4897-bcb5-895d5c56acfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:41.403966 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980b0165-2c8d-4897-bcb5-895d5c56acfc None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:41.404278 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980b0165-2c8d-4897-bcb5-895d5c56acfc None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:41.404559 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980b0165-2c8d-4897-bcb5-895d5c56acfc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:41.425384 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980b0165-2c8d-4897-bcb5-895d5c56acfc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:26:41.444312 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application [None req-980b0165-2c8d-4897-bcb5-895d5c56acfc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 14:26:41.444312 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:41.444312 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:26:41.444312 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:26:41.444312 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:26:41.444312 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:26:41.444312 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:26:41.444312 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:26:41.444312 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:26:41.444312 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:26:41.444312 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:26:41.444312 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:26:41.444312 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:26:41.444312 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:26:41.444312 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:26:41.444312 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:26:41.445255 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:26:41.445255 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:26:41.445255 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:26:41.445255 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:26:41.445255 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:26:41.445255 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:26:41.445255 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:26:41.445255 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:26:41.445255 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:26:41.445255 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:26:41.445255 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:26:41.445255 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application with Lock( Jul 11 14:26:41.445255 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:26:41.445255 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:26:41.445255 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:26:41.445255 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:26:41.446038 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:26:41.446038 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:26:41.446038 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:26:41.446038 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:26:41.446038 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:26:41.446038 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:26:41.446038 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:26:41.446038 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:26:41.446038 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:26:41.446038 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:26:41.446038 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 14:26:41.446038 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Jul 11 14:26:41.447143 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 208/404] 10.222.0.70 () {56 vars in 1114 bytes} [Mon Jul 11 14:26:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:26:41.459162 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61475c6c-f8ca-4473-be1a-e1a124404f05 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:41.555658 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db3e3dd-5d89-4219-a488-01dd708142c6 None None] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:41.556405 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db3e3dd-5d89-4219-a488-01dd708142c6 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:41.556890 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db3e3dd-5d89-4219-a488-01dd708142c6 None None] PATH_INFO: `/` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:41.559070 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 209/405] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:26:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 14:26:41.564998 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc1c8e5-84bc-4ffd-bb9c-17d27e677ea1 None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:41.565710 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc1c8e5-84bc-4ffd-bb9c-17d27e677ea1 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:41.566191 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc1c8e5-84bc-4ffd-bb9c-17d27e677ea1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:41.593669 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-bdc1c8e5-84bc-4ffd-bb9c-17d27e677ea1 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:26:41.598657 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-bdc1c8e5-84bc-4ffd-bb9c-17d27e677ea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:26:41.651271 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61475c6c-f8ca-4473-be1a-e1a124404f05 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:41.722716 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f1f179-d553-4f4c-8130-1537804bd319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:41.723323 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f1f179-d553-4f4c-8130-1537804bd319 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:41.723753 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f1f179-d553-4f4c-8130-1537804bd319 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:41.724062 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f1f179-d553-4f4c-8130-1537804bd319 None admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:41.724858 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f1f179-d553-4f4c-8130-1537804bd319 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:41.725169 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f1f179-d553-4f4c-8130-1537804bd319 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:41.726578 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f1f179-d553-4f4c-8130-1537804bd319 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:41.748587 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 210/406] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:26:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:26:41.749627 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 197/407] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Jul 11 14:26:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:41.755093 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc1c8e5-84bc-4ffd-bb9c-17d27e677ea1 None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:41.790508 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f1f179-d553-4f4c-8130-1537804bd319 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:41.907760 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:41.915235 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:41.986291 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc1c8e5-84bc-4ffd-bb9c-17d27e677ea1 None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:42.059517 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97487899-0f9a-4f49-baa6-1ba2acbe7b1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:42.062526 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97487899-0f9a-4f49-baa6-1ba2acbe7b1f None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:42.063336 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97487899-0f9a-4f49-baa6-1ba2acbe7b1f None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:42.064100 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97487899-0f9a-4f49-baa6-1ba2acbe7b1f None admin] PATH_INFO: `/v3/groups/f7a013e97dd848a98ff628c919d30efd` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:42.066707 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97487899-0f9a-4f49-baa6-1ba2acbe7b1f None admin] RBAC: Authorizing `identity:get_group(group_id=f7a013e97dd848a98ff628c919d30efd)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:42.070156 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97487899-0f9a-4f49-baa6-1ba2acbe7b1f None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:42.070628 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f1f179-d553-4f4c-8130-1537804bd319 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:42.075394 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 211/408] 10.222.0.70 () {56 vars in 1180 bytes} [Mon Jul 11 14:26:41 2022] GET /identity/v3/groups/f7a013e97dd848a98ff628c919d30efd => generated 226 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:42.088637 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97487899-0f9a-4f49-baa6-1ba2acbe7b1f None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:42.145771 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2c560b-37ef-47a6-b956-1edf72a1de8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:42.146602 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2c560b-37ef-47a6-b956-1edf72a1de8d None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:42.146889 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2c560b-37ef-47a6-b956-1edf72a1de8d None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:42.147167 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2c560b-37ef-47a6-b956-1edf72a1de8d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:42.171198 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2c560b-37ef-47a6-b956-1edf72a1de8d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:26:42.179784 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-ce2c560b-37ef-47a6-b956-1edf72a1de8d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:26:42.179784 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:42.179784 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:26:42.179784 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:26:42.179784 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:26:42.179784 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:26:42.179784 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:26:42.179784 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:26:42.179784 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:26:42.179784 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:26:42.179784 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:26:42.179784 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:26:42.179784 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:26:42.179784 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:26:42.179784 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:26:42.179784 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:26:42.181524 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:26:42.181524 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:26:42.181524 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:26:42.181524 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:26:42.181524 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:26:42.181524 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:26:42.181524 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:26:42.181524 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:26:42.181524 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:26:42.181524 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:26:42.181524 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:26:42.181524 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( Jul 11 14:26:42.181524 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:26:42.181524 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:26:42.181524 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:26:42.181524 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:26:42.183454 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:26:42.183454 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:26:42.183454 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:26:42.183454 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:26:42.183454 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:26:42.183454 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:26:42.183454 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:26:42.183454 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:26:42.183454 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:26:42.183454 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:26:42.183454 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:26:42.183454 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Jul 11 14:26:42.189634 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 198/409] 10.222.0.70 () {56 vars in 1096 bytes} [Mon Jul 11 14:26:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 399 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:26:42.203441 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2c560b-37ef-47a6-b956-1edf72a1de8d None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:42.310492 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97487899-0f9a-4f49-baa6-1ba2acbe7b1f None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:42.323250 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2c560b-37ef-47a6-b956-1edf72a1de8d None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:42.360623 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:42.365498 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12319fc3-ecce-4a8e-a0b6-65801fba2937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:42.366092 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12319fc3-ecce-4a8e-a0b6-65801fba2937 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:42.366421 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12319fc3-ecce-4a8e-a0b6-65801fba2937 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:42.366678 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12319fc3-ecce-4a8e-a0b6-65801fba2937 None admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:42.367521 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12319fc3-ecce-4a8e-a0b6-65801fba2937 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:42.367829 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12319fc3-ecce-4a8e-a0b6-65801fba2937 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:42.369323 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12319fc3-ecce-4a8e-a0b6-65801fba2937 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:42.380473 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 199/410] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Jul 11 14:26:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:26:42.381784 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c1b3ff-2d0b-4a19-83e5-b7fe003ce7cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:42.381998 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc708958-06a2-4699-9e80-20a0c9e63e82 None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:42.382128 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc708958-06a2-4699-9e80-20a0c9e63e82 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:42.382522 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc708958-06a2-4699-9e80-20a0c9e63e82 None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:42.383725 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 200/411] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:26:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:26:42.384689 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c1b3ff-2d0b-4a19-83e5-b7fe003ce7cf None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:42.385560 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c1b3ff-2d0b-4a19-83e5-b7fe003ce7cf None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:42.386318 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c1b3ff-2d0b-4a19-83e5-b7fe003ce7cf None admin] PATH_INFO: `/v3/projects/746cf064ee5344ddb5daa2377fd66d25` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:42.388901 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c1b3ff-2d0b-4a19-83e5-b7fe003ce7cf None admin] RBAC: Authorizing `identity:get_project(project_id=746cf064ee5344ddb5daa2377fd66d25)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:42.389290 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2f5947-e0d2-4242-8f1b-05e5f1f0729f None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:42.389585 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2f5947-e0d2-4242-8f1b-05e5f1f0729f None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:42.389863 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2f5947-e0d2-4242-8f1b-05e5f1f0729f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:42.393066 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c1b3ff-2d0b-4a19-83e5-b7fe003ce7cf None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:42.397782 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 212/412] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Jul 11 14:26:42 2022] GET /identity/v3/projects/746cf064ee5344ddb5daa2377fd66d25 => generated 302 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:42.406061 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c1b3ff-2d0b-4a19-83e5-b7fe003ce7cf None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:42.412040 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-8b2f5947-e0d2-4242-8f1b-05e5f1f0729f None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:26:42.414343 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-8b2f5947-e0d2-4242-8f1b-05e5f1f0729f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:26:42.438776 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:42.557011 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 201/413] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:26:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 14:26:42.557685 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2f5947-e0d2-4242-8f1b-05e5f1f0729f None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:42.592066 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c1b3ff-2d0b-4a19-83e5-b7fe003ce7cf None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:42.631558 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564e26af-a4c6-4a1a-a593-fae131bc98fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:42.632877 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564e26af-a4c6-4a1a-a593-fae131bc98fc None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:42.633369 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564e26af-a4c6-4a1a-a593-fae131bc98fc None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:42.633867 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564e26af-a4c6-4a1a-a593-fae131bc98fc None admin] PATH_INFO: `/v3/groups/151fdd7d8679421c811416d3a12ed8b7` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:42.635348 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564e26af-a4c6-4a1a-a593-fae131bc98fc None admin] RBAC: Authorizing `identity:get_group(group_id=151fdd7d8679421c811416d3a12ed8b7)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:42.637061 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564e26af-a4c6-4a1a-a593-fae131bc98fc None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:42.639416 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 213/414] 10.222.0.70 () {56 vars in 1180 bytes} [Mon Jul 11 14:26:42 2022] GET /identity/v3/groups/151fdd7d8679421c811416d3a12ed8b7 => generated 229 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:42.640524 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564e26af-a4c6-4a1a-a593-fae131bc98fc None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:42.699032 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2f5947-e0d2-4242-8f1b-05e5f1f0729f None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:42.711344 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:42.733495 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:42.740912 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ea7403-7912-4bd5-bbc7-3d9713e5147a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:42.742056 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ea7403-7912-4bd5-bbc7-3d9713e5147a None admin] REQUEST_METHOD: `PUT` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:42.742489 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ea7403-7912-4bd5-bbc7-3d9713e5147a None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:42.742912 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ea7403-7912-4bd5-bbc7-3d9713e5147a None admin] PATH_INFO: `/v3/projects/746cf064ee5344ddb5daa2377fd66d25/groups/f7a013e97dd848a98ff628c919d30efd/roles/7d8b0827910944f29bfa3a92d6cb7c92` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:42.745603 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ea7403-7912-4bd5-bbc7-3d9713e5147a None admin] RBAC: Authorizing `identity:create_grant(project_id=746cf064ee5344ddb5daa2377fd66d25, group_id=f7a013e97dd848a98ff628c919d30efd, role_id=7d8b0827910944f29bfa3a92d6cb7c92)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:42.747318 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ea7403-7912-4bd5-bbc7-3d9713e5147a None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:42.757108 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564e26af-a4c6-4a1a-a593-fae131bc98fc None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:42.770182 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 202/415] 10.222.0.70 () {58 vars in 1442 bytes} [Mon Jul 11 14:26:42 2022] PUT /identity/v3/projects/746cf064ee5344ddb5daa2377fd66d25/groups/f7a013e97dd848a98ff628c919d30efd/roles/7d8b0827910944f29bfa3a92d6cb7c92 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:26:42.771725 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ea7403-7912-4bd5-bbc7-3d9713e5147a None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:42.882533 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e994db1c-72a4-47c8-8e4e-116f33abcf7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:42.883414 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e994db1c-72a4-47c8-8e4e-116f33abcf7a None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:42.883835 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e994db1c-72a4-47c8-8e4e-116f33abcf7a None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:42.884271 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e994db1c-72a4-47c8-8e4e-116f33abcf7a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:42.924544 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ea7403-7912-4bd5-bbc7-3d9713e5147a None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:42.934205 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e994db1c-72a4-47c8-8e4e-116f33abcf7a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:26:42.951774 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application [None req-e994db1c-72a4-47c8-8e4e-116f33abcf7a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 14:26:42.951774 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:42.951774 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:26:42.951774 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:26:42.951774 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:26:42.951774 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:26:42.951774 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:26:42.951774 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:26:42.951774 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:26:42.951774 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:26:42.951774 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:26:42.951774 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:26:42.951774 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:26:42.951774 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:26:42.951774 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:26:42.951774 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:26:42.952783 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:26:42.952783 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:26:42.952783 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:26:42.952783 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:26:42.952783 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:26:42.952783 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:26:42.952783 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:26:42.952783 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:26:42.952783 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:26:42.952783 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:26:42.952783 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:26:42.952783 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application with Lock( Jul 11 14:26:42.952783 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:26:42.952783 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:26:42.952783 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:26:42.952783 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:26:42.953633 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:26:42.953633 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:26:42.953633 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:26:42.953633 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:26:42.953633 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:26:42.953633 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:26:42.953633 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:26:42.953633 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:26:42.953633 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:26:42.953633 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:26:42.953633 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 14:26:42.953633 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Jul 11 14:26:42.960975 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 214/416] 10.222.0.70 () {56 vars in 1114 bytes} [Mon Jul 11 14:26:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:26:42.963482 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e8a9f6-7569-4266-bfca-1d21e9f6e345 None None] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:42.963961 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e8a9f6-7569-4266-bfca-1d21e9f6e345 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:42.964641 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e8a9f6-7569-4266-bfca-1d21e9f6e345 None None] PATH_INFO: `/` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:42.972786 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 215/417] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:26:42 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:26:42.975143 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11183303-03d8-498e-82ab-09022430e232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:42.976381 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11183303-03d8-498e-82ab-09022430e232 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:42.976925 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11183303-03d8-498e-82ab-09022430e232 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:42.977419 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11183303-03d8-498e-82ab-09022430e232 None admin] PATH_INFO: `/v3/projects/3a62c198ecd94c498e9bd153b3d4226c` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:42.977651 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7889d072-e088-4e98-ab22-59534ad7aba2 None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:42.978145 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7889d072-e088-4e98-ab22-59534ad7aba2 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:42.978643 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7889d072-e088-4e98-ab22-59534ad7aba2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:42.979896 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11183303-03d8-498e-82ab-09022430e232 None admin] RBAC: Authorizing `identity:get_project(project_id=3a62c198ecd94c498e9bd153b3d4226c)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:42.981747 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11183303-03d8-498e-82ab-09022430e232 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:42.983902 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 203/418] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Jul 11 14:26:42 2022] GET /identity/v3/projects/3a62c198ecd94c498e9bd153b3d4226c => generated 344 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:42.985223 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11183303-03d8-498e-82ab-09022430e232 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:43.012361 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-7889d072-e088-4e98-ab22-59534ad7aba2 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:26:43.013944 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-7889d072-e088-4e98-ab22-59534ad7aba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:26:43.049357 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:43.101869 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 216/419] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:26:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 14:26:43.103022 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7889d072-e088-4e98-ab22-59534ad7aba2 None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:43.190555 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11183303-03d8-498e-82ab-09022430e232 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:43.244717 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:43.265575 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2463025d-9b4c-40fc-abee-029ff491f39a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:43.267182 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2463025d-9b4c-40fc-abee-029ff491f39a None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:43.267815 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2463025d-9b4c-40fc-abee-029ff491f39a None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:43.268504 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2463025d-9b4c-40fc-abee-029ff491f39a None admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:43.271056 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2463025d-9b4c-40fc-abee-029ff491f39a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:43.271901 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2463025d-9b4c-40fc-abee-029ff491f39a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:43.274908 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2463025d-9b4c-40fc-abee-029ff491f39a None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:43.294724 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 204/420] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Jul 11 14:26:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:43.297739 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2463025d-9b4c-40fc-abee-029ff491f39a None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:43.311215 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7889d072-e088-4e98-ab22-59534ad7aba2 None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:43.381318 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6289ba9e-1783-43ef-95a1-3d3d3635a4f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:43.383069 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6289ba9e-1783-43ef-95a1-3d3d3635a4f9 None admin] REQUEST_METHOD: `PUT` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:43.383770 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6289ba9e-1783-43ef-95a1-3d3d3635a4f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:43.384493 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6289ba9e-1783-43ef-95a1-3d3d3635a4f9 None admin] PATH_INFO: `/v3/projects/3a62c198ecd94c498e9bd153b3d4226c/groups/151fdd7d8679421c811416d3a12ed8b7/roles/b46df176b0fe479da63c318db225bed4` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:43.388370 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6289ba9e-1783-43ef-95a1-3d3d3635a4f9 None admin] RBAC: Authorizing `identity:create_grant(project_id=3a62c198ecd94c498e9bd153b3d4226c, group_id=151fdd7d8679421c811416d3a12ed8b7, role_id=b46df176b0fe479da63c318db225bed4)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:43.391352 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6289ba9e-1783-43ef-95a1-3d3d3635a4f9 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:43.416072 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 217/421] 10.222.0.70 () {58 vars in 1442 bytes} [Mon Jul 11 14:26:43 2022] PUT /identity/v3/projects/3a62c198ecd94c498e9bd153b3d4226c/groups/151fdd7d8679421c811416d3a12ed8b7/roles/b46df176b0fe479da63c318db225bed4 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:26:43.417999 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6289ba9e-1783-43ef-95a1-3d3d3635a4f9 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:43.573188 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2463025d-9b4c-40fc-abee-029ff491f39a None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:43.578154 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:43.691990 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6289ba9e-1783-43ef-95a1-3d3d3635a4f9 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:43.701442 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93eb26d1-8800-48aa-a9ad-c9019ae794e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:43.702915 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eb26d1-8800-48aa-a9ad-c9019ae794e8 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:43.703511 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eb26d1-8800-48aa-a9ad-c9019ae794e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:43.704122 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eb26d1-8800-48aa-a9ad-c9019ae794e8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:43.731751 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93eb26d1-8800-48aa-a9ad-c9019ae794e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:26:43.744044 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-93eb26d1-8800-48aa-a9ad-c9019ae794e8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 14:26:43.744044 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:43.744044 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:26:43.744044 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:26:43.744044 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:26:43.744044 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:26:43.744044 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:26:43.744044 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:26:43.744044 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:26:43.744044 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:26:43.744044 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:26:43.744044 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:26:43.744044 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:26:43.744044 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:26:43.744044 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:26:43.744044 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:26:43.745855 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:26:43.745855 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:26:43.745855 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:26:43.745855 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:26:43.745855 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:26:43.745855 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:26:43.745855 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:26:43.745855 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:26:43.745855 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:26:43.745855 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:26:43.745855 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:26:43.745855 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( Jul 11 14:26:43.745855 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:26:43.745855 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:26:43.745855 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:26:43.745855 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:26:43.747338 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:26:43.747338 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:26:43.747338 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:26:43.747338 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:26:43.747338 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:26:43.747338 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:26:43.747338 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:26:43.747338 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:26:43.747338 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:26:43.747338 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:26:43.747338 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 14:26:43.747338 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Jul 11 14:26:43.747338 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 205/422] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Jul 11 14:26:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 451 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:26:43.753452 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93eb26d1-8800-48aa-a9ad-c9019ae794e8 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:43.770992 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:43.786902 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbed12a4-cee1-4ef3-bc0b-7595c952450c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:43.788763 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbed12a4-cee1-4ef3-bc0b-7595c952450c None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:43.790440 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbed12a4-cee1-4ef3-bc0b-7595c952450c None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:43.796541 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbed12a4-cee1-4ef3-bc0b-7595c952450c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:43.986915 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbed12a4-cee1-4ef3-bc0b-7595c952450c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:43.988511 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbed12a4-cee1-4ef3-bc0b-7595c952450c None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:44.024828 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93eb26d1-8800-48aa-a9ad-c9019ae794e8 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:44.081796 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455ab9b2-fcfe-49ef-b983-8d3669c1ed46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:44.083572 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455ab9b2-fcfe-49ef-b983-8d3669c1ed46 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:44.084383 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455ab9b2-fcfe-49ef-b983-8d3669c1ed46 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:44.085207 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455ab9b2-fcfe-49ef-b983-8d3669c1ed46 None admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:44.087349 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455ab9b2-fcfe-49ef-b983-8d3669c1ed46 None admin] RBAC: Adding query filter params (name=member) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:44.088390 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455ab9b2-fcfe-49ef-b983-8d3669c1ed46 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:44.091314 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455ab9b2-fcfe-49ef-b983-8d3669c1ed46 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:44.112361 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 218/424] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Jul 11 14:26:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 689 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 14:26:44.112361 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae99200-0238-4ad6-928a-4e5fdf080393 None None] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:44.112361 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae99200-0238-4ad6-928a-4e5fdf080393 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:44.112976 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae99200-0238-4ad6-928a-4e5fdf080393 None None] PATH_INFO: `/` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:44.114765 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 219/425] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:26:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:26:44.115299 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 206/425] 10.222.0.70 () {56 vars in 1101 bytes} [Mon Jul 11 14:26:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:26:44.115869 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae99200-0238-4ad6-928a-4e5fdf080393 None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:44.124109 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42cdaf6-e8eb-4f95-9a60-98d9630e20df None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:44.124805 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42cdaf6-e8eb-4f95-9a60-98d9630e20df None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:44.125456 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42cdaf6-e8eb-4f95-9a60-98d9630e20df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:44.155699 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-a42cdaf6-e8eb-4f95-9a60-98d9630e20df None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:26:44.156545 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:44.157220 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-a42cdaf6-e8eb-4f95-9a60-98d9630e20df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:26:44.177286 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:44.240144 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae99200-0238-4ad6-928a-4e5fdf080393 None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:44.256700 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 207/426] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:26:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:26:44.258490 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42cdaf6-e8eb-4f95-9a60-98d9630e20df None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:44.292037 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09afa747-d503-4ed2-ad60-27e9eea703c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:44.293272 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09afa747-d503-4ed2-ad60-27e9eea703c6 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:44.293704 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09afa747-d503-4ed2-ad60-27e9eea703c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:44.294127 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09afa747-d503-4ed2-ad60-27e9eea703c6 None admin] PATH_INFO: `/v3/projects/02bf3f49198a4e809a9a6d408d01baa9` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:44.295686 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09afa747-d503-4ed2-ad60-27e9eea703c6 None admin] RBAC: Authorizing `identity:get_project(project_id=02bf3f49198a4e809a9a6d408d01baa9)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:44.298276 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09afa747-d503-4ed2-ad60-27e9eea703c6 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:44.300506 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 220/427] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Jul 11 14:26:44 2022] GET /identity/v3/projects/02bf3f49198a4e809a9a6d408d01baa9 => generated 298 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:44.307824 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09afa747-d503-4ed2-ad60-27e9eea703c6 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:44.468509 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42cdaf6-e8eb-4f95-9a60-98d9630e20df None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:44.501760 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:44.507082 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09afa747-d503-4ed2-ad60-27e9eea703c6 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:44.510088 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f164bb-c73c-4bc4-8c42-e79a0a9b1031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:44.511027 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f164bb-c73c-4bc4-8c42-e79a0a9b1031 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:44.511532 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f164bb-c73c-4bc4-8c42-e79a0a9b1031 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:44.512019 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f164bb-c73c-4bc4-8c42-e79a0a9b1031 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:44.536464 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:44.590039 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd33b607-7393-449f-8ebf-4d6fd46f2c94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:44.591496 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd33b607-7393-449f-8ebf-4d6fd46f2c94 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:44.592007 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd33b607-7393-449f-8ebf-4d6fd46f2c94 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:44.592599 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd33b607-7393-449f-8ebf-4d6fd46f2c94 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:44.593171 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f164bb-c73c-4bc4-8c42-e79a0a9b1031 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:44.594897 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f164bb-c73c-4bc4-8c42-e79a0a9b1031 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:44.609787 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd33b607-7393-449f-8ebf-4d6fd46f2c94 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:26:44.619534 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application [None req-fd33b607-7393-449f-8ebf-4d6fd46f2c94 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 14:26:44.619534 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:44.619534 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:26:44.619534 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:26:44.619534 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:26:44.619534 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:26:44.619534 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:26:44.619534 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:26:44.619534 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:26:44.619534 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:26:44.619534 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:26:44.619534 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:26:44.619534 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:26:44.619534 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:26:44.619534 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:26:44.619534 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:26:44.620528 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:26:44.620528 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:26:44.620528 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:26:44.620528 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:26:44.620528 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:26:44.620528 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:26:44.620528 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:26:44.620528 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:26:44.620528 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:26:44.620528 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:26:44.620528 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:26:44.620528 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application with Lock( Jul 11 14:26:44.620528 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:26:44.620528 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:26:44.620528 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:26:44.620528 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:26:44.621308 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:26:44.621308 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:26:44.621308 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:26:44.621308 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:26:44.621308 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:26:44.621308 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:26:44.621308 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:26:44.621308 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:26:44.621308 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:26:44.621308 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:26:44.621308 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 14:26:44.621308 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Jul 11 14:26:44.628556 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 221/428] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Jul 11 14:26:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:26:44.630405 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd33b607-7393-449f-8ebf-4d6fd46f2c94 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:44.722985 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 208/429] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Jul 11 14:26:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 14:26:44.724799 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f164bb-c73c-4bc4-8c42-e79a0a9b1031 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:44.773303 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd33b607-7393-449f-8ebf-4d6fd46f2c94 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:44.787658 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:44.811608 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cfee70-c5f7-4c60-8c29-2900550ee9c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:44.812518 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cfee70-c5f7-4c60-8c29-2900550ee9c7 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:44.812807 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cfee70-c5f7-4c60-8c29-2900550ee9c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:44.813093 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cfee70-c5f7-4c60-8c29-2900550ee9c7 None admin] PATH_INFO: `/v3/groups/f7a013e97dd848a98ff628c919d30efd` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:44.814555 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cfee70-c5f7-4c60-8c29-2900550ee9c7 None admin] RBAC: Authorizing `identity:get_group(group_id=f7a013e97dd848a98ff628c919d30efd)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:44.816885 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cfee70-c5f7-4c60-8c29-2900550ee9c7 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:44.819380 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 222/430] 10.222.0.70 () {56 vars in 1180 bytes} [Mon Jul 11 14:26:44 2022] GET /identity/v3/groups/f7a013e97dd848a98ff628c919d30efd => generated 226 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:44.825045 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cfee70-c5f7-4c60-8c29-2900550ee9c7 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:44.847532 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f164bb-c73c-4bc4-8c42-e79a0a9b1031 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:44.858368 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:44.891611 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26825a12-7fc0-43a2-8bb2-495021ad9879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:44.892925 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26825a12-7fc0-43a2-8bb2-495021ad9879 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:44.893458 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26825a12-7fc0-43a2-8bb2-495021ad9879 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:44.893958 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26825a12-7fc0-43a2-8bb2-495021ad9879 None admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:44.894987 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26825a12-7fc0-43a2-8bb2-495021ad9879 None admin] RBAC: Adding query filter params (name=member) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:44.896099 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26825a12-7fc0-43a2-8bb2-495021ad9879 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:44.899113 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26825a12-7fc0-43a2-8bb2-495021ad9879 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:44.911690 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 209/431] 10.222.0.70 () {56 vars in 1101 bytes} [Mon Jul 11 14:26:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:44.913823 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26825a12-7fc0-43a2-8bb2-495021ad9879 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:44.953178 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cfee70-c5f7-4c60-8c29-2900550ee9c7 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:44.997449 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c08170-a993-4763-aef6-50edb6baa6f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:44.998321 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c08170-a993-4763-aef6-50edb6baa6f9 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:44.998621 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c08170-a993-4763-aef6-50edb6baa6f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:44.999024 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c08170-a993-4763-aef6-50edb6baa6f9 None admin] PATH_INFO: `/v3/projects/02bf3f49198a4e809a9a6d408d01baa9` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:45.000412 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c08170-a993-4763-aef6-50edb6baa6f9 None admin] RBAC: Authorizing `identity:get_project(project_id=02bf3f49198a4e809a9a6d408d01baa9)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:45.001945 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c08170-a993-4763-aef6-50edb6baa6f9 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:45.008687 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 223/432] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Jul 11 14:26:44 2022] GET /identity/v3/projects/02bf3f49198a4e809a9a6d408d01baa9 => generated 298 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:45.008687 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c08170-a993-4763-aef6-50edb6baa6f9 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:45.053518 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26825a12-7fc0-43a2-8bb2-495021ad9879 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:45.070622 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:45.096800 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a81b70-fbfc-429f-ab5b-67e267cf9a35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:45.097633 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a81b70-fbfc-429f-ab5b-67e267cf9a35 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:45.098030 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a81b70-fbfc-429f-ab5b-67e267cf9a35 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:45.098972 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a81b70-fbfc-429f-ab5b-67e267cf9a35 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:45.100064 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a81b70-fbfc-429f-ab5b-67e267cf9a35 None admin] RBAC: Adding query filter params (group.id=f7a013e97dd848a98ff628c919d30efd, role.id=7d8b0827910944f29bfa3a92d6cb7c92, scope.project.id=02bf3f49198a4e809a9a6d408d01baa9) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:45.100519 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a81b70-fbfc-429f-ab5b-67e267cf9a35 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:45.102217 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a81b70-fbfc-429f-ab5b-67e267cf9a35 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:45.116236 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 210/433] 10.222.0.70 () {56 vars in 1376 bytes} [Mon Jul 11 14:26:44 2022] GET /identity/v3/role_assignments?group.id=f7a013e97dd848a98ff628c919d30efd&scope.project.id=02bf3f49198a4e809a9a6d408d01baa9&role.id=7d8b0827910944f29bfa3a92d6cb7c92 => generated 611 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:45.116236 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a81b70-fbfc-429f-ab5b-67e267cf9a35 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:45.138176 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:45.148766 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c08170-a993-4763-aef6-50edb6baa6f9 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:45.226092 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d2e64e-93a0-4fda-bb98-daf119865341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:45.227017 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d2e64e-93a0-4fda-bb98-daf119865341 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:45.227473 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d2e64e-93a0-4fda-bb98-daf119865341 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:45.227907 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d2e64e-93a0-4fda-bb98-daf119865341 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:45.232773 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a81b70-fbfc-429f-ab5b-67e267cf9a35 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:45.278516 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7d850d-8d90-408e-82df-e79bb4c6db6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:45.279692 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7d850d-8d90-408e-82df-e79bb4c6db6b None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:45.280087 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7d850d-8d90-408e-82df-e79bb4c6db6b None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:45.280650 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7d850d-8d90-408e-82df-e79bb4c6db6b None admin] PATH_INFO: `/v3/groups/f7a013e97dd848a98ff628c919d30efd` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:45.282631 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7d850d-8d90-408e-82df-e79bb4c6db6b None admin] RBAC: Authorizing `identity:get_group(group_id=f7a013e97dd848a98ff628c919d30efd)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:45.285968 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7d850d-8d90-408e-82df-e79bb4c6db6b None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:45.288576 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 211/434] 10.222.0.70 () {56 vars in 1180 bytes} [Mon Jul 11 14:26:45 2022] GET /identity/v3/groups/f7a013e97dd848a98ff628c919d30efd => generated 226 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:45.290090 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be049f0-d385-4e39-8c1e-d6396692b260 None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:45.295595 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be049f0-d385-4e39-8c1e-d6396692b260 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:45.296047 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be049f0-d385-4e39-8c1e-d6396692b260 None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:45.297988 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 212/435] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:26:45 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:26:45.299024 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be049f0-d385-4e39-8c1e-d6396692b260 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:45.361672 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:45.374113 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d2e64e-93a0-4fda-bb98-daf119865341 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:45.375743 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d2e64e-93a0-4fda-bb98-daf119865341 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:45.428630 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be049f0-d385-4e39-8c1e-d6396692b260 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:45.470004 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb31ab06-f3fe-4a3d-9b5c-335a02a156f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:45.470680 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb31ab06-f3fe-4a3d-9b5c-335a02a156f6 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:45.471089 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb31ab06-f3fe-4a3d-9b5c-335a02a156f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:45.471372 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb31ab06-f3fe-4a3d-9b5c-335a02a156f6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:45.472511 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb31ab06-f3fe-4a3d-9b5c-335a02a156f6 None admin] RBAC: Adding query filter params (group.id=f7a013e97dd848a98ff628c919d30efd, role.id=8eff41f243c843ed95505a488ca6eada, scope.project.id=02bf3f49198a4e809a9a6d408d01baa9) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:45.472634 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb31ab06-f3fe-4a3d-9b5c-335a02a156f6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:45.474295 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb31ab06-f3fe-4a3d-9b5c-335a02a156f6 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:45.492404 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 213/436] 10.222.0.70 () {56 vars in 1376 bytes} [Mon Jul 11 14:26:45 2022] GET /identity/v3/role_assignments?group.id=f7a013e97dd848a98ff628c919d30efd&scope.project.id=02bf3f49198a4e809a9a6d408d01baa9&role.id=8eff41f243c843ed95505a488ca6eada => generated 611 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:45.492404 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69edb8f-f659-47bc-a930-6b1630d86868 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:45.492404 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69edb8f-f659-47bc-a930-6b1630d86868 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:45.492404 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69edb8f-f659-47bc-a930-6b1630d86868 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:45.523103 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:45.531004 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-d69edb8f-f659-47bc-a930-6b1630d86868 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:26:45.532847 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-d69edb8f-f659-47bc-a930-6b1630d86868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:26:45.533554 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 224/437] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Jul 11 14:26:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 529 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 14:26:45.540825 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d2e64e-93a0-4fda-bb98-daf119865341 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:45.636884 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 214/438] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:26:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:26:45.663870 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69edb8f-f659-47bc-a930-6b1630d86868 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:45.724325 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d2e64e-93a0-4fda-bb98-daf119865341 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:45.735468 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:45.780236 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1f5f71-d4c6-4772-8cec-c2e6b8e3a688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:45.781431 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1f5f71-d4c6-4772-8cec-c2e6b8e3a688 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:45.781718 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1f5f71-d4c6-4772-8cec-c2e6b8e3a688 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:45.782137 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1f5f71-d4c6-4772-8cec-c2e6b8e3a688 None admin] PATH_INFO: `/v3/projects/746cf064ee5344ddb5daa2377fd66d25` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:45.785394 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1f5f71-d4c6-4772-8cec-c2e6b8e3a688 None admin] RBAC: Authorizing `identity:get_project(project_id=746cf064ee5344ddb5daa2377fd66d25)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:45.787905 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1f5f71-d4c6-4772-8cec-c2e6b8e3a688 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:45.791385 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 225/439] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Jul 11 14:26:45 2022] GET /identity/v3/projects/746cf064ee5344ddb5daa2377fd66d25 => generated 302 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:45.797180 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1f5f71-d4c6-4772-8cec-c2e6b8e3a688 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:45.839194 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69edb8f-f659-47bc-a930-6b1630d86868 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:45.905378 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e93d53-42c6-475d-b119-55210211cc0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:45.906221 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e93d53-42c6-475d-b119-55210211cc0f None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:45.906509 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e93d53-42c6-475d-b119-55210211cc0f None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:45.906788 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e93d53-42c6-475d-b119-55210211cc0f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:45.910419 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:45.931616 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e93d53-42c6-475d-b119-55210211cc0f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:26:45.940762 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-29e93d53-42c6-475d-b119-55210211cc0f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 14:26:45.940762 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:45.940762 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:26:45.940762 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:26:45.940762 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:26:45.940762 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:26:45.940762 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:26:45.940762 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:26:45.940762 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:26:45.940762 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:26:45.940762 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:26:45.940762 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:26:45.940762 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:26:45.940762 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:26:45.940762 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:26:45.940762 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:26:45.941773 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:26:45.941773 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:26:45.941773 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:26:45.941773 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:26:45.941773 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:26:45.941773 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:26:45.941773 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:26:45.941773 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:26:45.941773 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:26:45.941773 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:26:45.941773 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:26:45.941773 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( Jul 11 14:26:45.941773 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:26:45.941773 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:26:45.941773 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:26:45.941773 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:26:45.943592 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:26:45.943592 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:26:45.943592 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:26:45.943592 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:26:45.943592 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:26:45.943592 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:26:45.943592 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:26:45.943592 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:26:45.943592 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:26:45.943592 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:26:45.943592 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 14:26:45.943592 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Jul 11 14:26:45.943592 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 215/440] 10.222.0.70 () {56 vars in 1114 bytes} [Mon Jul 11 14:26:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:26:45.949281 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a2fd2f-fe01-44bf-a6a9-c949e32849a4 None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:45.949281 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a2fd2f-fe01-44bf-a6a9-c949e32849a4 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:45.949281 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a2fd2f-fe01-44bf-a6a9-c949e32849a4 None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:45.949281 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 216/441] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:26:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:26:45.950958 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a2fd2f-fe01-44bf-a6a9-c949e32849a4 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:45.982778 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1f5f71-d4c6-4772-8cec-c2e6b8e3a688 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:46.041304 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb1f164-b7f1-40a6-af07-7f9090502522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:46.042671 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb1f164-b7f1-40a6-af07-7f9090502522 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:46.042967 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb1f164-b7f1-40a6-af07-7f9090502522 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:46.043249 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb1f164-b7f1-40a6-af07-7f9090502522 None admin] PATH_INFO: `/v3/groups/f7a013e97dd848a98ff628c919d30efd` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:46.044593 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb1f164-b7f1-40a6-af07-7f9090502522 None admin] RBAC: Authorizing `identity:get_group(group_id=f7a013e97dd848a98ff628c919d30efd)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:46.046129 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb1f164-b7f1-40a6-af07-7f9090502522 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:46.048242 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 226/442] 10.222.0.70 () {56 vars in 1180 bytes} [Mon Jul 11 14:26:45 2022] GET /identity/v3/groups/f7a013e97dd848a98ff628c919d30efd => generated 226 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:26:46.049538 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500e3654-75b9-4034-9220-ec9e7a779550 None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:46.049830 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500e3654-75b9-4034-9220-ec9e7a779550 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:46.050110 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500e3654-75b9-4034-9220-ec9e7a779550 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:46.072476 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-500e3654-75b9-4034-9220-ec9e7a779550 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:26:46.073702 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-500e3654-75b9-4034-9220-ec9e7a779550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:26:46.129225 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:46.136951 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a2fd2f-fe01-44bf-a6a9-c949e32849a4 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:46.184834 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 227/443] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:26:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:26:46.185511 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73c5b1e-8e7b-4aff-b417-8fb793cff45d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:46.186049 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500e3654-75b9-4034-9220-ec9e7a779550 None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:46.186226 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73c5b1e-8e7b-4aff-b417-8fb793cff45d None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:46.186474 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73c5b1e-8e7b-4aff-b417-8fb793cff45d None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:46.186856 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73c5b1e-8e7b-4aff-b417-8fb793cff45d None admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:46.187746 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73c5b1e-8e7b-4aff-b417-8fb793cff45d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:46.188055 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73c5b1e-8e7b-4aff-b417-8fb793cff45d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:46.189525 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73c5b1e-8e7b-4aff-b417-8fb793cff45d None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:46.200187 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 217/444] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Jul 11 14:26:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:46.206151 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73c5b1e-8e7b-4aff-b417-8fb793cff45d None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:46.271616 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:46.321594 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500e3654-75b9-4034-9220-ec9e7a779550 None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:46.332166 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73c5b1e-8e7b-4aff-b417-8fb793cff45d None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:46.368028 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18fb3bf-4795-43fb-9fa4-c4eefb9bb693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:46.369005 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18fb3bf-4795-43fb-9fa4-c4eefb9bb693 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:46.369431 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18fb3bf-4795-43fb-9fa4-c4eefb9bb693 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:46.369882 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18fb3bf-4795-43fb-9fa4-c4eefb9bb693 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:46.371365 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18fb3bf-4795-43fb-9fa4-c4eefb9bb693 None admin] RBAC: Adding query filter params (group.id=f7a013e97dd848a98ff628c919d30efd, role.id=8eff41f243c843ed95505a488ca6eada, scope.project.id=746cf064ee5344ddb5daa2377fd66d25) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:46.371879 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18fb3bf-4795-43fb-9fa4-c4eefb9bb693 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:46.374173 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18fb3bf-4795-43fb-9fa4-c4eefb9bb693 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:46.384675 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 228/445] 10.222.0.70 () {56 vars in 1376 bytes} [Mon Jul 11 14:26:46 2022] GET /identity/v3/role_assignments?group.id=f7a013e97dd848a98ff628c919d30efd&scope.project.id=746cf064ee5344ddb5daa2377fd66d25&role.id=8eff41f243c843ed95505a488ca6eada => generated 611 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:46.384930 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa5c0f6-f0bc-45ec-9712-e94e905009b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:46.385990 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa5c0f6-f0bc-45ec-9712-e94e905009b4 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:46.386183 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18fb3bf-4795-43fb-9fa4-c4eefb9bb693 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:46.386440 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa5c0f6-f0bc-45ec-9712-e94e905009b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:46.386878 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa5c0f6-f0bc-45ec-9712-e94e905009b4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:46.435788 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:46.491868 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa5c0f6-f0bc-45ec-9712-e94e905009b4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:46.493519 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa5c0f6-f0bc-45ec-9712-e94e905009b4 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:46.546883 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18fb3bf-4795-43fb-9fa4-c4eefb9bb693 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:46.586585 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:46.600549 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e189e8-1afb-4feb-a5da-4ca19e38d4b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:46.601371 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e189e8-1afb-4feb-a5da-4ca19e38d4b1 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:46.601657 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e189e8-1afb-4feb-a5da-4ca19e38d4b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:46.601935 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e189e8-1afb-4feb-a5da-4ca19e38d4b1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:46.615528 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e189e8-1afb-4feb-a5da-4ca19e38d4b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:26:46.623518 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application [None req-f1e189e8-1afb-4feb-a5da-4ca19e38d4b1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:26:46.623518 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:46.623518 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:26:46.623518 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:26:46.623518 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:26:46.623518 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:26:46.623518 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:26:46.623518 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:26:46.623518 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:26:46.623518 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:26:46.623518 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:26:46.623518 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:26:46.623518 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:26:46.623518 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:26:46.623518 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:26:46.623518 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:26:46.625430 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:26:46.625430 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:26:46.625430 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:26:46.625430 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:26:46.625430 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:26:46.625430 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:26:46.625430 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:26:46.625430 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:26:46.625430 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:26:46.625430 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:26:46.625430 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:26:46.625430 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application with Lock( Jul 11 14:26:46.625430 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:26:46.625430 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:26:46.625430 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:26:46.625430 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:26:46.626546 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:26:46.626546 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:26:46.626546 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:26:46.626546 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:26:46.626546 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:26:46.626546 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:26:46.626546 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:26:46.626546 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:26:46.626546 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:26:46.626546 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:26:46.626546 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:26:46.626546 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Jul 11 14:26:46.626546 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 229/446] 10.222.0.70 () {56 vars in 1096 bytes} [Mon Jul 11 14:26:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:26:46.632118 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e189e8-1afb-4feb-a5da-4ca19e38d4b1 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:46.667582 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 218/447] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Jul 11 14:26:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 14:26:46.677143 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa5c0f6-f0bc-45ec-9712-e94e905009b4 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:46.785055 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:46.827727 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e189e8-1afb-4feb-a5da-4ca19e38d4b1 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:46.852642 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa5c0f6-f0bc-45ec-9712-e94e905009b4 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:46.876508 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece2a401-828d-4375-9ad5-b70cfbdabdfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:46.877177 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece2a401-828d-4375-9ad5-b70cfbdabdfa None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:46.877463 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece2a401-828d-4375-9ad5-b70cfbdabdfa None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:46.877734 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece2a401-828d-4375-9ad5-b70cfbdabdfa None admin] PATH_INFO: `/v3/roles` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:46.878496 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece2a401-828d-4375-9ad5-b70cfbdabdfa None admin] RBAC: Adding query filter params (name=admin) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:46.878805 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece2a401-828d-4375-9ad5-b70cfbdabdfa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:46.881105 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece2a401-828d-4375-9ad5-b70cfbdabdfa None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:46.890599 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 230/448] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Jul 11 14:26:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:46.893769 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9803240e-865b-42b2-bfb7-cd5a6c06a14d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:46.894750 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9803240e-865b-42b2-bfb7-cd5a6c06a14d None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:46.895706 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9803240e-865b-42b2-bfb7-cd5a6c06a14d None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:46.896563 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9803240e-865b-42b2-bfb7-cd5a6c06a14d None admin] PATH_INFO: `/v3/projects/746cf064ee5344ddb5daa2377fd66d25` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:46.897610 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9803240e-865b-42b2-bfb7-cd5a6c06a14d None admin] RBAC: Authorizing `identity:get_project(project_id=746cf064ee5344ddb5daa2377fd66d25)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:46.897904 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece2a401-828d-4375-9ad5-b70cfbdabdfa None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:46.899228 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9803240e-865b-42b2-bfb7-cd5a6c06a14d None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:46.901173 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 219/449] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Jul 11 14:26:46 2022] GET /identity/v3/projects/746cf064ee5344ddb5daa2377fd66d25 => generated 302 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:46.906893 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9803240e-865b-42b2-bfb7-cd5a6c06a14d None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:46.976235 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:47.037590 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9803240e-865b-42b2-bfb7-cd5a6c06a14d None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:47.047131 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece2a401-828d-4375-9ad5-b70cfbdabdfa None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:47.086299 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:47.090930 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7956f3b-4798-4c99-ba61-718cb25166cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:47.091820 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7956f3b-4798-4c99-ba61-718cb25166cf None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:47.092243 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7956f3b-4798-4c99-ba61-718cb25166cf None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:47.092637 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7956f3b-4798-4c99-ba61-718cb25166cf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:47.094619 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653da184-5e3c-42c6-a952-2e40d700191e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:47.095934 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653da184-5e3c-42c6-a952-2e40d700191e None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:47.096404 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653da184-5e3c-42c6-a952-2e40d700191e None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:47.096966 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653da184-5e3c-42c6-a952-2e40d700191e None admin] PATH_INFO: `/v3/groups/f7a013e97dd848a98ff628c919d30efd` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:47.100679 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653da184-5e3c-42c6-a952-2e40d700191e None admin] RBAC: Authorizing `identity:get_group(group_id=f7a013e97dd848a98ff628c919d30efd)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:47.100679 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653da184-5e3c-42c6-a952-2e40d700191e None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:47.102297 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 220/450] 10.222.0.70 () {56 vars in 1180 bytes} [Mon Jul 11 14:26:46 2022] GET /identity/v3/groups/f7a013e97dd848a98ff628c919d30efd => generated 226 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:26:47.111454 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653da184-5e3c-42c6-a952-2e40d700191e None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:47.200441 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7956f3b-4798-4c99-ba61-718cb25166cf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:47.202831 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7956f3b-4798-4c99-ba61-718cb25166cf None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:47.237026 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653da184-5e3c-42c6-a952-2e40d700191e None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:47.263323 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:47.283022 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a933b4-18a9-416c-a1dc-4ae3f32cf3d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:47.283749 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a933b4-18a9-416c-a1dc-4ae3f32cf3d7 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:47.284070 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a933b4-18a9-416c-a1dc-4ae3f32cf3d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:47.284416 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a933b4-18a9-416c-a1dc-4ae3f32cf3d7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:47.285360 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a933b4-18a9-416c-a1dc-4ae3f32cf3d7 None admin] RBAC: Adding query filter params (group.id=f7a013e97dd848a98ff628c919d30efd, role.id=7d8b0827910944f29bfa3a92d6cb7c92, scope.project.id=746cf064ee5344ddb5daa2377fd66d25) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:47.286233 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a933b4-18a9-416c-a1dc-4ae3f32cf3d7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:47.287895 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a933b4-18a9-416c-a1dc-4ae3f32cf3d7 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:47.295656 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 221/451] 10.222.0.70 () {56 vars in 1376 bytes} [Mon Jul 11 14:26:47 2022] GET /identity/v3/role_assignments?group.id=f7a013e97dd848a98ff628c919d30efd&scope.project.id=746cf064ee5344ddb5daa2377fd66d25&role.id=7d8b0827910944f29bfa3a92d6cb7c92 => generated 611 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:26:47.336270 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 231/452] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Jul 11 14:26:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 14:26:47.342343 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a933b4-18a9-416c-a1dc-4ae3f32cf3d7 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:47.424469 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:47.498414 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a933b4-18a9-416c-a1dc-4ae3f32cf3d7 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:47.545091 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360dc754-3090-44cb-ad43-1614a50725b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:47.546027 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360dc754-3090-44cb-ad43-1614a50725b6 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:47.546419 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360dc754-3090-44cb-ad43-1614a50725b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:47.546794 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360dc754-3090-44cb-ad43-1614a50725b6 None admin] PATH_INFO: `/v3/projects/3a62c198ecd94c498e9bd153b3d4226c` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:47.548596 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360dc754-3090-44cb-ad43-1614a50725b6 None admin] RBAC: Authorizing `identity:get_project(project_id=3a62c198ecd94c498e9bd153b3d4226c)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:47.550380 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360dc754-3090-44cb-ad43-1614a50725b6 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:47.553321 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 222/453] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Jul 11 14:26:47 2022] GET /identity/v3/projects/3a62c198ecd94c498e9bd153b3d4226c => generated 344 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:47.561834 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7956f3b-4798-4c99-ba61-718cb25166cf None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:47.706860 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7956f3b-4798-4c99-ba61-718cb25166cf None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:47.761875 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9f11f2-a76c-4a70-b645-ee5a35a422ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:47.762852 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9f11f2-a76c-4a70-b645-ee5a35a422ac None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:47.763136 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9f11f2-a76c-4a70-b645-ee5a35a422ac None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:47.763415 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9f11f2-a76c-4a70-b645-ee5a35a422ac None admin] PATH_INFO: `/v3/groups/151fdd7d8679421c811416d3a12ed8b7` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:47.764761 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9f11f2-a76c-4a70-b645-ee5a35a422ac None admin] RBAC: Authorizing `identity:get_group(group_id=151fdd7d8679421c811416d3a12ed8b7)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:47.766243 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9f11f2-a76c-4a70-b645-ee5a35a422ac None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:47.767965 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 232/454] 10.222.0.70 () {56 vars in 1180 bytes} [Mon Jul 11 14:26:47 2022] GET /identity/v3/groups/151fdd7d8679421c811416d3a12ed8b7 => generated 229 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:26:47.778217 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360dc754-3090-44cb-ad43-1614a50725b6 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:47.894342 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360dc754-3090-44cb-ad43-1614a50725b6 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:47.925234 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:47.932558 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636b5843-892e-4d26-a7d2-66b74699041d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:47.933500 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636b5843-892e-4d26-a7d2-66b74699041d None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:47.933782 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636b5843-892e-4d26-a7d2-66b74699041d None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:47.934055 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636b5843-892e-4d26-a7d2-66b74699041d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:47.934917 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636b5843-892e-4d26-a7d2-66b74699041d None admin] RBAC: Adding query filter params (group.id=151fdd7d8679421c811416d3a12ed8b7, role.id=b46df176b0fe479da63c318db225bed4, scope.project.id=3a62c198ecd94c498e9bd153b3d4226c) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:47.935231 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636b5843-892e-4d26-a7d2-66b74699041d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:47.936793 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636b5843-892e-4d26-a7d2-66b74699041d None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:47.945150 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 223/455] 10.222.0.70 () {56 vars in 1376 bytes} [Mon Jul 11 14:26:47 2022] GET /identity/v3/role_assignments?group.id=151fdd7d8679421c811416d3a12ed8b7&scope.project.id=3a62c198ecd94c498e9bd153b3d4226c&role.id=b46df176b0fe479da63c318db225bed4 => generated 611 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:26:50.820771 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc0d1e2-11f1-4d46-a7cf-593461585305 None None] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:50.821594 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc0d1e2-11f1-4d46-a7cf-593461585305 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:50.821594 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc0d1e2-11f1-4d46-a7cf-593461585305 None None] PATH_INFO: `/` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:50.823269 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 233/456] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:26:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:26:50.828748 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d7f665-8bf9-40cd-8248-2c611328e7e8 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:50.829486 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d7f665-8bf9-40cd-8248-2c611328e7e8 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:50.829486 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d7f665-8bf9-40cd-8248-2c611328e7e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:50.857443 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-e7d7f665-8bf9-40cd-8248-2c611328e7e8 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:26:50.858843 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-e7d7f665-8bf9-40cd-8248-2c611328e7e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:26:50.962736 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 224/457] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:26:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:26:51.011932 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc0d1e2-11f1-4d46-a7cf-593461585305 None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:51.039011 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:51.169890 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc0d1e2-11f1-4d46-a7cf-593461585305 None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:51.219358 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6beac23-be3b-4453-831d-35d0ef96bec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:51.220171 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6beac23-be3b-4453-831d-35d0ef96bec9 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:51.220480 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6beac23-be3b-4453-831d-35d0ef96bec9 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:51.220756 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6beac23-be3b-4453-831d-35d0ef96bec9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:51.232641 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6beac23-be3b-4453-831d-35d0ef96bec9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:51.234316 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6beac23-be3b-4453-831d-35d0ef96bec9 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:51.264723 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application [None req-b6beac23-be3b-4453-831d-35d0ef96bec9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:26:51.264723 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:51.264723 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:26:51.264723 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:26:51.264723 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:26:51.264723 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:26:51.264723 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:26:51.264723 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:26:51.264723 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:26:51.264723 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:26:51.264723 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:26:51.264723 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:26:51.264723 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:26:51.264723 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:26:51.264723 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:26:51.266593 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:26:51.266593 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:26:51.266593 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:26:51.266593 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:26:51.266593 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:26:51.266593 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:26:51.266593 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:26:51.266593 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:26:51.266593 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application with Lock( Jul 11 14:26:51.266593 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:26:51.266593 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:26:51.266593 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:26:51.266593 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:26:51.266593 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:26:51.266593 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:26:51.266593 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:26:51.266593 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:26:51.268730 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:26:51.268730 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:26:51.268730 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:26:51.268730 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Jul 11 14:26:51.268730 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 234/458] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 11 14:26:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:26:51.271870 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d7f665-8bf9-40cd-8248-2c611328e7e8 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:51.422371 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d7f665-8bf9-40cd-8248-2c611328e7e8 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:51.464069 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:51.479418 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c7b0f5-f010-4e57-9cd7-8e121ca496fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:51.480103 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c7b0f5-f010-4e57-9cd7-8e121ca496fc None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:51.480427 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c7b0f5-f010-4e57-9cd7-8e121ca496fc None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:51.480702 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c7b0f5-f010-4e57-9cd7-8e121ca496fc None admin] PATH_INFO: `/v3/domains` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:51.481441 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c7b0f5-f010-4e57-9cd7-8e121ca496fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:51.481745 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c7b0f5-f010-4e57-9cd7-8e121ca496fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:51.483147 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c7b0f5-f010-4e57-9cd7-8e121ca496fc None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:51.490018 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f1fd58-28e3-4f87-b3e1-3042829a6c92 None None] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:51.490288 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f1fd58-28e3-4f87-b3e1-3042829a6c92 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:51.490555 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f1fd58-28e3-4f87-b3e1-3042829a6c92 None None] PATH_INFO: `/` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:51.492256 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 235/459] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:26:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:26:51.498961 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 225/460] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jul 11 14:26:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:51.505405 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d5a848-9209-4d37-9e7d-9697e0f0d5d7 None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:51.505771 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d5a848-9209-4d37-9e7d-9697e0f0d5d7 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:51.506022 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d5a848-9209-4d37-9e7d-9697e0f0d5d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:51.508285 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c7b0f5-f010-4e57-9cd7-8e121ca496fc None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:51.546021 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-d1d5a848-9209-4d37-9e7d-9697e0f0d5d7 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:26:51.548676 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-d1d5a848-9209-4d37-9e7d-9697e0f0d5d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:26:51.631860 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c7b0f5-f010-4e57-9cd7-8e121ca496fc None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:51.642833 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:51.653995 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 236/461] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:26:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:26:51.656355 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc414d67-90a7-4989-9a50-ae1441b77cf6 None None] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:51.656847 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc414d67-90a7-4989-9a50-ae1441b77cf6 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:51.657275 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc414d67-90a7-4989-9a50-ae1441b77cf6 None None] PATH_INFO: `/` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:51.664755 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 237/462] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:26:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:26:51.674540 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf97f07b-ac74-4553-8b4b-f01c91f48381 None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:51.675235 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf97f07b-ac74-4553-8b4b-f01c91f48381 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:51.676058 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf97f07b-ac74-4553-8b4b-f01c91f48381 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:51.692594 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c79630c-ba26-4d7a-b278-0643c075caab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:51.693590 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c79630c-ba26-4d7a-b278-0643c075caab None admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:51.694058 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c79630c-ba26-4d7a-b278-0643c075caab None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:51.694348 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c79630c-ba26-4d7a-b278-0643c075caab None admin] PATH_INFO: `/v3/users` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:51.695074 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c79630c-ba26-4d7a-b278-0643c075caab None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:51.696580 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c79630c-ba26-4d7a-b278-0643c075caab None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:51.703514 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-bf97f07b-ac74-4553-8b4b-f01c91f48381 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:26:51.705292 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-bf97f07b-ac74-4553-8b4b-f01c91f48381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:26:51.719690 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 226/463] 10.222.0.70 () {60 vars in 1132 bytes} [Mon Jul 11 14:26:51 2022] POST /identity/v3/users => generated 248 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:26:51.721036 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c79630c-ba26-4d7a-b278-0643c075caab None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:51.776190 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:51.799974 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 238/464] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:26:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:26:51.838864 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf97f07b-ac74-4553-8b4b-f01c91f48381 None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:51.928830 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c79630c-ba26-4d7a-b278-0643c075caab None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:52.001440 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d7c097-e32d-44ad-9db2-56f9981b9bfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:52.001902 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d7c097-e32d-44ad-9db2-56f9981b9bfb None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:52.002164 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d7c097-e32d-44ad-9db2-56f9981b9bfb None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:52.002432 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d7c097-e32d-44ad-9db2-56f9981b9bfb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:52.017849 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d7c097-e32d-44ad-9db2-56f9981b9bfb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:52.019413 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d7c097-e32d-44ad-9db2-56f9981b9bfb None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:52.041506 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-59d7c097-e32d-44ad-9db2-56f9981b9bfb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:26:52.041506 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:52.041506 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:26:52.041506 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:26:52.041506 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:26:52.041506 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:26:52.041506 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:26:52.041506 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:26:52.041506 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:26:52.041506 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:26:52.041506 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:26:52.041506 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:26:52.041506 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:26:52.041506 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:26:52.041506 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:26:52.042866 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:26:52.042866 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:26:52.042866 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:26:52.042866 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:26:52.042866 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:26:52.042866 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:26:52.042866 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:26:52.042866 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:26:52.042866 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( Jul 11 14:26:52.042866 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:26:52.042866 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:26:52.042866 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:26:52.042866 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:26:52.042866 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:26:52.042866 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:26:52.042866 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:26:52.042866 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:26:52.045415 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:26:52.045415 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:26:52.045415 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:26:52.045415 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Jul 11 14:26:52.045415 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 227/465] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 11 14:26:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:26:52.049251 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d7c097-e32d-44ad-9db2-56f9981b9bfb None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:52.057232 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf97f07b-ac74-4553-8b4b-f01c91f48381 None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:52.096615 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:52.111659 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525925b5-694c-4860-a165-b7077ca48422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:52.111659 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525925b5-694c-4860-a165-b7077ca48422 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:52.112087 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525925b5-694c-4860-a165-b7077ca48422 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:52.112087 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525925b5-694c-4860-a165-b7077ca48422 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:52.127738 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525925b5-694c-4860-a165-b7077ca48422 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:52.129944 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525925b5-694c-4860-a165-b7077ca48422 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:52.150632 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application [None req-525925b5-694c-4860-a165-b7077ca48422 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:26:52.150632 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:52.150632 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:26:52.150632 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:26:52.150632 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:26:52.150632 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:26:52.150632 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:26:52.150632 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:26:52.150632 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:26:52.150632 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:26:52.150632 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:26:52.150632 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:26:52.150632 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:26:52.150632 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:26:52.150632 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:26:52.151531 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:26:52.151531 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:26:52.151531 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:26:52.151531 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:26:52.151531 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:26:52.151531 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:26:52.151531 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:26:52.151531 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:26:52.151531 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application with Lock( Jul 11 14:26:52.151531 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:26:52.151531 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:26:52.151531 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:26:52.151531 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:26:52.151531 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:26:52.151531 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:26:52.151531 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:26:52.151531 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:26:52.152414 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:26:52.152414 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:26:52.152414 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:26:52.152414 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Jul 11 14:26:52.159203 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 239/466] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 11 14:26:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:26:52.159203 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562e03d3-6550-4405-b504-ac70fa27cd22 None None] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:52.159482 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562e03d3-6550-4405-b504-ac70fa27cd22 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:52.159737 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562e03d3-6550-4405-b504-ac70fa27cd22 None None] PATH_INFO: `/` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:52.164844 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 240/467] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:26:52 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:26:52.164844 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562e03d3-6550-4405-b504-ac70fa27cd22 None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:52.190767 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:52.208171 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d7c097-e32d-44ad-9db2-56f9981b9bfb None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:52.283628 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72071718-f597-46e8-9cd6-ffa0c63271f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:52.285405 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72071718-f597-46e8-9cd6-ffa0c63271f7 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:52.285405 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72071718-f597-46e8-9cd6-ffa0c63271f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:52.285405 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72071718-f597-46e8-9cd6-ffa0c63271f7 None admin] PATH_INFO: `/v3/domains` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:52.287178 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72071718-f597-46e8-9cd6-ffa0c63271f7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:52.287652 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72071718-f597-46e8-9cd6-ffa0c63271f7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:52.289422 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72071718-f597-46e8-9cd6-ffa0c63271f7 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:52.310602 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 228/468] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jul 11 14:26:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:52.311075 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562e03d3-6550-4405-b504-ac70fa27cd22 None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:52.313507 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcde565-de30-4f2c-bf36-461c4ead6664 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:52.314196 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcde565-de30-4f2c-bf36-461c4ead6664 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:52.314803 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcde565-de30-4f2c-bf36-461c4ead6664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:52.353389 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-edcde565-de30-4f2c-bf36-461c4ead6664 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:26:52.355736 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-edcde565-de30-4f2c-bf36-461c4ead6664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:26:52.381388 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0d2e88-cf71-4445-b8c6-3d6e5eb7e574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:52.382851 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0d2e88-cf71-4445-b8c6-3d6e5eb7e574 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:52.383626 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0d2e88-cf71-4445-b8c6-3d6e5eb7e574 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:52.384324 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0d2e88-cf71-4445-b8c6-3d6e5eb7e574 None admin] PATH_INFO: `/v3/domains` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:52.385359 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0d2e88-cf71-4445-b8c6-3d6e5eb7e574 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:52.386044 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0d2e88-cf71-4445-b8c6-3d6e5eb7e574 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:52.388317 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0d2e88-cf71-4445-b8c6-3d6e5eb7e574 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:52.406459 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 241/469] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jul 11 14:26:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:52.413079 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0d2e88-cf71-4445-b8c6-3d6e5eb7e574 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:52.462951 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 229/470] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:26:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:26:52.463724 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcde565-de30-4f2c-bf36-461c4ead6664 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:52.482562 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:52.587887 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:52.608454 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcde565-de30-4f2c-bf36-461c4ead6664 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:52.612291 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0d2e88-cf71-4445-b8c6-3d6e5eb7e574 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:52.651435 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8661bf-5879-4917-bc56-1264b7369878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:52.652153 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8661bf-5879-4917-bc56-1264b7369878 None admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:52.652660 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8661bf-5879-4917-bc56-1264b7369878 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:52.653124 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8661bf-5879-4917-bc56-1264b7369878 None admin] PATH_INFO: `/v3/users` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:52.654015 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8661bf-5879-4917-bc56-1264b7369878 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:52.655671 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8661bf-5879-4917-bc56-1264b7369878 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:52.677311 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82722e44-bda8-4d13-9560-13501b1ca7ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:52.678492 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82722e44-bda8-4d13-9560-13501b1ca7ee None admin] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:52.679009 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82722e44-bda8-4d13-9560-13501b1ca7ee None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:52.679523 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82722e44-bda8-4d13-9560-13501b1ca7ee None admin] PATH_INFO: `/v3/users` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:52.680772 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82722e44-bda8-4d13-9560-13501b1ca7ee None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:52.680931 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 230/471] 10.222.0.70 () {60 vars in 1132 bytes} [Mon Jul 11 14:26:52 2022] POST /identity/v3/users => generated 246 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:26:52.682363 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8661bf-5879-4917-bc56-1264b7369878 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:52.692737 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82722e44-bda8-4d13-9560-13501b1ca7ee None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:52.743310 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 242/472] 10.222.0.70 () {60 vars in 1132 bytes} [Mon Jul 11 14:26:52 2022] POST /identity/v3/users => generated 248 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:26:52.818489 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8661bf-5879-4917-bc56-1264b7369878 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:52.860992 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be96f1ef-fa59-4a8c-8ba2-8fe9b4f4a233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:52.861881 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be96f1ef-fa59-4a8c-8ba2-8fe9b4f4a233 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:52.862171 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be96f1ef-fa59-4a8c-8ba2-8fe9b4f4a233 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:52.862452 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be96f1ef-fa59-4a8c-8ba2-8fe9b4f4a233 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:52.870866 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:52.875935 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be96f1ef-fa59-4a8c-8ba2-8fe9b4f4a233 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:52.882267 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be96f1ef-fa59-4a8c-8ba2-8fe9b4f4a233 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:52.906845 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-be96f1ef-fa59-4a8c-8ba2-8fe9b4f4a233 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:26:52.906845 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:52.906845 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:26:52.906845 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:26:52.906845 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:26:52.906845 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:26:52.906845 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:26:52.906845 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:26:52.906845 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:26:52.906845 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:26:52.906845 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:26:52.906845 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:26:52.906845 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:26:52.906845 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:26:52.906845 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:26:52.908590 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:26:52.908590 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:26:52.908590 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:26:52.908590 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:26:52.908590 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:26:52.908590 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:26:52.908590 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:26:52.908590 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:26:52.908590 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( Jul 11 14:26:52.908590 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:26:52.908590 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:26:52.908590 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:26:52.908590 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:26:52.908590 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:26:52.908590 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:26:52.908590 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:26:52.908590 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:26:52.911418 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:26:52.911418 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:26:52.911418 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:26:52.911418 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Jul 11 14:26:52.914326 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 231/473] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 11 14:26:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:26:52.915814 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82722e44-bda8-4d13-9560-13501b1ca7ee None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:53.037657 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca9a5be-4966-43b6-9dd4-92130d8a1837 None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:53.038426 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca9a5be-4966-43b6-9dd4-92130d8a1837 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:53.038426 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca9a5be-4966-43b6-9dd4-92130d8a1837 None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:53.039818 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 232/474] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:26:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:26:53.045259 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f664cb-82c2-421f-abb8-5e45a37e632e None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:53.045625 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f664cb-82c2-421f-abb8-5e45a37e632e None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:53.045955 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f664cb-82c2-421f-abb8-5e45a37e632e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:53.086343 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-f5f664cb-82c2-421f-abb8-5e45a37e632e None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:26:53.087887 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-f5f664cb-82c2-421f-abb8-5e45a37e632e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:26:53.126537 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:53.135055 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82722e44-bda8-4d13-9560-13501b1ca7ee None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:53.181379 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e1c164-6395-44ad-9463-d206287643ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:53.183443 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e1c164-6395-44ad-9463-d206287643ea None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:53.183990 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e1c164-6395-44ad-9463-d206287643ea None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:53.184781 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e1c164-6395-44ad-9463-d206287643ea None admin] PATH_INFO: `/v3/domains` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:53.185903 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e1c164-6395-44ad-9463-d206287643ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:53.186673 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e1c164-6395-44ad-9463-d206287643ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:53.188619 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 233/475] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:26:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 14:26:53.189132 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e1c164-6395-44ad-9463-d206287643ea None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:53.206326 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 243/476] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jul 11 14:26:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:53.212580 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f664cb-82c2-421f-abb8-5e45a37e632e None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:53.222925 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e1c164-6395-44ad-9463-d206287643ea None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:53.340530 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f664cb-82c2-421f-abb8-5e45a37e632e None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:53.367370 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:53.385094 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404a4afd-fbbd-432e-892e-247f0e8a1087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:53.385882 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404a4afd-fbbd-432e-892e-247f0e8a1087 None admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:53.386180 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404a4afd-fbbd-432e-892e-247f0e8a1087 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:53.386453 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404a4afd-fbbd-432e-892e-247f0e8a1087 None admin] PATH_INFO: `/v3/users` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:53.387803 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404a4afd-fbbd-432e-892e-247f0e8a1087 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:53.389309 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404a4afd-fbbd-432e-892e-247f0e8a1087 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:53.413340 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 234/477] 10.222.0.70 () {60 vars in 1132 bytes} [Mon Jul 11 14:26:53 2022] POST /identity/v3/users => generated 249 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:26:53.527469 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e1c164-6395-44ad-9463-d206287643ea None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:53.586411 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28532216-9ee6-4042-a814-22375448f1fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:53.587101 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28532216-9ee6-4042-a814-22375448f1fc None admin] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:53.587389 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28532216-9ee6-4042-a814-22375448f1fc None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:53.587668 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28532216-9ee6-4042-a814-22375448f1fc None admin] PATH_INFO: `/v3/roles` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:53.588459 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28532216-9ee6-4042-a814-22375448f1fc None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:53.589865 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28532216-9ee6-4042-a814-22375448f1fc None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:53.601495 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.sql.core [None req-28532216-9ee6-4042-a814-22375448f1fc None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 11 14:26:53.601495 dv-cinder-master-3-smb devstack@keystone.service[80534]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 11 14:26:53.601495 dv-cinder-master-3-smb devstack@keystone.service[80534]: [parameters: {'id': '928471b95984420ab6bd8778040321ab', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 11 14:26:53.601495 dv-cinder-master-3-smb devstack@keystone.service[80534]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80534) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 11 14:26:53.618269 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application [None req-28532216-9ee6-4042-a814-22375448f1fc None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 11 14:26:53.618269 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:53.618269 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 11 14:26:53.618269 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 11 14:26:53.618269 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 11 14:26:53.618269 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 11 14:26:53.618269 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 11 14:26:53.618269 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application result = self._query(query) Jul 11 14:26:53.618269 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 11 14:26:53.618269 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application conn.query(q) Jul 11 14:26:53.618269 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 11 14:26:53.618269 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 11 14:26:53.618269 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 11 14:26:53.618269 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application result.read() Jul 11 14:26:53.618269 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 11 14:26:53.619205 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 11 14:26:53.619205 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 11 14:26:53.619205 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 11 14:26:53.619205 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 11 14:26:53.619205 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 11 14:26:53.619205 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 11 14:26:53.619205 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 11 14:26:53.619205 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 11 14:26:53.619205 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Jul 11 14:26:53.619205 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 11 14:26:53.619205 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Jul 11 14:26:53.619205 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:53.619205 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 11 14:26:53.619205 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 11 14:26:53.619205 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jul 11 14:26:53.619205 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return ref.to_dict() Jul 11 14:26:53.619205 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 11 14:26:53.619205 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application next(self.gen) Jul 11 14:26:53.620121 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 11 14:26:53.620121 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application yield resource Jul 11 14:26:53.620121 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 11 14:26:53.620121 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application next(self.gen) Jul 11 14:26:53.620121 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 11 14:26:53.620121 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application self.session.rollback() Jul 11 14:26:53.620121 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 11 14:26:53.620121 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application self.force_reraise() Jul 11 14:26:53.620121 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 11 14:26:53.620121 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application raise self.value Jul 11 14:26:53.620121 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 11 14:26:53.620121 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 11 14:26:53.620121 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 11 14:26:53.620121 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application session.commit() Jul 11 14:26:53.620121 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 11 14:26:53.620121 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 11 14:26:53.620121 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 11 14:26:53.621041 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application self._prepare_impl() Jul 11 14:26:53.621041 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 11 14:26:53.621041 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application self.session.flush() Jul 11 14:26:53.621041 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 11 14:26:53.621041 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application self._flush(objects) Jul 11 14:26:53.621041 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 11 14:26:53.621041 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 11 14:26:53.621041 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 11 14:26:53.621041 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application compat.raise_( Jul 11 14:26:53.621041 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 11 14:26:53.621041 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application raise exception Jul 11 14:26:53.621041 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 11 14:26:53.621041 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application flush_context.execute() Jul 11 14:26:53.621041 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 11 14:26:53.621041 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application rec.execute(self) Jul 11 14:26:53.621041 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 11 14:26:53.621041 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 11 14:26:53.621948 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 11 14:26:53.621948 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 11 14:26:53.621948 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 11 14:26:53.621948 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 11 14:26:53.621948 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 11 14:26:53.621948 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 11 14:26:53.621948 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 11 14:26:53.621948 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 11 14:26:53.621948 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 11 14:26:53.621948 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 11 14:26:53.621948 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 11 14:26:53.621948 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 11 14:26:53.621948 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 11 14:26:53.621948 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 11 14:26:53.621948 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 11 14:26:53.621948 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application raise exception Jul 11 14:26:53.622770 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 11 14:26:53.622770 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 11 14:26:53.622770 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 11 14:26:53.622770 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 11 14:26:53.622770 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 11 14:26:53.622770 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application result = self._query(query) Jul 11 14:26:53.622770 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 11 14:26:53.622770 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application conn.query(q) Jul 11 14:26:53.622770 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 11 14:26:53.622770 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 11 14:26:53.622770 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 11 14:26:53.622770 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application result.read() Jul 11 14:26:53.622770 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 11 14:26:53.622770 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 11 14:26:53.622770 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 11 14:26:53.622770 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 11 14:26:53.623543 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 11 14:26:53.623543 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 11 14:26:53.623543 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 11 14:26:53.623543 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 11 14:26:53.623543 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 11 14:26:53.623543 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 11 14:26:53.623543 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application [parameters: {'id': '928471b95984420ab6bd8778040321ab', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 11 14:26:53.623543 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 11 14:26:53.623543 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Jul 11 14:26:53.623543 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 14:26:53.623543 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Jul 11 14:26:53.623543 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:53.623543 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:26:53.623543 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:26:53.623543 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:26:53.623543 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:26:53.625955 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:26:53.625955 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:26:53.625955 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:26:53.625955 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:26:53.625955 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:26:53.625955 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:26:53.625955 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jul 11 14:26:53.625955 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jul 11 14:26:53.625955 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:26:53.625955 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:26:53.625955 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jul 11 14:26:53.625955 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jul 11 14:26:53.625955 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 11 14:26:53.625955 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 11 14:26:53.625955 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 11 14:26:53.625955 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Jul 11 14:26:53.627899 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 244/478] 10.222.0.70 () {60 vars in 1131 bytes} [Mon Jul 11 14:26:53 2022] POST /identity/v3/roles => generated 144 bytes in 398 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:26:53.628049 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404a4afd-fbbd-432e-892e-247f0e8a1087 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:53.778189 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404a4afd-fbbd-432e-892e-247f0e8a1087 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:53.816185 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacae00a-69e3-499d-97b2-d518c72002a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:53.817989 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacae00a-69e3-499d-97b2-d518c72002a1 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:53.818276 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacae00a-69e3-499d-97b2-d518c72002a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:53.818553 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacae00a-69e3-499d-97b2-d518c72002a1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:53.830699 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacae00a-69e3-499d-97b2-d518c72002a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:26:53.839479 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-cacae00a-69e3-499d-97b2-d518c72002a1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 14:26:53.839479 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:53.839479 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:26:53.839479 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:26:53.839479 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:26:53.839479 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:26:53.839479 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:26:53.839479 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:26:53.839479 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:26:53.839479 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:26:53.839479 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:26:53.839479 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:26:53.839479 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:26:53.839479 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:26:53.839479 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:26:53.839479 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:26:53.841686 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:26:53.841686 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:26:53.841686 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:26:53.841686 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:26:53.841686 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:26:53.841686 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:26:53.841686 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:26:53.841686 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:26:53.841686 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:26:53.841686 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:26:53.841686 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:26:53.841686 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( Jul 11 14:26:53.841686 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:26:53.841686 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:26:53.841686 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:26:53.841686 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:26:53.843609 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:26:53.843609 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:26:53.843609 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:26:53.843609 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:26:53.843609 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:26:53.843609 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:26:53.843609 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:26:53.843609 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:26:53.843609 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:26:53.843609 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:26:53.843609 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 14:26:53.843609 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Jul 11 14:26:53.843609 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 235/479] 10.222.0.70 () {56 vars in 1114 bytes} [Mon Jul 11 14:26:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:26:53.846678 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28532216-9ee6-4042-a814-22375448f1fc None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:53.877110 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:53.964733 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28532216-9ee6-4042-a814-22375448f1fc None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:54.002981 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1cfff4-955f-4c4c-84a0-02c07f1e2b18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:54.003672 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1cfff4-955f-4c4c-84a0-02c07f1e2b18 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:54.004519 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1cfff4-955f-4c4c-84a0-02c07f1e2b18 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:54.004799 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1cfff4-955f-4c4c-84a0-02c07f1e2b18 None admin] PATH_INFO: `/v3/roles` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:54.005566 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1cfff4-955f-4c4c-84a0-02c07f1e2b18 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:54.005873 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1cfff4-955f-4c4c-84a0-02c07f1e2b18 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:54.007272 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1cfff4-955f-4c4c-84a0-02c07f1e2b18 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:54.016919 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 245/480] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Jul 11 14:26:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:54.424165 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bf8ea6-f9af-4559-9dce-198cff36d7cb None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:54.425007 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bf8ea6-f9af-4559-9dce-198cff36d7cb None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:54.425007 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bf8ea6-f9af-4559-9dce-198cff36d7cb None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:54.427852 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 236/481] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:26:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:26:54.435338 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dd9f3c-a570-4413-baa9-2e885a7d2cf1 None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:54.436154 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dd9f3c-a570-4413-baa9-2e885a7d2cf1 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:54.437010 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dd9f3c-a570-4413-baa9-2e885a7d2cf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:54.464457 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-95dd9f3c-a570-4413-baa9-2e885a7d2cf1 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:26:54.466340 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-95dd9f3c-a570-4413-baa9-2e885a7d2cf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:26:54.561852 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 246/482] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:26:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:26:54.595714 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bf8ea6-f9af-4559-9dce-198cff36d7cb None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:54.672141 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:54.787456 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bf8ea6-f9af-4559-9dce-198cff36d7cb None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:54.843822 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac785f4-1c79-4f09-a930-372b9f4fbfd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:54.844665 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac785f4-1c79-4f09-a930-372b9f4fbfd2 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:54.844946 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac785f4-1c79-4f09-a930-372b9f4fbfd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:54.845219 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac785f4-1c79-4f09-a930-372b9f4fbfd2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:54.865707 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac785f4-1c79-4f09-a930-372b9f4fbfd2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:26:54.873728 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-bac785f4-1c79-4f09-a930-372b9f4fbfd2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:26:54.873728 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:54.873728 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:26:54.873728 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:26:54.873728 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:26:54.873728 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:26:54.873728 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:26:54.873728 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:26:54.873728 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:26:54.873728 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:26:54.873728 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:26:54.873728 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:26:54.873728 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:26:54.873728 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:26:54.873728 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:26:54.873728 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:26:54.874695 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:26:54.874695 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:26:54.874695 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:26:54.874695 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:26:54.874695 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:26:54.874695 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:26:54.874695 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:26:54.874695 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:26:54.874695 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:26:54.874695 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:26:54.874695 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:26:54.874695 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( Jul 11 14:26:54.874695 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:26:54.874695 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:26:54.874695 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:26:54.874695 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:26:54.875480 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:26:54.875480 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:26:54.875480 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:26:54.875480 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:26:54.875480 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:26:54.875480 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:26:54.875480 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:26:54.875480 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:26:54.875480 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:26:54.875480 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:26:54.875480 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:26:54.875480 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Jul 11 14:26:54.880484 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 237/483] 10.222.0.70 () {56 vars in 1102 bytes} [Mon Jul 11 14:26:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:26:54.885381 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dd9f3c-a570-4413-baa9-2e885a7d2cf1 None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:54.909671 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:55.054188 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dd9f3c-a570-4413-baa9-2e885a7d2cf1 None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:55.121134 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45945052-5292-448c-a31d-d9d89a2f7141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:55.121844 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45945052-5292-448c-a31d-d9d89a2f7141 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:55.122129 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45945052-5292-448c-a31d-d9d89a2f7141 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:55.122405 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45945052-5292-448c-a31d-d9d89a2f7141 None admin] PATH_INFO: `/v3/roles` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:55.123177 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45945052-5292-448c-a31d-d9d89a2f7141 None admin] RBAC: Adding query filter params (name=service) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:55.123487 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45945052-5292-448c-a31d-d9d89a2f7141 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:55.124920 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45945052-5292-448c-a31d-d9d89a2f7141 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:55.137327 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 247/484] 10.222.0.70 () {56 vars in 1103 bytes} [Mon Jul 11 14:26:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:55.147376 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac785f4-1c79-4f09-a930-372b9f4fbfd2 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:55.391737 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:55.403179 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac785f4-1c79-4f09-a930-372b9f4fbfd2 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:55.456832 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb60110-5f5b-4f39-9f53-13289d928f73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:55.458129 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb60110-5f5b-4f39-9f53-13289d928f73 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:55.458585 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb60110-5f5b-4f39-9f53-13289d928f73 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:55.459042 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb60110-5f5b-4f39-9f53-13289d928f73 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:55.474963 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb60110-5f5b-4f39-9f53-13289d928f73 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:55.477763 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb60110-5f5b-4f39-9f53-13289d928f73 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:55.508224 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-4fb60110-5f5b-4f39-9f53-13289d928f73 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:26:55.508224 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:55.508224 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:26:55.508224 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:26:55.508224 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:26:55.508224 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:26:55.508224 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:26:55.508224 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:26:55.508224 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:26:55.508224 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:26:55.508224 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:26:55.508224 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:26:55.508224 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:26:55.508224 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:26:55.508224 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:26:55.509144 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:26:55.509144 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:26:55.509144 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:26:55.509144 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:26:55.509144 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:26:55.509144 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:26:55.509144 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:26:55.509144 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:26:55.509144 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( Jul 11 14:26:55.509144 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:26:55.509144 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:26:55.509144 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:26:55.509144 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:26:55.509144 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:26:55.509144 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:26:55.509144 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:26:55.509144 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:26:55.509997 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:26:55.509997 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:26:55.509997 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:26:55.509997 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Jul 11 14:26:55.514103 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 238/485] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 11 14:26:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 364 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:26:55.521400 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45945052-5292-448c-a31d-d9d89a2f7141 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:55.725211 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:55.791433 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45945052-5292-448c-a31d-d9d89a2f7141 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:55.798329 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d3dfa5-8f55-4c2c-8c11-36187ec3af51 None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:55.798638 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d3dfa5-8f55-4c2c-8c11-36187ec3af51 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:55.798900 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d3dfa5-8f55-4c2c-8c11-36187ec3af51 None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:55.802971 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 239/486] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:26:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:26:55.807978 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d31d79-411a-440c-87b9-ac1315ccd57b None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:55.808311 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d31d79-411a-440c-87b9-ac1315ccd57b None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:55.808663 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d31d79-411a-440c-87b9-ac1315ccd57b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:55.831129 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-43d31d79-411a-440c-87b9-ac1315ccd57b None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:26:55.833050 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-43d31d79-411a-440c-87b9-ac1315ccd57b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:26:55.865408 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f120a009-51b1-43e2-ab36-d4af9d2cfe4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:55.866559 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f120a009-51b1-43e2-ab36-d4af9d2cfe4d None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:55.867052 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f120a009-51b1-43e2-ab36-d4af9d2cfe4d None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:55.868490 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f120a009-51b1-43e2-ab36-d4af9d2cfe4d None admin] PATH_INFO: `/v3/domains` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:55.869676 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f120a009-51b1-43e2-ab36-d4af9d2cfe4d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:55.871884 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f120a009-51b1-43e2-ab36-d4af9d2cfe4d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:55.874433 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f120a009-51b1-43e2-ab36-d4af9d2cfe4d None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:55.901202 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 248/487] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jul 11 14:26:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 380 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:55.906404 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f120a009-51b1-43e2-ab36-d4af9d2cfe4d None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:55.983479 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 240/488] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:26:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 14:26:55.985616 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cc7d52-b319-4d37-942a-ce6b05978846 None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:55.986115 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cc7d52-b319-4d37-942a-ce6b05978846 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:55.986566 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cc7d52-b319-4d37-942a-ce6b05978846 None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:56.000247 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 241/489] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:26:55 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:26:56.000247 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42da624e-f2a5-4a90-9c86-0640677ce162 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:56.000247 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42da624e-f2a5-4a90-9c86-0640677ce162 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:56.000247 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42da624e-f2a5-4a90-9c86-0640677ce162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:56.031090 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-42da624e-f2a5-4a90-9c86-0640677ce162 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:26:56.033528 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-42da624e-f2a5-4a90-9c86-0640677ce162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:26:56.060780 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f120a009-51b1-43e2-ab36-d4af9d2cfe4d None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:56.110063 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61d78c6-a171-4a87-b419-d9c5b1701d2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:56.111552 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61d78c6-a171-4a87-b419-d9c5b1701d2c None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:56.112606 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61d78c6-a171-4a87-b419-d9c5b1701d2c None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:56.113113 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61d78c6-a171-4a87-b419-d9c5b1701d2c None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:56.118726 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:56.136724 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61d78c6-a171-4a87-b419-d9c5b1701d2c None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:56.139512 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61d78c6-a171-4a87-b419-d9c5b1701d2c None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:56.147196 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 242/490] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:26:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 14:26:56.148133 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42da624e-f2a5-4a90-9c86-0640677ce162 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:56.177364 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application [None req-c61d78c6-a171-4a87-b419-d9c5b1701d2c None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 11 14:26:56.177364 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:56.177364 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:26:56.177364 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:26:56.177364 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:26:56.177364 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:26:56.177364 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:26:56.177364 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:26:56.177364 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:26:56.177364 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:26:56.177364 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:26:56.177364 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:26:56.177364 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 14:26:56.177364 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 14:26:56.177364 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 14:26:56.177364 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 14:26:56.179180 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:26:56.179180 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:26:56.179180 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 14:26:56.179180 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:26:56.179180 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 14:26:56.179180 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:26:56.179180 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:26:56.179180 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:26:56.179180 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:26:56.179180 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:26:56.179180 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:26:56.179180 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application with Lock( Jul 11 14:26:56.179180 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:26:56.179180 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:26:56.179180 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:26:56.179180 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:26:56.179180 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:26:56.179180 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:26:56.180990 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:26:56.180990 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:26:56.180990 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 14:26:56.180990 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 14:26:56.180990 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 14:26:56.180990 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 14:26:56.180990 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 14:26:56.180990 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 14:26:56.180990 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 11 14:26:56.180990 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Jul 11 14:26:56.181790 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:56.181921 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 249/491] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Jul 11 14:26:55 2022] GET /identity/v3/users/cinder => generated 84 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:26:56.187542 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61d78c6-a171-4a87-b419-d9c5b1701d2c None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:56.322720 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61d78c6-a171-4a87-b419-d9c5b1701d2c None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:56.363301 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94042f85-e723-4397-aaa9-82c6003b917e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:56.364553 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94042f85-e723-4397-aaa9-82c6003b917e None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:56.364997 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94042f85-e723-4397-aaa9-82c6003b917e None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:56.365236 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94042f85-e723-4397-aaa9-82c6003b917e None admin] PATH_INFO: `/v3/users` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:56.365976 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94042f85-e723-4397-aaa9-82c6003b917e None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:56.366290 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94042f85-e723-4397-aaa9-82c6003b917e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:56.367778 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94042f85-e723-4397-aaa9-82c6003b917e None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:56.387738 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42da624e-f2a5-4a90-9c86-0640677ce162 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:56.411827 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 250/492] 10.222.0.70 () {56 vars in 1137 bytes} [Mon Jul 11 14:26:56 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:56.412760 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94042f85-e723-4397-aaa9-82c6003b917e None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:56.451752 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c667a6-d38a-40e3-abb0-22a61be1014e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:56.453457 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c667a6-d38a-40e3-abb0-22a61be1014e None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:56.453968 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c667a6-d38a-40e3-abb0-22a61be1014e None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:56.454459 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c667a6-d38a-40e3-abb0-22a61be1014e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:56.475711 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:56.477730 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c667a6-d38a-40e3-abb0-22a61be1014e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:26:56.493789 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-c2c667a6-d38a-40e3-abb0-22a61be1014e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:26:56.493789 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:56.493789 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:26:56.493789 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:26:56.493789 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:26:56.493789 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:26:56.493789 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:26:56.493789 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:26:56.493789 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:26:56.493789 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:26:56.493789 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:26:56.493789 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:26:56.493789 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:26:56.493789 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:26:56.493789 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:26:56.493789 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:26:56.497200 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:26:56.497200 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:26:56.497200 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:26:56.497200 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:26:56.497200 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:26:56.497200 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:26:56.497200 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:26:56.497200 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:26:56.497200 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:26:56.497200 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:26:56.497200 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:26:56.497200 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( Jul 11 14:26:56.497200 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:26:56.497200 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:26:56.497200 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:26:56.497200 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:26:56.500415 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:26:56.500415 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:26:56.500415 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:26:56.500415 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:26:56.500415 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:26:56.500415 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:26:56.500415 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:26:56.500415 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:26:56.500415 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:26:56.500415 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:26:56.500415 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:26:56.500415 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Jul 11 14:26:56.500415 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 243/493] 10.222.0.70 () {56 vars in 1102 bytes} [Mon Jul 11 14:26:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 347 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:26:56.500415 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c667a6-d38a-40e3-abb0-22a61be1014e None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:56.549955 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94042f85-e723-4397-aaa9-82c6003b917e None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:56.607260 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c60c328-4d0d-4609-a935-383f5f3262d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:56.608368 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c60c328-4d0d-4609-a935-383f5f3262d1 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:56.608708 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c60c328-4d0d-4609-a935-383f5f3262d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:56.608988 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c60c328-4d0d-4609-a935-383f5f3262d1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:56.615037 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:56.628226 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c60c328-4d0d-4609-a935-383f5f3262d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:26:56.639609 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application [None req-0c60c328-4d0d-4609-a935-383f5f3262d1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:26:56.639609 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:56.639609 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:26:56.639609 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:26:56.639609 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:26:56.639609 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:26:56.639609 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:26:56.639609 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:26:56.639609 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:26:56.639609 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:26:56.639609 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:26:56.639609 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:26:56.639609 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:26:56.639609 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:26:56.639609 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:26:56.639609 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:26:56.640628 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:26:56.640628 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:26:56.640628 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:26:56.640628 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:26:56.640628 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:26:56.640628 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:26:56.640628 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:26:56.640628 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:26:56.640628 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:26:56.640628 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:26:56.640628 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:26:56.640628 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application with Lock( Jul 11 14:26:56.640628 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:26:56.640628 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:26:56.640628 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:26:56.640628 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:26:56.641426 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:26:56.641426 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:26:56.641426 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:26:56.641426 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:26:56.641426 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:26:56.641426 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:26:56.641426 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:26:56.641426 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:26:56.641426 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:26:56.641426 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:26:56.641426 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:26:56.641426 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Jul 11 14:26:56.641426 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 251/494] 10.222.0.70 () {56 vars in 1102 bytes} [Mon Jul 11 14:26:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:26:56.642087 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c60c328-4d0d-4609-a935-383f5f3262d1 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:56.665340 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c667a6-d38a-40e3-abb0-22a61be1014e None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:56.711957 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26538027-495d-496a-bf3d-f4aaae9ba229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:56.712653 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26538027-495d-496a-bf3d-f4aaae9ba229 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:56.712933 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26538027-495d-496a-bf3d-f4aaae9ba229 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:56.713206 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26538027-495d-496a-bf3d-f4aaae9ba229 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:56.804220 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26538027-495d-496a-bf3d-f4aaae9ba229 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:56.807011 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26538027-495d-496a-bf3d-f4aaae9ba229 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:56.810224 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c60c328-4d0d-4609-a935-383f5f3262d1 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:56.830045 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:56.865711 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845de89a-db4c-4e4a-84f1-22f92c5a6738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:56.867169 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845de89a-db4c-4e4a-84f1-22f92c5a6738 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:56.867850 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845de89a-db4c-4e4a-84f1-22f92c5a6738 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:56.868466 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845de89a-db4c-4e4a-84f1-22f92c5a6738 None admin] PATH_INFO: `/v3/roles` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:56.869890 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845de89a-db4c-4e4a-84f1-22f92c5a6738 None admin] RBAC: Adding query filter params (name=service) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:56.870453 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845de89a-db4c-4e4a-84f1-22f92c5a6738 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:56.875803 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845de89a-db4c-4e4a-84f1-22f92c5a6738 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:56.912612 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 252/495] 10.222.0.70 () {56 vars in 1103 bytes} [Mon Jul 11 14:26:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:56.914755 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845de89a-db4c-4e4a-84f1-22f92c5a6738 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:56.935002 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:56.990147 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 244/496] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Jul 11 14:26:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 494 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 14:26:56.992017 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deabcb98-d95b-4d2d-9636-9af94e22d2eb None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:56.992473 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deabcb98-d95b-4d2d-9636-9af94e22d2eb None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:56.992758 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deabcb98-d95b-4d2d-9636-9af94e22d2eb None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:56.994472 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 245/497] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:26:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:26:56.996560 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deabcb98-d95b-4d2d-9636-9af94e22d2eb None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:57.065731 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845de89a-db4c-4e4a-84f1-22f92c5a6738 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:57.106067 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69662207-33b1-498d-82c3-8a4f272f72cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:57.106670 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69662207-33b1-498d-82c3-8a4f272f72cb None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:57.106975 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69662207-33b1-498d-82c3-8a4f272f72cb None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:57.108475 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69662207-33b1-498d-82c3-8a4f272f72cb None admin] PATH_INFO: `/v3/roles` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:57.108475 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69662207-33b1-498d-82c3-8a4f272f72cb None admin] RBAC: Adding query filter params (name=service) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:57.108475 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69662207-33b1-498d-82c3-8a4f272f72cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:57.109723 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69662207-33b1-498d-82c3-8a4f272f72cb None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:57.119525 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 253/498] 10.222.0.70 () {56 vars in 1103 bytes} [Mon Jul 11 14:26:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:57.120398 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69662207-33b1-498d-82c3-8a4f272f72cb None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:57.130743 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deabcb98-d95b-4d2d-9636-9af94e22d2eb None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:57.158999 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:57.176972 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ebf8c2-d658-43c1-b7bb-25126207a912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:57.177785 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ebf8c2-d658-43c1-b7bb-25126207a912 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:57.178062 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ebf8c2-d658-43c1-b7bb-25126207a912 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:57.178344 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ebf8c2-d658-43c1-b7bb-25126207a912 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:57.190763 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ebf8c2-d658-43c1-b7bb-25126207a912 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:57.193728 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ebf8c2-d658-43c1-b7bb-25126207a912 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:57.219537 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-60ebf8c2-d658-43c1-b7bb-25126207a912 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:26:57.219537 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:57.219537 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:26:57.219537 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:26:57.219537 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:26:57.219537 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:26:57.219537 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:26:57.219537 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:26:57.219537 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:26:57.219537 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:26:57.219537 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:26:57.219537 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:26:57.219537 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:26:57.219537 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:26:57.219537 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:26:57.220547 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:26:57.220547 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:26:57.220547 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:26:57.220547 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:26:57.220547 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:26:57.220547 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:26:57.220547 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:26:57.220547 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:26:57.220547 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( Jul 11 14:26:57.220547 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:26:57.220547 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:26:57.220547 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:26:57.220547 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:26:57.220547 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:26:57.220547 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:26:57.220547 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:26:57.220547 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:26:57.221402 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:26:57.221402 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:26:57.221402 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:26:57.221402 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Jul 11 14:26:57.221402 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 246/499] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 11 14:26:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:26:57.222162 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e5eff1-6bfd-4d33-83f5-204633769c07 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:57.222691 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e5eff1-6bfd-4d33-83f5-204633769c07 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:57.223075 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e5eff1-6bfd-4d33-83f5-204633769c07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:57.240134 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69662207-33b1-498d-82c3-8a4f272f72cb None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:57.242125 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-06e5eff1-6bfd-4d33-83f5-204633769c07 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:26:57.243357 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-06e5eff1-6bfd-4d33-83f5-204633769c07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:26:57.259194 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:57.284804 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc731d7-9104-47b6-9a7c-b244e1864e66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:57.285706 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc731d7-9104-47b6-9a7c-b244e1864e66 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:57.286057 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc731d7-9104-47b6-9a7c-b244e1864e66 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:57.286565 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc731d7-9104-47b6-9a7c-b244e1864e66 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:57.308550 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc731d7-9104-47b6-9a7c-b244e1864e66 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:57.310471 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc731d7-9104-47b6-9a7c-b244e1864e66 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:57.328575 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 247/500] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:26:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:26:57.329924 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5fb3b3-5bd4-4285-91df-0cf0e3b27ea3 None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:57.330214 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5fb3b3-5bd4-4285-91df-0cf0e3b27ea3 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:57.330480 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5fb3b3-5bd4-4285-91df-0cf0e3b27ea3 None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:57.338075 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 248/501] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:26:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:26:57.338075 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5fb3b3-5bd4-4285-91df-0cf0e3b27ea3 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:57.338325 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application [None req-8fc731d7-9104-47b6-9a7c-b244e1864e66 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:26:57.338325 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:57.338325 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:26:57.338325 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:26:57.338325 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:26:57.338325 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:26:57.338325 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:26:57.338325 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:26:57.338325 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:26:57.338325 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:26:57.338325 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:26:57.338325 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:26:57.338325 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:26:57.338325 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:26:57.338325 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:26:57.339550 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:26:57.339550 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:26:57.339550 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:26:57.339550 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:26:57.339550 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:26:57.339550 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:26:57.339550 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:26:57.339550 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:26:57.339550 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application with Lock( Jul 11 14:26:57.339550 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:26:57.339550 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:26:57.339550 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:26:57.339550 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:26:57.339550 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:26:57.339550 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:26:57.339550 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:26:57.339550 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:26:57.340667 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:26:57.340667 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:26:57.340667 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:26:57.340667 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Jul 11 14:26:57.340667 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 254/502] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 11 14:26:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:26:57.340667 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc731d7-9104-47b6-9a7c-b244e1864e66 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:57.453051 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:57.468841 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc731d7-9104-47b6-9a7c-b244e1864e66 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:57.474874 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5fb3b3-5bd4-4285-91df-0cf0e3b27ea3 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:57.512489 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b24eee-4ae2-40dc-8d45-14332a550602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:57.513169 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b24eee-4ae2-40dc-8d45-14332a550602 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:57.513453 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b24eee-4ae2-40dc-8d45-14332a550602 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:57.513732 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b24eee-4ae2-40dc-8d45-14332a550602 None admin] PATH_INFO: `/v3/domains` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:57.514471 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b24eee-4ae2-40dc-8d45-14332a550602 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:57.514779 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b24eee-4ae2-40dc-8d45-14332a550602 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:57.516224 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b24eee-4ae2-40dc-8d45-14332a550602 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:57.524056 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afdf2b5-dddb-4c17-a9d3-997770b3b204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:57.525214 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afdf2b5-dddb-4c17-a9d3-997770b3b204 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:57.525959 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afdf2b5-dddb-4c17-a9d3-997770b3b204 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:57.525959 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afdf2b5-dddb-4c17-a9d3-997770b3b204 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:57.531883 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 255/503] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jul 11 14:26:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:57.533006 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d6d4c0-532a-4ba6-96e6-cd0572f7b6c3 None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:57.533319 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d6d4c0-532a-4ba6-96e6-cd0572f7b6c3 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:57.533601 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d6d4c0-532a-4ba6-96e6-cd0572f7b6c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:57.541743 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afdf2b5-dddb-4c17-a9d3-997770b3b204 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:57.543250 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afdf2b5-dddb-4c17-a9d3-997770b3b204 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:57.556497 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-55d6d4c0-532a-4ba6-96e6-cd0572f7b6c3 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:26:57.558198 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-55d6d4c0-532a-4ba6-96e6-cd0572f7b6c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:26:57.570482 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-2afdf2b5-dddb-4c17-a9d3-997770b3b204 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:26:57.570482 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:57.570482 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:26:57.570482 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:26:57.570482 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:26:57.570482 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:26:57.570482 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:26:57.570482 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:26:57.570482 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:26:57.570482 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:26:57.570482 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:26:57.570482 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:26:57.570482 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:26:57.570482 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:26:57.570482 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:26:57.571446 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:26:57.571446 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:26:57.571446 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:26:57.571446 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:26:57.571446 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:26:57.571446 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:26:57.571446 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:26:57.571446 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:26:57.571446 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( Jul 11 14:26:57.571446 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:26:57.571446 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:26:57.571446 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:26:57.571446 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:26:57.571446 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:26:57.571446 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:26:57.571446 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:26:57.571446 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:26:57.572308 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:26:57.572308 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:26:57.572308 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:26:57.572308 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Jul 11 14:26:57.572308 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 249/504] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 11 14:26:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:26:57.573533 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afdf2b5-dddb-4c17-a9d3-997770b3b204 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:57.576835 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:57.678340 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 256/505] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:26:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:26:57.679213 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d6d4c0-532a-4ba6-96e6-cd0572f7b6c3 None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:57.726673 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afdf2b5-dddb-4c17-a9d3-997770b3b204 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:57.765860 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:57.785813 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a50b56-2b80-4bcc-8861-1374c0639c26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:57.786928 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a50b56-2b80-4bcc-8861-1374c0639c26 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:57.787223 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a50b56-2b80-4bcc-8861-1374c0639c26 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:57.787508 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a50b56-2b80-4bcc-8861-1374c0639c26 None admin] PATH_INFO: `/v3/domains` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:57.788322 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a50b56-2b80-4bcc-8861-1374c0639c26 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:57.788639 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a50b56-2b80-4bcc-8861-1374c0639c26 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:57.790106 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a50b56-2b80-4bcc-8861-1374c0639c26 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:57.794057 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d6d4c0-532a-4ba6-96e6-cd0572f7b6c3 None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:57.805421 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 250/506] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jul 11 14:26:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:57.806331 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a50b56-2b80-4bcc-8861-1374c0639c26 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:57.840061 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53163a52-9d1a-400a-b79d-3bc8800517f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:57.841464 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53163a52-9d1a-400a-b79d-3bc8800517f8 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:57.841863 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53163a52-9d1a-400a-b79d-3bc8800517f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:57.842275 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53163a52-9d1a-400a-b79d-3bc8800517f8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:57.861321 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53163a52-9d1a-400a-b79d-3bc8800517f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:26:57.874776 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application [None req-53163a52-9d1a-400a-b79d-3bc8800517f8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:26:57.874776 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:57.874776 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:26:57.874776 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:26:57.874776 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:26:57.874776 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:26:57.874776 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:26:57.874776 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:26:57.874776 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:26:57.874776 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:26:57.874776 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:26:57.874776 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:26:57.874776 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:26:57.874776 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:26:57.874776 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:26:57.874776 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:26:57.876409 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:26:57.876409 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:26:57.876409 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:26:57.876409 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:26:57.876409 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:26:57.876409 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:26:57.876409 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:26:57.876409 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:26:57.876409 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:26:57.876409 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:26:57.876409 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:26:57.876409 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application with Lock( Jul 11 14:26:57.876409 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:26:57.876409 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:26:57.876409 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:26:57.876409 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:26:57.877835 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:26:57.877835 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:26:57.877835 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:26:57.877835 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:26:57.877835 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:26:57.877835 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:26:57.877835 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:26:57.877835 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:26:57.877835 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:26:57.877835 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:26:57.877835 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:26:57.877835 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Jul 11 14:26:57.877835 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 257/507] 10.222.0.70 () {56 vars in 1102 bytes} [Mon Jul 11 14:26:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:26:57.879708 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53163a52-9d1a-400a-b79d-3bc8800517f8 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:57.905229 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:57.957969 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a50b56-2b80-4bcc-8861-1374c0639c26 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:58.008632 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d5a438-9ce3-4003-86b6-4c93d1457f68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:58.009591 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d5a438-9ce3-4003-86b6-4c93d1457f68 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:58.009963 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d5a438-9ce3-4003-86b6-4c93d1457f68 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:58.010364 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d5a438-9ce3-4003-86b6-4c93d1457f68 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:58.012382 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53163a52-9d1a-400a-b79d-3bc8800517f8 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:58.019884 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d5a438-9ce3-4003-86b6-4c93d1457f68 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:58.021620 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d5a438-9ce3-4003-86b6-4c93d1457f68 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:58.038556 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-24d5a438-9ce3-4003-86b6-4c93d1457f68 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 11 14:26:58.038556 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:58.038556 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:26:58.038556 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:26:58.038556 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:26:58.038556 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:26:58.038556 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:26:58.038556 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:26:58.038556 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:26:58.038556 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:26:58.038556 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:26:58.038556 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:26:58.038556 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 14:26:58.038556 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 14:26:58.038556 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 14:26:58.038556 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 14:26:58.039612 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:26:58.039612 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:26:58.039612 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 14:26:58.039612 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:26:58.039612 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 14:26:58.039612 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:26:58.039612 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:26:58.039612 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:26:58.039612 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:26:58.039612 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:26:58.039612 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:26:58.039612 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( Jul 11 14:26:58.039612 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:26:58.039612 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:26:58.039612 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:26:58.039612 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:26:58.039612 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:26:58.039612 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:26:58.041917 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:26:58.041917 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:26:58.041917 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 14:26:58.041917 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 14:26:58.041917 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 14:26:58.041917 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 14:26:58.041917 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 14:26:58.041917 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 14:26:58.041917 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 11 14:26:58.041917 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Jul 11 14:26:58.041917 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 251/508] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Jul 11 14:26:57 2022] GET /identity/v3/users/glance => generated 84 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:26:58.041917 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d5a438-9ce3-4003-86b6-4c93d1457f68 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:58.060048 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541e97bd-f15c-4dc7-bacd-fde18de32e06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:58.060769 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541e97bd-f15c-4dc7-bacd-fde18de32e06 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:58.061054 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541e97bd-f15c-4dc7-bacd-fde18de32e06 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:58.061331 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541e97bd-f15c-4dc7-bacd-fde18de32e06 None admin] PATH_INFO: `/v3/domains` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:58.062078 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541e97bd-f15c-4dc7-bacd-fde18de32e06 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:58.062387 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541e97bd-f15c-4dc7-bacd-fde18de32e06 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:58.063809 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541e97bd-f15c-4dc7-bacd-fde18de32e06 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:58.071441 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:58.078083 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 258/509] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jul 11 14:26:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:58.079558 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541e97bd-f15c-4dc7-bacd-fde18de32e06 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:58.197407 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541e97bd-f15c-4dc7-bacd-fde18de32e06 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:58.205056 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d5a438-9ce3-4003-86b6-4c93d1457f68 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:58.240973 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f54384-544f-4bac-9cba-b5f7e1557ea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:58.241778 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f54384-544f-4bac-9cba-b5f7e1557ea0 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:58.242063 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f54384-544f-4bac-9cba-b5f7e1557ea0 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:58.242339 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f54384-544f-4bac-9cba-b5f7e1557ea0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:58.243431 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:58.251331 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f54384-544f-4bac-9cba-b5f7e1557ea0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:58.253171 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f54384-544f-4bac-9cba-b5f7e1557ea0 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:58.260745 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44d5976-0acf-46c3-adf2-b8eb9e809b66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:58.261633 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44d5976-0acf-46c3-adf2-b8eb9e809b66 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:58.262002 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44d5976-0acf-46c3-adf2-b8eb9e809b66 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:58.262365 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44d5976-0acf-46c3-adf2-b8eb9e809b66 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:58.274292 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application [None req-e8f54384-544f-4bac-9cba-b5f7e1557ea0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:26:58.274292 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:58.274292 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:26:58.274292 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:26:58.274292 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:26:58.274292 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:26:58.274292 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:26:58.274292 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:26:58.274292 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:26:58.274292 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:26:58.274292 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:26:58.274292 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:26:58.274292 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 14:26:58.274292 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 14:26:58.274292 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 14:26:58.275920 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 14:26:58.275920 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:26:58.275920 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:26:58.275920 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:26:58.275920 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:26:58.275920 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:26:58.275920 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:26:58.275920 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:26:58.275920 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application with Lock( Jul 11 14:26:58.275920 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:26:58.275920 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:26:58.275920 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:26:58.275920 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:26:58.275920 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:26:58.275920 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:26:58.275920 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:26:58.275920 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:26:58.277614 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 14:26:58.277614 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 14:26:58.277614 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 14:26:58.277614 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 14:26:58.277614 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 14:26:58.277614 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 14:26:58.277614 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:26:58.277614 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Jul 11 14:26:58.277614 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 259/510] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Jul 11 14:26:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:26:58.279924 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44d5976-0acf-46c3-adf2-b8eb9e809b66 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:58.280271 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f54384-544f-4bac-9cba-b5f7e1557ea0 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:58.280606 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44d5976-0acf-46c3-adf2-b8eb9e809b66 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:58.309608 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-a44d5976-0acf-46c3-adf2-b8eb9e809b66 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:26:58.309608 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:58.309608 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:26:58.309608 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:26:58.309608 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:26:58.309608 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:26:58.309608 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:26:58.309608 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:26:58.309608 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:26:58.309608 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:26:58.309608 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:26:58.309608 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:26:58.309608 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:26:58.309608 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:26:58.309608 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:26:58.311035 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:26:58.311035 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:26:58.311035 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:26:58.311035 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:26:58.311035 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:26:58.311035 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:26:58.311035 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:26:58.311035 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:26:58.311035 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( Jul 11 14:26:58.311035 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:26:58.311035 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:26:58.311035 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:26:58.311035 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:26:58.311035 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:26:58.311035 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:26:58.311035 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:26:58.311035 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:26:58.312186 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:26:58.312186 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:26:58.312186 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:26:58.312186 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Jul 11 14:26:58.312186 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 252/511] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 11 14:26:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:26:58.313292 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44d5976-0acf-46c3-adf2-b8eb9e809b66 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:58.365456 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:58.426104 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f54384-544f-4bac-9cba-b5f7e1557ea0 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:58.445477 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44d5976-0acf-46c3-adf2-b8eb9e809b66 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:58.478761 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217ae4e4-c1f9-4cc5-93bc-e6c775131fc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:58.479445 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217ae4e4-c1f9-4cc5-93bc-e6c775131fc7 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:58.479731 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217ae4e4-c1f9-4cc5-93bc-e6c775131fc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:58.480008 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217ae4e4-c1f9-4cc5-93bc-e6c775131fc7 None admin] PATH_INFO: `/v3/roles` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:58.480818 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217ae4e4-c1f9-4cc5-93bc-e6c775131fc7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:58.481131 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217ae4e4-c1f9-4cc5-93bc-e6c775131fc7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:58.482553 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217ae4e4-c1f9-4cc5-93bc-e6c775131fc7 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:58.484180 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6551895e-af51-42d4-ad40-2dd356456b2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:58.486161 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6551895e-af51-42d4-ad40-2dd356456b2a None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:58.486161 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6551895e-af51-42d4-ad40-2dd356456b2a None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:58.486161 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6551895e-af51-42d4-ad40-2dd356456b2a None admin] PATH_INFO: `/v3/users` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:58.486610 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6551895e-af51-42d4-ad40-2dd356456b2a None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:58.486610 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6551895e-af51-42d4-ad40-2dd356456b2a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:58.488176 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6551895e-af51-42d4-ad40-2dd356456b2a None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:58.493381 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 260/512] 10.222.0.70 () {56 vars in 1103 bytes} [Mon Jul 11 14:26:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:58.494268 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217ae4e4-c1f9-4cc5-93bc-e6c775131fc7 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:58.531288 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 253/513] 10.222.0.70 () {56 vars in 1137 bytes} [Mon Jul 11 14:26:58 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:58.532243 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6551895e-af51-42d4-ad40-2dd356456b2a None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:58.588137 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:58.640537 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217ae4e4-c1f9-4cc5-93bc-e6c775131fc7 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:58.666800 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:58.684189 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fcc62b-d550-41b5-9a85-ccdaf5966b0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:58.685020 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fcc62b-d550-41b5-9a85-ccdaf5966b0b None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:58.685315 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fcc62b-d550-41b5-9a85-ccdaf5966b0b None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:58.685591 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fcc62b-d550-41b5-9a85-ccdaf5966b0b None admin] PATH_INFO: `/v3/users/nova` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:58.695233 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fcc62b-d550-41b5-9a85-ccdaf5966b0b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:58.697020 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fcc62b-d550-41b5-9a85-ccdaf5966b0b None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:58.713398 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application [None req-40fcc62b-d550-41b5-9a85-ccdaf5966b0b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 11 14:26:58.713398 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:58.713398 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:26:58.713398 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:26:58.713398 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:26:58.713398 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:26:58.713398 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:26:58.713398 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:26:58.713398 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:26:58.713398 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:26:58.713398 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:26:58.713398 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:26:58.713398 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 14:26:58.713398 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 14:26:58.713398 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 14:26:58.713398 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 14:26:58.715262 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:26:58.715262 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:26:58.715262 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 14:26:58.715262 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:26:58.715262 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 14:26:58.715262 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:26:58.715262 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:26:58.715262 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:26:58.715262 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:26:58.715262 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:26:58.715262 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:26:58.715262 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application with Lock( Jul 11 14:26:58.715262 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:26:58.715262 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:26:58.715262 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:26:58.715262 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:26:58.715262 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:26:58.715262 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:26:58.717078 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:26:58.717078 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:26:58.717078 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 14:26:58.717078 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 14:26:58.717078 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 14:26:58.717078 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 14:26:58.717078 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 14:26:58.717078 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 14:26:58.717078 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 11 14:26:58.717078 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Jul 11 14:26:58.717078 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 261/514] 10.222.0.70 () {56 vars in 1093 bytes} [Mon Jul 11 14:26:58 2022] GET /identity/v3/users/nova => generated 82 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:26:58.717078 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fcc62b-d550-41b5-9a85-ccdaf5966b0b None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:58.733729 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6551895e-af51-42d4-ad40-2dd356456b2a None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:58.777860 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec55d49-8be0-4b96-a927-70743e170937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:58.778531 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec55d49-8be0-4b96-a927-70743e170937 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:58.778815 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec55d49-8be0-4b96-a927-70743e170937 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:58.779098 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec55d49-8be0-4b96-a927-70743e170937 None admin] PATH_INFO: `/v3/projects` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:58.779904 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec55d49-8be0-4b96-a927-70743e170937 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:58.780250 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec55d49-8be0-4b96-a927-70743e170937 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:58.781799 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec55d49-8be0-4b96-a927-70743e170937 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:58.802104 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 254/515] 10.222.0.70 () {56 vars in 1148 bytes} [Mon Jul 11 14:26:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:58.803007 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec55d49-8be0-4b96-a927-70743e170937 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:58.854987 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fcc62b-d550-41b5-9a85-ccdaf5966b0b None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:58.895728 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc2d105-1691-47a0-984e-870e667c2e47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:58.896448 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc2d105-1691-47a0-984e-870e667c2e47 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:58.896735 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc2d105-1691-47a0-984e-870e667c2e47 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:58.897048 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc2d105-1691-47a0-984e-870e667c2e47 None admin] PATH_INFO: `/v3/domains` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:58.897765 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc2d105-1691-47a0-984e-870e667c2e47 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:58.898071 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc2d105-1691-47a0-984e-870e667c2e47 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:58.899517 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc2d105-1691-47a0-984e-870e667c2e47 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:58.907228 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:58.913567 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 262/516] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jul 11 14:26:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:58.914661 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc2d105-1691-47a0-984e-870e667c2e47 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:58.921664 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec55d49-8be0-4b96-a927-70743e170937 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:58.965973 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:58.977138 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c633fcd3-d87d-4e89-a424-05c3cad62b88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:58.978069 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c633fcd3-d87d-4e89-a424-05c3cad62b88 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:58.978455 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c633fcd3-d87d-4e89-a424-05c3cad62b88 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:58.978816 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c633fcd3-d87d-4e89-a424-05c3cad62b88 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:58.994383 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c633fcd3-d87d-4e89-a424-05c3cad62b88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:58.997268 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c633fcd3-d87d-4e89-a424-05c3cad62b88 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:59.030122 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-c633fcd3-d87d-4e89-a424-05c3cad62b88 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:26:59.030122 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:59.030122 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:26:59.030122 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:26:59.030122 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:26:59.030122 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:26:59.030122 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:26:59.030122 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:26:59.030122 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:26:59.030122 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:26:59.030122 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:26:59.030122 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:26:59.030122 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:26:59.030122 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:26:59.030122 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:26:59.032116 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:26:59.032116 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:26:59.032116 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:26:59.032116 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:26:59.032116 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:26:59.032116 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:26:59.032116 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:26:59.032116 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:26:59.032116 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( Jul 11 14:26:59.032116 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:26:59.032116 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:26:59.032116 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:26:59.032116 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:26:59.032116 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:26:59.032116 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:26:59.032116 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:26:59.032116 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:26:59.043026 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:26:59.043026 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:26:59.043026 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:26:59.043026 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Jul 11 14:26:59.043498 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc2d105-1691-47a0-984e-870e667c2e47 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:59.043657 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 255/517] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 11 14:26:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:26:59.043657 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c633fcd3-d87d-4e89-a424-05c3cad62b88 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:59.073432 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c659c40-2d92-4fb8-bf2b-0f684f592356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:59.074211 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c659c40-2d92-4fb8-bf2b-0f684f592356 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:59.074351 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c659c40-2d92-4fb8-bf2b-0f684f592356 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:59.074628 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c659c40-2d92-4fb8-bf2b-0f684f592356 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:59.170895 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c633fcd3-d87d-4e89-a424-05c3cad62b88 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:59.171388 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c659c40-2d92-4fb8-bf2b-0f684f592356 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:59.172995 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c659c40-2d92-4fb8-bf2b-0f684f592356 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:59.213896 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbccadb-f19b-4c3a-ab1c-ddfc390b34b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:59.215029 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbccadb-f19b-4c3a-ab1c-ddfc390b34b3 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:59.215539 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbccadb-f19b-4c3a-ab1c-ddfc390b34b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:59.216034 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbccadb-f19b-4c3a-ab1c-ddfc390b34b3 None admin] PATH_INFO: `/v3/users` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:59.217724 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbccadb-f19b-4c3a-ab1c-ddfc390b34b3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:59.218332 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbccadb-f19b-4c3a-ab1c-ddfc390b34b3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:59.218486 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:59.221135 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbccadb-f19b-4c3a-ab1c-ddfc390b34b3 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:59.247680 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 256/518] 10.222.0.70 () {56 vars in 1133 bytes} [Mon Jul 11 14:26:59 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:59.248835 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbccadb-f19b-4c3a-ab1c-ddfc390b34b3 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:59.251921 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:59.296425 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 263/519] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Jul 11 14:26:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 14:26:59.297155 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c659c40-2d92-4fb8-bf2b-0f684f592356 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:59.398654 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbccadb-f19b-4c3a-ab1c-ddfc390b34b3 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:59.420990 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c659c40-2d92-4fb8-bf2b-0f684f592356 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:59.456100 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8fada3-c2b2-472f-9740-6e725a0e0070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:59.457688 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8fada3-c2b2-472f-9740-6e725a0e0070 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:59.458149 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8fada3-c2b2-472f-9740-6e725a0e0070 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:59.458646 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8fada3-c2b2-472f-9740-6e725a0e0070 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:59.460278 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8fada3-c2b2-472f-9740-6e725a0e0070 None admin] RBAC: Adding query filter params (role.id=c766eda9743248fa87df72ec905d271e, scope.project.id=ccd34295bf7b435a96b37487c8e89fc3, user.id=868e7c2dec264512b972c8736d659c34) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:59.460848 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8fada3-c2b2-472f-9740-6e725a0e0070 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:59.461296 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23aea71-ad2c-488f-9190-d008ec59c2a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:59.461983 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23aea71-ad2c-488f-9190-d008ec59c2a8 None admin] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:59.462268 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23aea71-ad2c-488f-9190-d008ec59c2a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:59.462541 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23aea71-ad2c-488f-9190-d008ec59c2a8 None admin] PATH_INFO: `/v3/users` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:59.463267 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23aea71-ad2c-488f-9190-d008ec59c2a8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:59.463472 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8fada3-c2b2-472f-9740-6e725a0e0070 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:59.464763 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23aea71-ad2c-488f-9190-d008ec59c2a8 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:59.473344 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 257/520] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Jul 11 14:26:59 2022] GET /identity/v3/role_assignments?user.id=868e7c2dec264512b972c8736d659c34&scope.project.id=ccd34295bf7b435a96b37487c8e89fc3&role.id=c766eda9743248fa87df72ec905d271e => generated 259 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:59.474802 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8fada3-c2b2-472f-9740-6e725a0e0070 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:59.486514 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:59.499149 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 264/521] 10.222.0.70 () {60 vars in 1132 bytes} [Mon Jul 11 14:26:59 2022] POST /identity/v3/users => generated 247 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:26:59.501136 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23aea71-ad2c-488f-9190-d008ec59c2a8 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:59.639957 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:59.713747 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8fada3-c2b2-472f-9740-6e725a0e0070 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:59.729708 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23aea71-ad2c-488f-9190-d008ec59c2a8 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:59.788469 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8580def9-50f0-440f-bf9d-ed2dfd74eb45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:59.789328 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8580def9-50f0-440f-bf9d-ed2dfd74eb45 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:59.790222 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8580def9-50f0-440f-bf9d-ed2dfd74eb45 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:59.790222 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8580def9-50f0-440f-bf9d-ed2dfd74eb45 None admin] PATH_INFO: `/v3/domains` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:59.791285 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8580def9-50f0-440f-bf9d-ed2dfd74eb45 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:59.791721 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8580def9-50f0-440f-bf9d-ed2dfd74eb45 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:59.794095 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8580def9-50f0-440f-bf9d-ed2dfd74eb45 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:59.803036 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed4f061-b91b-48f8-a08a-4b9dee78214d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:59.805092 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed4f061-b91b-48f8-a08a-4b9dee78214d None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:59.806014 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed4f061-b91b-48f8-a08a-4b9dee78214d None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:59.806014 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed4f061-b91b-48f8-a08a-4b9dee78214d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:59.814451 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 258/522] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jul 11 14:26:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:59.818792 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8580def9-50f0-440f-bf9d-ed2dfd74eb45 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:59.951225 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:59.963605 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed4f061-b91b-48f8-a08a-4b9dee78214d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:59.966433 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed4f061-b91b-48f8-a08a-4b9dee78214d None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:00.016010 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8580def9-50f0-440f-bf9d-ed2dfd74eb45 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:00.054004 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:00.067273 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013e8966-526d-4730-ad9b-b846d07be5ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:00.068519 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013e8966-526d-4730-ad9b-b846d07be5ca None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:00.068914 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013e8966-526d-4730-ad9b-b846d07be5ca None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:00.069194 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013e8966-526d-4730-ad9b-b846d07be5ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:00.084112 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013e8966-526d-4730-ad9b-b846d07be5ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:00.085660 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013e8966-526d-4730-ad9b-b846d07be5ca None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:00.107183 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-013e8966-526d-4730-ad9b-b846d07be5ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:27:00.107183 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:00.107183 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:00.107183 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:00.107183 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:00.107183 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:00.107183 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:00.107183 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:00.107183 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:00.107183 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:00.107183 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:00.107183 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:00.107183 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:27:00.107183 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:27:00.107183 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:27:00.108118 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:27:00.108118 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:00.108118 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:00.108118 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:00.108118 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:00.108118 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:00.108118 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:00.108118 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:00.108118 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:00.108118 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:00.108118 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:00.108118 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:00.108118 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:00.108118 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:00.108118 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:00.108118 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:00.108118 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:00.108984 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:27:00.108984 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:27:00.108984 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:27:00.108984 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Jul 11 14:27:00.108984 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 259/523] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 11 14:26:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:27:00.109679 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013e8966-526d-4730-ad9b-b846d07be5ca None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:00.116293 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 265/524] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Jul 11 14:26:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 617 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 14:27:00.117838 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed4f061-b91b-48f8-a08a-4b9dee78214d None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:00.246084 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:00.250122 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013e8966-526d-4730-ad9b-b846d07be5ca None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:00.252689 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed4f061-b91b-48f8-a08a-4b9dee78214d None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:00.298889 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bbcaa4-cc19-4cc4-ab98-6d1f6525451f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:00.299567 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bbcaa4-cc19-4cc4-ab98-6d1f6525451f None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:00.299793 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59a24c8-a16d-4423-a862-82abd2f97627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:00.299932 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bbcaa4-cc19-4cc4-ab98-6d1f6525451f None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:00.300173 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bbcaa4-cc19-4cc4-ab98-6d1f6525451f None admin] PATH_INFO: `/v3/domains` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:00.301719 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59a24c8-a16d-4423-a862-82abd2f97627 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:00.301828 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bbcaa4-cc19-4cc4-ab98-6d1f6525451f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:00.302273 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bbcaa4-cc19-4cc4-ab98-6d1f6525451f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:00.302571 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59a24c8-a16d-4423-a862-82abd2f97627 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:00.303090 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59a24c8-a16d-4423-a862-82abd2f97627 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:00.304853 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bbcaa4-cc19-4cc4-ab98-6d1f6525451f None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:00.312995 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59a24c8-a16d-4423-a862-82abd2f97627 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:00.314500 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59a24c8-a16d-4423-a862-82abd2f97627 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:00.325790 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 266/525] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jul 11 14:27:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:00.326999 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bbcaa4-cc19-4cc4-ab98-6d1f6525451f None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:00.336137 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-a59a24c8-a16d-4423-a862-82abd2f97627 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 11 14:27:00.336137 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:00.336137 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:00.336137 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:00.336137 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:00.336137 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:00.336137 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:00.336137 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:00.336137 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:00.336137 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:00.336137 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:00.336137 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:00.336137 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 14:27:00.336137 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 14:27:00.336137 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 14:27:00.336137 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 14:27:00.337134 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:00.337134 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:00.337134 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 14:27:00.337134 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:27:00.337134 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 14:27:00.337134 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:27:00.337134 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:00.337134 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:00.337134 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:00.337134 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:00.337134 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:00.337134 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:00.337134 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:00.337134 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:00.337134 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:00.337134 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:00.337134 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:00.337134 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:00.338059 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:00.338059 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:00.338059 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 14:27:00.338059 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 14:27:00.338059 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 14:27:00.338059 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 14:27:00.338059 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 14:27:00.338059 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 14:27:00.338059 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 11 14:27:00.338059 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Jul 11 14:27:00.344824 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 260/526] 10.222.0.70 () {56 vars in 1102 bytes} [Mon Jul 11 14:27:00 2022] GET /identity/v3/users/neutron => generated 85 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:27:00.346087 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59a24c8-a16d-4423-a862-82abd2f97627 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:00.429861 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:00.470482 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bbcaa4-cc19-4cc4-ab98-6d1f6525451f None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:00.517151 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92d4e23-3bb3-4aac-8d2e-d921df5fedad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:00.518334 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92d4e23-3bb3-4aac-8d2e-d921df5fedad None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:00.518780 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92d4e23-3bb3-4aac-8d2e-d921df5fedad None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:00.519265 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92d4e23-3bb3-4aac-8d2e-d921df5fedad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:00.540899 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92d4e23-3bb3-4aac-8d2e-d921df5fedad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:00.541254 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59a24c8-a16d-4423-a862-82abd2f97627 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:00.543786 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92d4e23-3bb3-4aac-8d2e-d921df5fedad None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:00.577741 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application [None req-d92d4e23-3bb3-4aac-8d2e-d921df5fedad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:27:00.577741 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:00.577741 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:00.577741 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:00.577741 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:00.577741 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:00.577741 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:00.577741 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:00.577741 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:00.577741 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:00.577741 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:00.577741 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:00.577741 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:27:00.577741 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:27:00.577741 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:27:00.578601 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:27:00.578601 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:00.578601 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:00.578601 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:00.578601 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:00.578601 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:00.578601 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:00.578601 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:00.578601 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:00.578601 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:00.578601 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:00.578601 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:00.578601 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:00.578601 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:00.578601 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:00.578601 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:00.578601 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:00.579458 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:27:00.579458 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:27:00.579458 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:27:00.579458 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Jul 11 14:27:00.582891 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 267/527] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 11 14:27:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:27:00.584433 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92d4e23-3bb3-4aac-8d2e-d921df5fedad None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:00.599567 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:00.608682 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d35703b-addf-4930-8025-30a1bbbf41d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:00.610177 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d35703b-addf-4930-8025-30a1bbbf41d3 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:00.610804 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d35703b-addf-4930-8025-30a1bbbf41d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:00.611435 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d35703b-addf-4930-8025-30a1bbbf41d3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:00.624349 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d35703b-addf-4930-8025-30a1bbbf41d3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:00.627674 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d35703b-addf-4930-8025-30a1bbbf41d3 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:00.656602 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-4d35703b-addf-4930-8025-30a1bbbf41d3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:27:00.656602 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:00.656602 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:00.656602 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:00.656602 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:00.656602 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:00.656602 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:00.656602 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:00.656602 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:00.656602 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:00.656602 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:00.656602 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:00.656602 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 14:27:00.656602 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 14:27:00.656602 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 14:27:00.657964 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 14:27:00.657964 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:00.657964 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:00.657964 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:00.657964 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:00.657964 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:00.657964 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:00.657964 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:00.657964 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:00.657964 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:00.657964 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:00.657964 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:00.657964 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:00.657964 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:00.657964 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:00.657964 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:00.657964 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:00.658799 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 14:27:00.658799 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 14:27:00.658799 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 14:27:00.658799 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 14:27:00.658799 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 14:27:00.658799 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 14:27:00.658799 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:27:00.658799 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Jul 11 14:27:00.659199 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 261/528] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Jul 11 14:27:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:27:00.661013 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d35703b-addf-4930-8025-30a1bbbf41d3 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:00.722045 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92d4e23-3bb3-4aac-8d2e-d921df5fedad None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:00.796497 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beeaa82-8913-4d24-b018-53d9da175697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:00.797727 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beeaa82-8913-4d24-b018-53d9da175697 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:00.798306 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beeaa82-8913-4d24-b018-53d9da175697 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:00.798879 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beeaa82-8913-4d24-b018-53d9da175697 None admin] PATH_INFO: `/v3/users` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:00.800784 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1beeaa82-8913-4d24-b018-53d9da175697 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:00.802294 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1beeaa82-8913-4d24-b018-53d9da175697 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:00.806295 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1beeaa82-8913-4d24-b018-53d9da175697 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:00.834272 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:00.840170 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d35703b-addf-4930-8025-30a1bbbf41d3 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:00.856398 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 268/529] 10.222.0.70 () {56 vars in 1139 bytes} [Mon Jul 11 14:27:00 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:00.857347 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beeaa82-8913-4d24-b018-53d9da175697 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:00.899678 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa87b11b-b141-4a85-9a6a-79c337558883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:00.900903 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa87b11b-b141-4a85-9a6a-79c337558883 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:00.901426 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa87b11b-b141-4a85-9a6a-79c337558883 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:00.901926 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa87b11b-b141-4a85-9a6a-79c337558883 None admin] PATH_INFO: `/v3/domains` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:00.903337 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa87b11b-b141-4a85-9a6a-79c337558883 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:00.904045 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa87b11b-b141-4a85-9a6a-79c337558883 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:00.906765 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa87b11b-b141-4a85-9a6a-79c337558883 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:00.924551 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 262/530] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jul 11 14:27:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:00.925994 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa87b11b-b141-4a85-9a6a-79c337558883 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:00.986948 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:01.053806 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beeaa82-8913-4d24-b018-53d9da175697 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:01.058242 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa87b11b-b141-4a85-9a6a-79c337558883 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:01.109639 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fefc1ba-2a08-43fc-aa79-355ddad72695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:01.110611 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fefc1ba-2a08-43fc-aa79-355ddad72695 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:01.111005 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fefc1ba-2a08-43fc-aa79-355ddad72695 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:01.111386 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fefc1ba-2a08-43fc-aa79-355ddad72695 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:01.130578 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60ed726-d03e-4355-a300-e21ac8d1c930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:01.132628 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60ed726-d03e-4355-a300-e21ac8d1c930 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:01.133496 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60ed726-d03e-4355-a300-e21ac8d1c930 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:01.134251 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60ed726-d03e-4355-a300-e21ac8d1c930 None admin] PATH_INFO: `/v3/projects` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:01.135918 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60ed726-d03e-4355-a300-e21ac8d1c930 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:01.136796 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60ed726-d03e-4355-a300-e21ac8d1c930 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:01.139784 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60ed726-d03e-4355-a300-e21ac8d1c930 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:01.147104 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:01.188567 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 269/531] 10.222.0.70 () {56 vars in 1148 bytes} [Mon Jul 11 14:27:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:01.190714 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60ed726-d03e-4355-a300-e21ac8d1c930 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:01.200085 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fefc1ba-2a08-43fc-aa79-355ddad72695 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:01.202000 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fefc1ba-2a08-43fc-aa79-355ddad72695 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:01.341502 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60ed726-d03e-4355-a300-e21ac8d1c930 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:01.373589 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:01.386072 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8b9078-4b99-41d1-aa66-58df079cfce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:01.387050 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8b9078-4b99-41d1-aa66-58df079cfce6 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:01.387416 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8b9078-4b99-41d1-aa66-58df079cfce6 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:01.387813 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8b9078-4b99-41d1-aa66-58df079cfce6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:01.395862 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8b9078-4b99-41d1-aa66-58df079cfce6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:01.397657 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8b9078-4b99-41d1-aa66-58df079cfce6 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:01.414145 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application [None req-ea8b9078-4b99-41d1-aa66-58df079cfce6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:27:01.414145 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:01.414145 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:01.414145 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:01.414145 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:01.414145 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:01.414145 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:01.414145 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:01.414145 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:01.414145 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:01.414145 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:01.414145 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:01.414145 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 14:27:01.414145 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 14:27:01.414145 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 14:27:01.416085 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 14:27:01.416085 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:01.416085 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:01.416085 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:01.416085 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:01.416085 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:01.416085 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:01.416085 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:01.416085 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:01.416085 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:01.416085 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:01.416085 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:01.416085 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:01.416085 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:01.416085 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:01.416085 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:01.416085 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:01.418176 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 14:27:01.418176 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 14:27:01.418176 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 14:27:01.418176 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 14:27:01.418176 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 14:27:01.418176 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 14:27:01.418176 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:27:01.418176 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Jul 11 14:27:01.418176 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 270/532] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Jul 11 14:27:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:27:01.419392 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8b9078-4b99-41d1-aa66-58df079cfce6 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:01.421410 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 263/533] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Jul 11 14:27:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 496 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 14:27:01.432267 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fefc1ba-2a08-43fc-aa79-355ddad72695 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:01.536544 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8b9078-4b99-41d1-aa66-58df079cfce6 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:01.578504 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74639547-1373-4903-ba48-a2b5aa9e0cd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:01.579481 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74639547-1373-4903-ba48-a2b5aa9e0cd9 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:01.579969 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74639547-1373-4903-ba48-a2b5aa9e0cd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:01.580519 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74639547-1373-4903-ba48-a2b5aa9e0cd9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:01.581600 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74639547-1373-4903-ba48-a2b5aa9e0cd9 None admin] RBAC: Adding query filter params (role.id=c766eda9743248fa87df72ec905d271e, scope.project.id=ccd34295bf7b435a96b37487c8e89fc3, user.id=fa21b44163d84534b9ca1ffe5b5a6071) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:01.582231 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74639547-1373-4903-ba48-a2b5aa9e0cd9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:01.583945 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74639547-1373-4903-ba48-a2b5aa9e0cd9 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:01.587360 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:01.593332 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 271/534] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Jul 11 14:27:01 2022] GET /identity/v3/role_assignments?user.id=fa21b44163d84534b9ca1ffe5b5a6071&scope.project.id=ccd34295bf7b435a96b37487c8e89fc3&role.id=c766eda9743248fa87df72ec905d271e => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:01.594458 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74639547-1373-4903-ba48-a2b5aa9e0cd9 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:01.664767 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:01.721165 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74639547-1373-4903-ba48-a2b5aa9e0cd9 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:01.735960 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fefc1ba-2a08-43fc-aa79-355ddad72695 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:01.765403 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af7695c-dcc7-4da1-8920-56053aa19e5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:01.766629 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af7695c-dcc7-4da1-8920-56053aa19e5e None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:01.767277 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af7695c-dcc7-4da1-8920-56053aa19e5e None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:01.767800 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af7695c-dcc7-4da1-8920-56053aa19e5e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:01.782718 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af7695c-dcc7-4da1-8920-56053aa19e5e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:01.784938 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af7695c-dcc7-4da1-8920-56053aa19e5e None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:01.806172 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application [None req-0af7695c-dcc7-4da1-8920-56053aa19e5e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:27:01.806172 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:01.806172 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:01.806172 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:01.806172 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:01.806172 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:01.806172 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:01.806172 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:01.806172 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:01.806172 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:01.806172 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:01.806172 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:01.806172 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:27:01.806172 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:27:01.806172 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:27:01.807093 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:27:01.807093 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:01.807093 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:01.807093 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:01.807093 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:01.807093 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:01.807093 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:01.807093 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:01.807093 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:01.807093 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:01.807093 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:01.807093 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:01.807093 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:01.807093 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:01.807093 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:01.807093 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:01.807093 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:01.808182 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:27:01.808182 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:27:01.808182 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:27:01.808182 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Jul 11 14:27:01.810362 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 272/535] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 11 14:27:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:27:01.819320 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af7695c-dcc7-4da1-8920-56053aa19e5e None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:01.856373 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7cac1d-2722-497a-a5f2-9987f790ebb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:01.857460 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7cac1d-2722-497a-a5f2-9987f790ebb9 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:01.857969 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7cac1d-2722-497a-a5f2-9987f790ebb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:01.858470 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7cac1d-2722-497a-a5f2-9987f790ebb9 None admin] PATH_INFO: `/v3/projects` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:01.860022 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7cac1d-2722-497a-a5f2-9987f790ebb9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:01.860619 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7cac1d-2722-497a-a5f2-9987f790ebb9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:01.868434 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7cac1d-2722-497a-a5f2-9987f790ebb9 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:01.915942 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 264/536] 10.222.0.70 () {56 vars in 1148 bytes} [Mon Jul 11 14:27:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 490 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:01.928089 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7cac1d-2722-497a-a5f2-9987f790ebb9 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:02.037128 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af7695c-dcc7-4da1-8920-56053aa19e5e None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:02.040689 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:02.088853 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53c7218-a43a-4b2a-be93-edc678e9ab7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:02.089654 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53c7218-a43a-4b2a-be93-edc678e9ab7b None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:02.089990 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53c7218-a43a-4b2a-be93-edc678e9ab7b None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:02.090335 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53c7218-a43a-4b2a-be93-edc678e9ab7b None admin] PATH_INFO: `/v3/domains` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:02.091160 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53c7218-a43a-4b2a-be93-edc678e9ab7b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:02.091558 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53c7218-a43a-4b2a-be93-edc678e9ab7b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:02.093199 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53c7218-a43a-4b2a-be93-edc678e9ab7b None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:02.108494 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 273/537] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jul 11 14:27:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:02.121342 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53c7218-a43a-4b2a-be93-edc678e9ab7b None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:02.173799 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7cac1d-2722-497a-a5f2-9987f790ebb9 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:02.239611 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:02.267227 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53c7218-a43a-4b2a-be93-edc678e9ab7b None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:02.302887 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec8d756-1a18-4bd6-846c-5f201cd849c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:02.303994 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec8d756-1a18-4bd6-846c-5f201cd849c0 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:02.304520 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec8d756-1a18-4bd6-846c-5f201cd849c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:02.305012 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec8d756-1a18-4bd6-846c-5f201cd849c0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:02.306614 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec8d756-1a18-4bd6-846c-5f201cd849c0 None admin] RBAC: Adding query filter params (role.id=c766eda9743248fa87df72ec905d271e, scope.project.id=ccd34295bf7b435a96b37487c8e89fc3, user.id=f4f8c0d696af4bd5a205ca8e9110b8cc) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:02.307160 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec8d756-1a18-4bd6-846c-5f201cd849c0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:02.308930 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ebc094-292b-47a4-8b1c-d7c041068a67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:02.310046 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ebc094-292b-47a4-8b1c-d7c041068a67 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:02.310228 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec8d756-1a18-4bd6-846c-5f201cd849c0 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:02.310734 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ebc094-292b-47a4-8b1c-d7c041068a67 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:02.311261 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ebc094-292b-47a4-8b1c-d7c041068a67 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:02.320270 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ebc094-292b-47a4-8b1c-d7c041068a67 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:02.322240 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ebc094-292b-47a4-8b1c-d7c041068a67 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:02.334045 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 265/538] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Jul 11 14:27:01 2022] GET /identity/v3/role_assignments?user.id=f4f8c0d696af4bd5a205ca8e9110b8cc&scope.project.id=ccd34295bf7b435a96b37487c8e89fc3&role.id=c766eda9743248fa87df72ec905d271e => generated 259 bytes in 407 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:02.339124 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application [None req-93ebc094-292b-47a4-8b1c-d7c041068a67 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:27:02.339124 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:02.339124 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:02.339124 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:02.339124 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:02.339124 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:02.339124 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:02.339124 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:02.339124 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:02.339124 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:02.339124 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:02.339124 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:02.339124 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 14:27:02.339124 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 14:27:02.339124 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 14:27:02.340054 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 14:27:02.340054 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:02.340054 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:02.340054 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:02.340054 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:02.340054 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:02.340054 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:02.340054 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:02.340054 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:02.340054 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:02.340054 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:02.340054 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:02.340054 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:02.340054 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:02.340054 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:02.340054 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:02.340054 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:02.340945 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 14:27:02.340945 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 14:27:02.340945 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 14:27:02.340945 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 14:27:02.340945 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 14:27:02.340945 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 14:27:02.340945 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:27:02.340945 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Jul 11 14:27:02.343880 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 274/539] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Jul 11 14:27:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:27:02.353426 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec8d756-1a18-4bd6-846c-5f201cd849c0 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:02.660531 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec8d756-1a18-4bd6-846c-5f201cd849c0 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:02.743527 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fd25f6-5a0e-4e97-a86f-0b1e621fc774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:02.744907 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fd25f6-5a0e-4e97-a86f-0b1e621fc774 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:02.745468 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fd25f6-5a0e-4e97-a86f-0b1e621fc774 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:02.746032 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fd25f6-5a0e-4e97-a86f-0b1e621fc774 None admin] PATH_INFO: `/v3/projects` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:02.747802 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fd25f6-5a0e-4e97-a86f-0b1e621fc774 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:02.748444 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fd25f6-5a0e-4e97-a86f-0b1e621fc774 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:02.751447 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fd25f6-5a0e-4e97-a86f-0b1e621fc774 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:02.778457 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 266/540] 10.222.0.70 () {56 vars in 1148 bytes} [Mon Jul 11 14:27:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 426 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:02.788774 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ebc094-292b-47a4-8b1c-d7c041068a67 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:02.848453 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20484be4-893a-4163-afb5-89943435b583 None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:02.848886 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20484be4-893a-4163-afb5-89943435b583 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:02.849228 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20484be4-893a-4163-afb5-89943435b583 None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:02.850981 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 267/541] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:27:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 14:27:02.859188 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:02.879627 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a15c7a-38ac-41e9-81b8-fe9daa2b034e None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:02.880032 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a15c7a-38ac-41e9-81b8-fe9daa2b034e None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:02.880278 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a15c7a-38ac-41e9-81b8-fe9daa2b034e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:02.915715 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-87a15c7a-38ac-41e9-81b8-fe9daa2b034e None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:27:02.917008 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-87a15c7a-38ac-41e9-81b8-fe9daa2b034e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:27:03.050381 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:03.059469 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ebc094-292b-47a4-8b1c-d7c041068a67 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:03.108461 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 268/542] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:27:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:27:03.109943 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a4c398-f179-45b0-8e3b-dad15dc79020 None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:03.110261 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a4c398-f179-45b0-8e3b-dad15dc79020 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:03.110509 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a4c398-f179-45b0-8e3b-dad15dc79020 None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:03.112245 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 269/543] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:27:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:27:03.118288 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf7ccf6-50f2-44f5-a3ad-ab1f8dcbfa60 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:03.118657 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf7ccf6-50f2-44f5-a3ad-ab1f8dcbfa60 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:03.118902 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf7ccf6-50f2-44f5-a3ad-ab1f8dcbfa60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:03.127899 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f5a782-849e-4eea-9d36-5e191382fc4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:03.129579 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f5a782-849e-4eea-9d36-5e191382fc4f None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:03.129863 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f5a782-849e-4eea-9d36-5e191382fc4f None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:03.130240 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f5a782-849e-4eea-9d36-5e191382fc4f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:03.131924 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f5a782-849e-4eea-9d36-5e191382fc4f None admin] RBAC: Adding query filter params (role.id=c766eda9743248fa87df72ec905d271e, scope.project.id=ccd34295bf7b435a96b37487c8e89fc3, user.id=20eede5ccd834862b00123310b5c3975) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:03.132538 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f5a782-849e-4eea-9d36-5e191382fc4f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:03.135413 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f5a782-849e-4eea-9d36-5e191382fc4f None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:03.147727 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 275/544] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Jul 11 14:27:02 2022] GET /identity/v3/role_assignments?user.id=20eede5ccd834862b00123310b5c3975&scope.project.id=ccd34295bf7b435a96b37487c8e89fc3&role.id=c766eda9743248fa87df72ec905d271e => generated 259 bytes in 360 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:03.150194 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-3cf7ccf6-50f2-44f5-a3ad-ab1f8dcbfa60 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:27:03.151457 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-3cf7ccf6-50f2-44f5-a3ad-ab1f8dcbfa60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:27:03.155673 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f5a782-849e-4eea-9d36-5e191382fc4f None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:03.231794 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 270/545] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:27:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 14:27:03.254981 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf7ccf6-50f2-44f5-a3ad-ab1f8dcbfa60 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:03.352719 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:03.367612 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f5a782-849e-4eea-9d36-5e191382fc4f None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:03.418165 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b5ca58-c67b-41c5-a9a7-1175d7f57de7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:03.419045 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b5ca58-c67b-41c5-a9a7-1175d7f57de7 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:03.419332 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b5ca58-c67b-41c5-a9a7-1175d7f57de7 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:03.419610 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b5ca58-c67b-41c5-a9a7-1175d7f57de7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:03.447611 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b5ca58-c67b-41c5-a9a7-1175d7f57de7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:27:03.458626 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application [None req-25b5ca58-c67b-41c5-a9a7-1175d7f57de7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:27:03.458626 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:03.458626 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:03.458626 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:03.458626 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:03.458626 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:03.458626 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:03.458626 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:03.458626 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:03.458626 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:03.458626 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:03.458626 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:03.458626 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:27:03.458626 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:27:03.458626 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:27:03.458626 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:27:03.460442 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:27:03.460442 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:27:03.460442 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:27:03.460442 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:27:03.460442 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:03.460442 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:03.460442 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:03.460442 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:03.460442 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:03.460442 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:03.460442 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:03.460442 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:03.460442 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:03.460442 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:03.460442 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:03.460442 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:03.462004 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:03.462004 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:03.462004 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:03.462004 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:03.462004 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:27:03.462004 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:27:03.462004 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:27:03.462004 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:27:03.462004 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:27:03.462004 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:27:03.462004 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:27:03.462004 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Jul 11 14:27:03.462004 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 276/546] 10.222.0.70 () {56 vars in 1102 bytes} [Mon Jul 11 14:27:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:27:03.469534 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b5ca58-c67b-41c5-a9a7-1175d7f57de7 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:03.603214 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf7ccf6-50f2-44f5-a3ad-ab1f8dcbfa60 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:03.606410 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:03.701272 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2e7f75-2499-4de3-b72c-82d0530ee0e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:03.702622 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2e7f75-2499-4de3-b72c-82d0530ee0e7 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:03.703135 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2e7f75-2499-4de3-b72c-82d0530ee0e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:03.703626 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2e7f75-2499-4de3-b72c-82d0530ee0e7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:03.744404 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2e7f75-2499-4de3-b72c-82d0530ee0e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:27:03.764330 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-3b2e7f75-2499-4de3-b72c-82d0530ee0e7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:27:03.764330 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:03.764330 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:03.764330 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:03.764330 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:03.764330 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:03.764330 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:03.764330 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:03.764330 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:03.764330 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:03.764330 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:03.764330 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:03.764330 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:27:03.764330 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:27:03.764330 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:27:03.764330 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:27:03.765293 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:27:03.765293 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:27:03.765293 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:27:03.765293 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:27:03.765293 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:03.765293 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:03.765293 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:03.765293 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:03.765293 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:03.765293 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:03.765293 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:03.765293 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:03.765293 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:03.765293 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:03.765293 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:03.765293 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:03.766077 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:03.766077 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:03.766077 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:03.766077 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:03.766077 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:27:03.766077 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:27:03.766077 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:27:03.766077 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:27:03.766077 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:27:03.766077 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:27:03.766077 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:27:03.766077 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Jul 11 14:27:03.769645 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 271/547] 10.222.0.70 () {56 vars in 1102 bytes} [Mon Jul 11 14:27:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 514 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:27:03.778307 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2e7f75-2499-4de3-b72c-82d0530ee0e7 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:03.781061 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b5ca58-c67b-41c5-a9a7-1175d7f57de7 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:03.882478 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f639b2d-0ad4-467e-9879-87297e2ac780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:03.883644 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f639b2d-0ad4-467e-9879-87297e2ac780 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:03.884156 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f639b2d-0ad4-467e-9879-87297e2ac780 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:03.884655 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f639b2d-0ad4-467e-9879-87297e2ac780 None admin] PATH_INFO: `/v3/roles` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:03.886017 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f639b2d-0ad4-467e-9879-87297e2ac780 None admin] RBAC: Adding query filter params (name=service) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:03.886573 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f639b2d-0ad4-467e-9879-87297e2ac780 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:03.889257 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f639b2d-0ad4-467e-9879-87297e2ac780 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:03.912393 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 277/548] 10.222.0.70 () {56 vars in 1103 bytes} [Mon Jul 11 14:27:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 437 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:27:03.915327 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f639b2d-0ad4-467e-9879-87297e2ac780 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:03.944865 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:04.074725 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2e7f75-2499-4de3-b72c-82d0530ee0e7 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:04.201415 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b932f24b-daf9-4c5c-9211-23405bf46253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:04.202557 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b932f24b-daf9-4c5c-9211-23405bf46253 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:04.203047 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b932f24b-daf9-4c5c-9211-23405bf46253 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:04.203535 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b932f24b-daf9-4c5c-9211-23405bf46253 None admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:04.204991 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b932f24b-daf9-4c5c-9211-23405bf46253 None admin] RBAC: Adding query filter params (name=service) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:04.205571 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b932f24b-daf9-4c5c-9211-23405bf46253 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:04.208820 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b932f24b-daf9-4c5c-9211-23405bf46253 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:04.221050 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f639b2d-0ad4-467e-9879-87297e2ac780 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:04.242561 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 272/549] 10.222.0.70 () {56 vars in 1103 bytes} [Mon Jul 11 14:27:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 465 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:04.249189 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b932f24b-daf9-4c5c-9211-23405bf46253 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:04.310555 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:04.317821 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3ed0b2-f41e-4c8a-b1f4-fb1d3bfbd187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:04.319215 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3ed0b2-f41e-4c8a-b1f4-fb1d3bfbd187 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:04.319766 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3ed0b2-f41e-4c8a-b1f4-fb1d3bfbd187 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:04.320250 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3ed0b2-f41e-4c8a-b1f4-fb1d3bfbd187 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:04.343690 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3ed0b2-f41e-4c8a-b1f4-fb1d3bfbd187 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:04.346386 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3ed0b2-f41e-4c8a-b1f4-fb1d3bfbd187 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:04.385994 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application [None req-7f3ed0b2-f41e-4c8a-b1f4-fb1d3bfbd187 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:27:04.385994 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:04.385994 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:04.385994 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:04.385994 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:04.385994 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:04.385994 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:04.385994 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:04.385994 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:04.385994 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:04.385994 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:04.385994 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:04.385994 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:27:04.385994 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:27:04.385994 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:27:04.387345 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:27:04.387345 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:04.387345 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:04.387345 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:04.387345 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:04.387345 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:04.387345 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:04.387345 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:04.387345 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:04.387345 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:04.387345 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:04.387345 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:04.387345 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:04.387345 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:04.387345 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:04.387345 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:04.387345 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:04.388929 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:27:04.388929 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:27:04.388929 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:27:04.388929 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Jul 11 14:27:04.388929 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 278/550] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 11 14:27:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 474 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:27:04.396417 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3ed0b2-f41e-4c8a-b1f4-fb1d3bfbd187 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:04.504085 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b932f24b-daf9-4c5c-9211-23405bf46253 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:04.528614 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:04.590361 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b16c9b-0f82-4ccb-898e-8f00865a86b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:04.591705 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b16c9b-0f82-4ccb-898e-8f00865a86b6 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:04.592237 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b16c9b-0f82-4ccb-898e-8f00865a86b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:04.592734 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b16c9b-0f82-4ccb-898e-8f00865a86b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:04.614711 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b16c9b-0f82-4ccb-898e-8f00865a86b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:04.617306 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b16c9b-0f82-4ccb-898e-8f00865a86b6 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:04.647062 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3ed0b2-f41e-4c8a-b1f4-fb1d3bfbd187 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:04.653293 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-05b16c9b-0f82-4ccb-898e-8f00865a86b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:27:04.653293 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:04.653293 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:04.653293 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:04.653293 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:04.653293 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:04.653293 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:04.653293 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:04.653293 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:04.653293 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:04.653293 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:04.653293 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:04.653293 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:27:04.653293 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:27:04.653293 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:27:04.654309 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:27:04.654309 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:04.654309 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:04.654309 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:04.654309 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:04.654309 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:04.654309 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:04.654309 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:04.654309 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:04.654309 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:04.654309 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:04.654309 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:04.654309 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:04.654309 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:04.654309 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:04.654309 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:04.654309 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:04.655190 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:27:04.655190 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:27:04.655190 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:27:04.655190 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Jul 11 14:27:04.660304 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 273/551] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 11 14:27:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 408 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:27:04.664075 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b16c9b-0f82-4ccb-898e-8f00865a86b6 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:04.713472 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128f6383-c5d6-46d8-b53b-ff19576b1958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:04.714522 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128f6383-c5d6-46d8-b53b-ff19576b1958 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:04.715011 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128f6383-c5d6-46d8-b53b-ff19576b1958 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:04.715488 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128f6383-c5d6-46d8-b53b-ff19576b1958 None admin] PATH_INFO: `/v3/domains` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:04.716684 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128f6383-c5d6-46d8-b53b-ff19576b1958 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:04.718417 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128f6383-c5d6-46d8-b53b-ff19576b1958 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:04.720093 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128f6383-c5d6-46d8-b53b-ff19576b1958 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:04.745270 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 279/552] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jul 11 14:27:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:04.746693 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84804730-217a-4242-a489-e1b30bcfd1d3 None None] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:04.751448 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84804730-217a-4242-a489-e1b30bcfd1d3 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:04.751448 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84804730-217a-4242-a489-e1b30bcfd1d3 None None] PATH_INFO: `/` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:04.751448 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 280/553] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:27:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:27:04.754333 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84804730-217a-4242-a489-e1b30bcfd1d3 None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:04.798730 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:04.827306 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b16c9b-0f82-4ccb-898e-8f00865a86b6 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:04.891239 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84804730-217a-4242-a489-e1b30bcfd1d3 None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:04.910779 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfdcb73-0a9b-41c9-8c30-06c9f9776462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:04.911475 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfdcb73-0a9b-41c9-8c30-06c9f9776462 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:04.911757 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfdcb73-0a9b-41c9-8c30-06c9f9776462 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:04.912029 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfdcb73-0a9b-41c9-8c30-06c9f9776462 None admin] PATH_INFO: `/v3/domains` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:04.912845 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfdcb73-0a9b-41c9-8c30-06c9f9776462 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:04.913143 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfdcb73-0a9b-41c9-8c30-06c9f9776462 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:04.914544 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfdcb73-0a9b-41c9-8c30-06c9f9776462 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:04.934114 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 274/554] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jul 11 14:27:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:04.934339 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:04.936439 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b4561f-6d76-4eab-ac7e-08f378d38ea4 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:04.936439 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b4561f-6d76-4eab-ac7e-08f378d38ea4 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:04.936916 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b4561f-6d76-4eab-ac7e-08f378d38ea4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:04.954933 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-64b4561f-6d76-4eab-ac7e-08f378d38ea4 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:27:04.956154 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-64b4561f-6d76-4eab-ac7e-08f378d38ea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:27:04.958759 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e90e3e-baa1-4818-bee1-9fe9776117a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:04.960492 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e90e3e-baa1-4818-bee1-9fe9776117a1 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:04.961334 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e90e3e-baa1-4818-bee1-9fe9776117a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:04.962101 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e90e3e-baa1-4818-bee1-9fe9776117a1 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:04.979398 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e90e3e-baa1-4818-bee1-9fe9776117a1 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:04.982741 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e90e3e-baa1-4818-bee1-9fe9776117a1 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:05.014909 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application [None req-f3e90e3e-baa1-4818-bee1-9fe9776117a1 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 11 14:27:05.014909 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:05.014909 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:05.014909 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:05.014909 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:05.014909 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:05.014909 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:05.014909 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:05.014909 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:05.014909 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:05.014909 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:05.014909 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:05.014909 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 14:27:05.014909 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 14:27:05.014909 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 14:27:05.014909 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 14:27:05.016931 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:05.016931 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:05.016931 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 14:27:05.016931 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:27:05.016931 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 14:27:05.016931 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:27:05.016931 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:05.016931 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:05.016931 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:05.016931 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:05.016931 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:05.016931 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:05.016931 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:05.016931 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:05.016931 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:05.016931 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:05.016931 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:05.016931 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:05.018667 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:05.018667 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:05.018667 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 14:27:05.018667 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 14:27:05.018667 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 14:27:05.018667 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 14:27:05.018667 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 14:27:05.018667 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 14:27:05.018667 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 11 14:27:05.018667 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Jul 11 14:27:05.023513 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 281/555] 10.222.0.70 () {56 vars in 1096 bytes} [Mon Jul 11 14:27:04 2022] GET /identity/v3/users/swift => generated 83 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:27:05.025430 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e90e3e-baa1-4818-bee1-9fe9776117a1 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:05.042882 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 275/556] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:27:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:27:05.052358 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b4561f-6d76-4eab-ac7e-08f378d38ea4 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:05.217182 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:05.230937 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e90e3e-baa1-4818-bee1-9fe9776117a1 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:05.297647 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0e67ec-b15b-4118-8880-82fef47673ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:05.298881 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0e67ec-b15b-4118-8880-82fef47673ae None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:05.299323 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0e67ec-b15b-4118-8880-82fef47673ae None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:05.299758 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0e67ec-b15b-4118-8880-82fef47673ae None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:05.307028 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b4561f-6d76-4eab-ac7e-08f378d38ea4 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:05.314272 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0e67ec-b15b-4118-8880-82fef47673ae None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:05.317623 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0e67ec-b15b-4118-8880-82fef47673ae None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:05.346261 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application [None req-0c0e67ec-b15b-4118-8880-82fef47673ae None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 11 14:27:05.346261 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:05.346261 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:05.346261 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:05.346261 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:05.346261 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:05.346261 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:05.346261 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:05.346261 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:05.346261 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:05.346261 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:05.346261 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:05.346261 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 14:27:05.346261 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 14:27:05.346261 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 14:27:05.346261 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 14:27:05.348136 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:05.348136 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:05.348136 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 14:27:05.348136 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:27:05.348136 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 14:27:05.348136 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:27:05.348136 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:05.348136 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:05.348136 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:05.348136 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:05.348136 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:05.348136 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:05.348136 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:05.348136 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:05.348136 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:05.348136 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:05.348136 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:05.348136 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:05.349811 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:05.349811 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:05.349811 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 14:27:05.349811 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 14:27:05.349811 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 14:27:05.349811 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 14:27:05.349811 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 14:27:05.349811 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 14:27:05.349811 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 11 14:27:05.349811 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Jul 11 14:27:05.355168 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6986322e-aa85-41c8-a34b-eff10103c58c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:05.356141 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6986322e-aa85-41c8-a34b-eff10103c58c None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:05.356603 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6986322e-aa85-41c8-a34b-eff10103c58c None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:05.357021 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6986322e-aa85-41c8-a34b-eff10103c58c None admin] PATH_INFO: `/v3/users` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:05.357136 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 282/557] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Jul 11 14:27:05 2022] GET /identity/v3/users/cinder => generated 84 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:27:05.358144 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6986322e-aa85-41c8-a34b-eff10103c58c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:05.358468 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6986322e-aa85-41c8-a34b-eff10103c58c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:05.358868 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0e67ec-b15b-4118-8880-82fef47673ae None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:05.359965 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6986322e-aa85-41c8-a34b-eff10103c58c None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:05.389041 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 276/558] 10.222.0.70 () {56 vars in 1135 bytes} [Mon Jul 11 14:27:05 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:05.389041 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07535a89-b312-4a9b-9419-011aac741357 None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:05.389041 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07535a89-b312-4a9b-9419-011aac741357 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:05.389041 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07535a89-b312-4a9b-9419-011aac741357 None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:05.390441 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 277/559] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:27:05 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:27:05.391372 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07535a89-b312-4a9b-9419-011aac741357 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:05.448416 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:05.527470 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07535a89-b312-4a9b-9419-011aac741357 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:05.565036 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0e67ec-b15b-4118-8880-82fef47673ae None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:05.570601 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:05.589700 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c4e578-fb98-4db2-a179-5ade6ba0d6da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:05.590384 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c4e578-fb98-4db2-a179-5ade6ba0d6da None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:05.590667 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c4e578-fb98-4db2-a179-5ade6ba0d6da None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:05.590939 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c4e578-fb98-4db2-a179-5ade6ba0d6da None admin] PATH_INFO: `/v3/users` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:05.591789 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c4e578-fb98-4db2-a179-5ade6ba0d6da None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:05.592096 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c4e578-fb98-4db2-a179-5ade6ba0d6da None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:05.593655 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c4e578-fb98-4db2-a179-5ade6ba0d6da None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:05.623990 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148bfa1f-7a96-4cdc-bd36-be6b215d9141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:05.624826 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148bfa1f-7a96-4cdc-bd36-be6b215d9141 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:05.625184 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148bfa1f-7a96-4cdc-bd36-be6b215d9141 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:05.625406 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148bfa1f-7a96-4cdc-bd36-be6b215d9141 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:05.629066 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 278/560] 10.222.0.70 () {56 vars in 1137 bytes} [Mon Jul 11 14:27:05 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:05.630849 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c4e578-fb98-4db2-a179-5ade6ba0d6da None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:05.645898 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148bfa1f-7a96-4cdc-bd36-be6b215d9141 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:27:05.654016 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application [None req-148bfa1f-7a96-4cdc-bd36-be6b215d9141 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:27:05.654016 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:05.654016 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:05.654016 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:05.654016 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:05.654016 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:05.654016 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:05.654016 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:05.654016 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:05.654016 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:05.654016 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:05.654016 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:05.654016 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:27:05.654016 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:27:05.654016 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:27:05.654016 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:27:05.656148 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:27:05.656148 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:27:05.656148 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:27:05.656148 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:27:05.656148 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:05.656148 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:05.656148 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:05.656148 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:05.656148 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:05.656148 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:05.656148 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:05.656148 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:05.656148 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:05.656148 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:05.656148 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:05.656148 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:05.658119 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:05.658119 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:05.658119 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:05.658119 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:05.658119 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:27:05.658119 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:27:05.658119 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:27:05.658119 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:27:05.658119 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:27:05.658119 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:27:05.658119 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:27:05.658119 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Jul 11 14:27:05.658119 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 283/561] 10.222.0.70 () {56 vars in 1102 bytes} [Mon Jul 11 14:27:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:27:05.658119 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d964416-4d7d-4d8b-8693-ab3a31c8141d None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:05.661907 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d964416-4d7d-4d8b-8693-ab3a31c8141d None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:05.661907 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d964416-4d7d-4d8b-8693-ab3a31c8141d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:05.677044 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-1d964416-4d7d-4d8b-8693-ab3a31c8141d None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:27:05.678728 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-1d964416-4d7d-4d8b-8693-ab3a31c8141d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:27:05.772663 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 284/562] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:27:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:27:05.774060 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d964416-4d7d-4d8b-8693-ab3a31c8141d None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:05.829540 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:05.852412 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c4e578-fb98-4db2-a179-5ade6ba0d6da None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:05.922054 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d964416-4d7d-4d8b-8693-ab3a31c8141d None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:05.924976 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818eb80b-29e9-44f4-bbd9-4187e26443e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:05.926327 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818eb80b-29e9-44f4-bbd9-4187e26443e9 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:05.926960 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818eb80b-29e9-44f4-bbd9-4187e26443e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:05.927582 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818eb80b-29e9-44f4-bbd9-4187e26443e9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:05.969357 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4408fe27-dce7-491c-9603-5b9ec821756d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:05.970307 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4408fe27-dce7-491c-9603-5b9ec821756d None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:05.970691 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4408fe27-dce7-491c-9603-5b9ec821756d None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:05.971075 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4408fe27-dce7-491c-9603-5b9ec821756d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:05.986609 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4408fe27-dce7-491c-9603-5b9ec821756d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:05.989819 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4408fe27-dce7-491c-9603-5b9ec821756d None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:06.017231 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:06.025436 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application [None req-4408fe27-dce7-491c-9603-5b9ec821756d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:27:06.025436 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:06.025436 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:06.025436 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:06.025436 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:06.025436 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:06.025436 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:06.025436 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:06.025436 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:06.025436 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:06.025436 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:06.025436 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:06.025436 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:27:06.025436 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:27:06.025436 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:27:06.027091 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:27:06.027091 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:06.027091 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:06.027091 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:06.027091 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:06.027091 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:06.027091 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:06.027091 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:06.027091 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:06.027091 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:06.027091 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:06.027091 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:06.027091 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:06.027091 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:06.027091 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:06.027091 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:06.027091 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:06.029989 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:27:06.029989 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:27:06.029989 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:27:06.029989 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Jul 11 14:27:06.029989 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 285/563] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 11 14:27:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:27:06.029989 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4408fe27-dce7-491c-9603-5b9ec821756d None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:06.062571 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818eb80b-29e9-44f4-bbd9-4187e26443e9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:06.065266 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818eb80b-29e9-44f4-bbd9-4187e26443e9 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:06.146408 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:06.170634 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4408fe27-dce7-491c-9603-5b9ec821756d None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:06.218624 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727d93ad-957d-41bd-9155-8614c5e3ed70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:06.220047 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727d93ad-957d-41bd-9155-8614c5e3ed70 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:06.220711 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727d93ad-957d-41bd-9155-8614c5e3ed70 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:06.221221 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727d93ad-957d-41bd-9155-8614c5e3ed70 None admin] PATH_INFO: `/v3/roles` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:06.222830 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727d93ad-957d-41bd-9155-8614c5e3ed70 None admin] RBAC: Adding query filter params (name=service) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:06.223407 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727d93ad-957d-41bd-9155-8614c5e3ed70 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:06.226095 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727d93ad-957d-41bd-9155-8614c5e3ed70 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:06.246794 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 286/564] 10.222.0.70 () {56 vars in 1103 bytes} [Mon Jul 11 14:27:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:06.246794 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727d93ad-957d-41bd-9155-8614c5e3ed70 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:06.272238 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 279/565] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Jul 11 14:27:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 638 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 14:27:06.272238 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818eb80b-29e9-44f4-bbd9-4187e26443e9 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:06.419935 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:06.444868 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727d93ad-957d-41bd-9155-8614c5e3ed70 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:06.449068 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818eb80b-29e9-44f4-bbd9-4187e26443e9 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:06.502704 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81b494c-060b-4142-ba63-786458e164e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:06.503984 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81b494c-060b-4142-ba63-786458e164e9 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:06.504428 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81b494c-060b-4142-ba63-786458e164e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:06.505044 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81b494c-060b-4142-ba63-786458e164e9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:06.505926 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d8fa1a-15ce-49c0-8cd2-09c5c77c05e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:06.507074 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d8fa1a-15ce-49c0-8cd2-09c5c77c05e5 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:06.507574 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d8fa1a-15ce-49c0-8cd2-09c5c77c05e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:06.508067 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d8fa1a-15ce-49c0-8cd2-09c5c77c05e5 None admin] PATH_INFO: `/v3/domains` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:06.509509 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d8fa1a-15ce-49c0-8cd2-09c5c77c05e5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:06.510465 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d8fa1a-15ce-49c0-8cd2-09c5c77c05e5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:06.511791 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d8fa1a-15ce-49c0-8cd2-09c5c77c05e5 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:06.520872 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81b494c-060b-4142-ba63-786458e164e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:27:06.526103 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 280/566] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jul 11 14:27:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:06.527147 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d8fa1a-15ce-49c0-8cd2-09c5c77c05e5 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:06.532786 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application [None req-d81b494c-060b-4142-ba63-786458e164e9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:27:06.532786 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:06.532786 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:06.532786 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:06.532786 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:06.532786 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:06.532786 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:06.532786 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:06.532786 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:06.532786 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:06.532786 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:06.532786 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:06.532786 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:27:06.532786 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:27:06.532786 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:27:06.532786 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:27:06.535115 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:27:06.535115 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:27:06.535115 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:27:06.535115 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:27:06.535115 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:06.535115 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:06.535115 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:06.535115 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:06.535115 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:06.535115 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:06.535115 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:06.535115 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:06.535115 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:06.535115 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:06.535115 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:06.535115 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:06.537634 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:06.537634 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:06.537634 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:06.537634 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:06.537634 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:27:06.537634 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:27:06.537634 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:27:06.537634 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:27:06.537634 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:27:06.537634 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:27:06.537634 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:27:06.537634 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Jul 11 14:27:06.537634 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 287/567] 10.222.0.70 () {56 vars in 1102 bytes} [Mon Jul 11 14:27:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:27:06.537634 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81b494c-060b-4142-ba63-786458e164e9 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:06.545642 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:06.653148 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d8fa1a-15ce-49c0-8cd2-09c5c77c05e5 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:06.693624 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803dc66e-252a-48ab-8518-0bde7eed375f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:06.694338 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803dc66e-252a-48ab-8518-0bde7eed375f None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:06.694613 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803dc66e-252a-48ab-8518-0bde7eed375f None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:06.694885 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803dc66e-252a-48ab-8518-0bde7eed375f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:06.706541 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803dc66e-252a-48ab-8518-0bde7eed375f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:06.708130 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803dc66e-252a-48ab-8518-0bde7eed375f None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:06.708666 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81b494c-060b-4142-ba63-786458e164e9 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:06.710548 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:06.730350 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-803dc66e-252a-48ab-8518-0bde7eed375f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:27:06.730350 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:06.730350 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:06.730350 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:06.730350 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:06.730350 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:06.730350 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:06.730350 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:06.730350 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:06.730350 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:06.730350 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:06.730350 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:06.730350 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:27:06.730350 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:27:06.730350 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:27:06.732422 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:27:06.732422 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:06.732422 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:06.732422 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:06.732422 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:06.732422 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:06.732422 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:06.732422 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:06.732422 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:06.732422 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:06.732422 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:06.732422 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:06.732422 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:06.732422 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:06.732422 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:06.732422 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:06.732422 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:06.734305 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:27:06.734305 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:27:06.734305 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:27:06.734305 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Jul 11 14:27:06.734305 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 281/568] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 11 14:27:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:27:06.734305 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e621f90-c703-41f2-be9e-fc2d6f9d6c94 None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:06.734950 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e621f90-c703-41f2-be9e-fc2d6f9d6c94 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:06.734950 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e621f90-c703-41f2-be9e-fc2d6f9d6c94 None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:06.737017 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 282/569] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:27:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:27:06.737995 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e621f90-c703-41f2-be9e-fc2d6f9d6c94 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:06.758343 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753a3132-2c23-4058-84f0-6acd9e5d1bda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:06.759161 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753a3132-2c23-4058-84f0-6acd9e5d1bda None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:06.759445 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753a3132-2c23-4058-84f0-6acd9e5d1bda None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:06.759722 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753a3132-2c23-4058-84f0-6acd9e5d1bda None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:06.771923 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753a3132-2c23-4058-84f0-6acd9e5d1bda None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:06.773552 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753a3132-2c23-4058-84f0-6acd9e5d1bda None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:06.793153 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application [None req-753a3132-2c23-4058-84f0-6acd9e5d1bda None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:27:06.793153 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:06.793153 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:06.793153 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:06.793153 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:06.793153 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:06.793153 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:06.793153 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:06.793153 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:06.793153 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:06.793153 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:06.793153 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:06.793153 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:27:06.793153 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:27:06.793153 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:27:06.794910 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:27:06.794910 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:06.794910 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:06.794910 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:06.794910 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:06.794910 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:06.794910 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:06.794910 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:06.794910 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:06.794910 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:06.794910 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:06.794910 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:06.794910 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:06.794910 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:06.794910 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:06.794910 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:06.794910 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:06.796700 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:27:06.796700 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:27:06.796700 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:27:06.796700 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Jul 11 14:27:06.796700 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 288/570] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 11 14:27:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:27:06.796700 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753a3132-2c23-4058-84f0-6acd9e5d1bda None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:06.867875 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:06.893054 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e621f90-c703-41f2-be9e-fc2d6f9d6c94 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:06.927233 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753a3132-2c23-4058-84f0-6acd9e5d1bda None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:06.935867 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9061a89d-97fe-4a11-929a-079e2169c9b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:06.936893 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9061a89d-97fe-4a11-929a-079e2169c9b9 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:06.937263 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9061a89d-97fe-4a11-929a-079e2169c9b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:06.937649 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9061a89d-97fe-4a11-929a-079e2169c9b9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:06.948618 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9061a89d-97fe-4a11-929a-079e2169c9b9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:06.951054 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9061a89d-97fe-4a11-929a-079e2169c9b9 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:06.968692 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-9061a89d-97fe-4a11-929a-079e2169c9b9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:27:06.968692 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:06.968692 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:06.968692 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:06.968692 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:06.968692 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:06.968692 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:06.968692 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:06.968692 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:06.968692 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:06.968692 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:06.968692 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:06.968692 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 14:27:06.968692 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 14:27:06.968692 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 14:27:06.970884 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 14:27:06.970884 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:06.970884 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:06.970884 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:06.970884 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:06.970884 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:06.970884 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:06.970884 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:06.970884 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:06.970884 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:06.970884 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:06.970884 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:06.970884 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:06.970884 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:06.970884 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:06.970884 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:06.970884 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:06.973216 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 14:27:06.973216 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 14:27:06.973216 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 14:27:06.973216 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 14:27:06.973216 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 14:27:06.973216 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 14:27:06.973216 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:27:06.973216 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Jul 11 14:27:06.973216 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 283/571] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Jul 11 14:27:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:27:06.973216 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9061a89d-97fe-4a11-929a-079e2169c9b9 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:06.978809 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5410b4-f21c-4231-9f43-a6abf72d9eb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:06.980324 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5410b4-f21c-4231-9f43-a6abf72d9eb8 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:06.980843 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5410b4-f21c-4231-9f43-a6abf72d9eb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:06.981336 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5410b4-f21c-4231-9f43-a6abf72d9eb8 None admin] PATH_INFO: `/v3/roles` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:06.982788 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5410b4-f21c-4231-9f43-a6abf72d9eb8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:06.983335 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5410b4-f21c-4231-9f43-a6abf72d9eb8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:06.986002 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5410b4-f21c-4231-9f43-a6abf72d9eb8 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:07.000272 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 289/572] 10.222.0.70 () {56 vars in 1103 bytes} [Mon Jul 11 14:27:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:07.001597 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479f388e-ca7f-4c65-b078-fc6a9cd2e47e None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:07.001937 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479f388e-ca7f-4c65-b078-fc6a9cd2e47e None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:07.002160 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479f388e-ca7f-4c65-b078-fc6a9cd2e47e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:07.021700 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-479f388e-ca7f-4c65-b078-fc6a9cd2e47e None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:27:07.022947 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-479f388e-ca7f-4c65-b078-fc6a9cd2e47e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:27:07.046393 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:07.100785 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9061a89d-97fe-4a11-929a-079e2169c9b9 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:07.104687 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 290/573] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:27:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:27:07.105729 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479f388e-ca7f-4c65-b078-fc6a9cd2e47e None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:07.157292 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bd4520-e88c-4621-a3f8-a445241aca1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:07.158100 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bd4520-e88c-4621-a3f8-a445241aca1f None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:07.158496 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bd4520-e88c-4621-a3f8-a445241aca1f None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:07.158860 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bd4520-e88c-4621-a3f8-a445241aca1f None admin] PATH_INFO: `/v3/domains` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:07.160428 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bd4520-e88c-4621-a3f8-a445241aca1f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:07.160855 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bd4520-e88c-4621-a3f8-a445241aca1f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:07.162255 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bd4520-e88c-4621-a3f8-a445241aca1f None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:07.177600 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:07.179814 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 284/574] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jul 11 14:27:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:07.181280 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bd4520-e88c-4621-a3f8-a445241aca1f None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:07.238841 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479f388e-ca7f-4c65-b078-fc6a9cd2e47e None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:07.277669 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d338b7-2c6d-496c-83b5-e4610ad98833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:07.278339 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d338b7-2c6d-496c-83b5-e4610ad98833 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:07.278629 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d338b7-2c6d-496c-83b5-e4610ad98833 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:07.278922 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d338b7-2c6d-496c-83b5-e4610ad98833 None admin] PATH_INFO: `/v3/domains` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:07.279652 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d338b7-2c6d-496c-83b5-e4610ad98833 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:07.279953 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d338b7-2c6d-496c-83b5-e4610ad98833 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:07.281386 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d338b7-2c6d-496c-83b5-e4610ad98833 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:07.294813 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 291/575] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jul 11 14:27:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:07.295670 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d338b7-2c6d-496c-83b5-e4610ad98833 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:07.350040 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bd4520-e88c-4621-a3f8-a445241aca1f None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:07.365677 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:07.393729 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ed811f-7a0b-4c05-b92a-1b7b13a3d63a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:07.394583 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ed811f-7a0b-4c05-b92a-1b7b13a3d63a None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:07.395227 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ed811f-7a0b-4c05-b92a-1b7b13a3d63a None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:07.395602 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ed811f-7a0b-4c05-b92a-1b7b13a3d63a None admin] PATH_INFO: `/v3/projects` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:07.396613 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ed811f-7a0b-4c05-b92a-1b7b13a3d63a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:07.397123 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ed811f-7a0b-4c05-b92a-1b7b13a3d63a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:07.399634 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ed811f-7a0b-4c05-b92a-1b7b13a3d63a None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:07.421028 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 285/576] 10.222.0.70 () {56 vars in 1148 bytes} [Mon Jul 11 14:27:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:07.422347 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ed811f-7a0b-4c05-b92a-1b7b13a3d63a None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:07.426757 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d338b7-2c6d-496c-83b5-e4610ad98833 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:07.439841 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:07.468400 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4f5691-c703-42b6-9a5f-7d9da67afd82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:07.469211 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4f5691-c703-42b6-9a5f-7d9da67afd82 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:07.469499 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4f5691-c703-42b6-9a5f-7d9da67afd82 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:07.469778 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4f5691-c703-42b6-9a5f-7d9da67afd82 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:07.481694 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4f5691-c703-42b6-9a5f-7d9da67afd82 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:07.483159 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4f5691-c703-42b6-9a5f-7d9da67afd82 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:07.501273 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application [None req-ad4f5691-c703-42b6-9a5f-7d9da67afd82 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:27:07.501273 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:07.501273 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:07.501273 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:07.501273 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:07.501273 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:07.501273 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:07.501273 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:07.501273 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:07.501273 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:07.501273 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:07.501273 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:07.501273 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:27:07.501273 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:27:07.501273 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:27:07.507718 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:27:07.507718 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:07.507718 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:07.507718 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:07.507718 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:07.507718 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:07.507718 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:07.507718 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:07.507718 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:07.507718 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:07.507718 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:07.507718 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:07.507718 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:07.507718 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:07.507718 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:07.507718 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:07.507718 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:07.508879 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:27:07.508879 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:27:07.508879 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:27:07.508879 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Jul 11 14:27:07.508879 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 292/577] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 11 14:27:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:27:07.508879 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4f5691-c703-42b6-9a5f-7d9da67afd82 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:07.597673 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ed811f-7a0b-4c05-b92a-1b7b13a3d63a None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:07.621291 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4f5691-c703-42b6-9a5f-7d9da67afd82 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:07.636197 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7ee12e-23f4-4ec0-b356-47abc215c61f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:07.637039 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7ee12e-23f4-4ec0-b356-47abc215c61f None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:07.637544 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7ee12e-23f4-4ec0-b356-47abc215c61f None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:07.637728 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7ee12e-23f4-4ec0-b356-47abc215c61f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:07.653516 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7ee12e-23f4-4ec0-b356-47abc215c61f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:27:07.659611 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea19760e-48f8-4e14-be98-4b6da9219abc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:07.660575 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea19760e-48f8-4e14-be98-4b6da9219abc None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:07.660862 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea19760e-48f8-4e14-be98-4b6da9219abc None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:07.661139 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea19760e-48f8-4e14-be98-4b6da9219abc None admin] PATH_INFO: `/v3/users/glance` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:07.666318 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-eb7ee12e-23f4-4ec0-b356-47abc215c61f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:27:07.666318 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:07.666318 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:07.666318 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:07.666318 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:07.666318 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:07.666318 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:07.666318 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:07.666318 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:07.666318 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:07.666318 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:07.666318 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:07.666318 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:27:07.666318 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:27:07.666318 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:27:07.666318 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:27:07.667321 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:27:07.667321 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:27:07.667321 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:27:07.667321 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:27:07.667321 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:07.667321 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:07.667321 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:07.667321 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:07.667321 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:07.667321 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:07.667321 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:07.667321 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:07.667321 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:07.667321 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:07.667321 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:07.667321 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:07.668150 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:07.668150 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:07.668150 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:07.668150 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:07.668150 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:27:07.668150 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:27:07.668150 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:27:07.668150 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:27:07.668150 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:27:07.668150 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:27:07.668150 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:27:07.668150 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Jul 11 14:27:07.668820 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 286/578] 10.222.0.70 () {56 vars in 1102 bytes} [Mon Jul 11 14:27:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:27:07.670215 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7ee12e-23f4-4ec0-b356-47abc215c61f None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:07.673471 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea19760e-48f8-4e14-be98-4b6da9219abc None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:07.675477 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea19760e-48f8-4e14-be98-4b6da9219abc None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:07.690772 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application [None req-ea19760e-48f8-4e14-be98-4b6da9219abc None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 11 14:27:07.690772 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:07.690772 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:07.690772 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:07.690772 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:07.690772 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:07.690772 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:07.690772 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:07.690772 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:07.690772 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:07.690772 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:07.690772 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:07.690772 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 14:27:07.690772 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 14:27:07.690772 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 14:27:07.690772 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 14:27:07.692551 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:07.692551 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:07.692551 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 14:27:07.692551 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:27:07.692551 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 14:27:07.692551 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:27:07.692551 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:07.692551 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:07.692551 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:07.692551 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:07.692551 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:07.692551 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:07.692551 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:07.692551 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:07.692551 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:07.692551 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:07.692551 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:07.692551 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:07.695442 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:07.695442 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:07.695442 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 14:27:07.695442 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 14:27:07.695442 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 14:27:07.695442 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 14:27:07.695442 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 14:27:07.695442 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 14:27:07.695442 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 11 14:27:07.695442 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Jul 11 14:27:07.695442 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 293/579] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Jul 11 14:27:07 2022] GET /identity/v3/users/glance => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:27:07.695442 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea19760e-48f8-4e14-be98-4b6da9219abc None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:07.724989 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:07.725975 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:07.799835 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7ee12e-23f4-4ec0-b356-47abc215c61f None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:07.821910 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea19760e-48f8-4e14-be98-4b6da9219abc None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:07.842288 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae3dfc2-e371-4949-8f3c-27c0fa2bf847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:07.843462 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae3dfc2-e371-4949-8f3c-27c0fa2bf847 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:07.843749 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae3dfc2-e371-4949-8f3c-27c0fa2bf847 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:07.844028 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae3dfc2-e371-4949-8f3c-27c0fa2bf847 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:07.852841 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae3dfc2-e371-4949-8f3c-27c0fa2bf847 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:07.854395 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae3dfc2-e371-4949-8f3c-27c0fa2bf847 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:07.870923 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-8ae3dfc2-e371-4949-8f3c-27c0fa2bf847 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:27:07.870923 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:07.870923 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:07.870923 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:07.870923 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:07.870923 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:07.870923 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:07.870923 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:07.870923 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:07.870923 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:07.870923 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:07.870923 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:07.870923 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 14:27:07.870923 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 14:27:07.870923 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 14:27:07.872637 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 14:27:07.872637 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:07.872637 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:07.872637 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:07.872637 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:07.872637 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:07.872637 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:07.872637 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:07.872637 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:07.872637 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:07.872637 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:07.872637 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:07.872637 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:07.872637 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:07.872637 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:07.872637 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:07.872637 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:07.874416 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 14:27:07.874416 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 14:27:07.874416 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 14:27:07.874416 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 14:27:07.874416 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 14:27:07.874416 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 14:27:07.874416 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:27:07.874416 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Jul 11 14:27:07.874416 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 287/580] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Jul 11 14:27:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:27:07.874416 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae3dfc2-e371-4949-8f3c-27c0fa2bf847 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:07.885748 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d380d5d9-6245-4d27-b213-66a5a59d0437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:07.886679 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d380d5d9-6245-4d27-b213-66a5a59d0437 None admin] REQUEST_METHOD: `PUT` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:07.886962 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d380d5d9-6245-4d27-b213-66a5a59d0437 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:07.887235 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d380d5d9-6245-4d27-b213-66a5a59d0437 None admin] PATH_INFO: `/v3/projects/ccd34295bf7b435a96b37487c8e89fc3/users/868e7c2dec264512b972c8736d659c34/roles/c766eda9743248fa87df72ec905d271e` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:07.906470 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d380d5d9-6245-4d27-b213-66a5a59d0437 None admin] RBAC: Authorizing `identity:create_grant(project_id=ccd34295bf7b435a96b37487c8e89fc3, user_id=868e7c2dec264512b972c8736d659c34, role_id=c766eda9743248fa87df72ec905d271e)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:07.908227 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d380d5d9-6245-4d27-b213-66a5a59d0437 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:07.928300 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 294/581] 10.222.0.70 () {58 vars in 1439 bytes} [Mon Jul 11 14:27:07 2022] PUT /identity/v3/projects/ccd34295bf7b435a96b37487c8e89fc3/users/868e7c2dec264512b972c8736d659c34/roles/c766eda9743248fa87df72ec905d271e => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:27:07.929701 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d380d5d9-6245-4d27-b213-66a5a59d0437 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:08.037994 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:08.051899 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae3dfc2-e371-4949-8f3c-27c0fa2bf847 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:08.064326 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:08.114361 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0226df89-025c-4f54-a624-0a5b96b45534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:08.115179 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0226df89-025c-4f54-a624-0a5b96b45534 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:08.115473 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0226df89-025c-4f54-a624-0a5b96b45534 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:08.115763 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0226df89-025c-4f54-a624-0a5b96b45534 None admin] PATH_INFO: `/v3/domains` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:08.116637 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0226df89-025c-4f54-a624-0a5b96b45534 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:08.116888 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0226df89-025c-4f54-a624-0a5b96b45534 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:08.118367 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0226df89-025c-4f54-a624-0a5b96b45534 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:08.127291 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d380d5d9-6245-4d27-b213-66a5a59d0437 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:08.132866 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 288/582] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jul 11 14:27:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:08.133533 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0226df89-025c-4f54-a624-0a5b96b45534 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:08.180193 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d8de32-4248-43d5-a74a-42388b55c4b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:08.180922 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d8de32-4248-43d5-a74a-42388b55c4b8 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:08.181219 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d8de32-4248-43d5-a74a-42388b55c4b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:08.181498 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d8de32-4248-43d5-a74a-42388b55c4b8 None admin] PATH_INFO: `/v3/roles` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:08.182512 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d8de32-4248-43d5-a74a-42388b55c4b8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:08.182832 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d8de32-4248-43d5-a74a-42388b55c4b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:08.184293 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d8de32-4248-43d5-a74a-42388b55c4b8 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:08.195093 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 295/583] 10.222.0.70 () {56 vars in 1103 bytes} [Mon Jul 11 14:27:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:08.199871 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d8de32-4248-43d5-a74a-42388b55c4b8 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:08.249838 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0226df89-025c-4f54-a624-0a5b96b45534 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:08.302788 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c9b6ab-ee3d-4077-89be-e608a8039ec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:08.304417 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c9b6ab-ee3d-4077-89be-e608a8039ec0 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:08.304708 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c9b6ab-ee3d-4077-89be-e608a8039ec0 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:08.304989 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c9b6ab-ee3d-4077-89be-e608a8039ec0 None admin] PATH_INFO: `/v3/users` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:08.305853 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c9b6ab-ee3d-4077-89be-e608a8039ec0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:08.306165 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c9b6ab-ee3d-4077-89be-e608a8039ec0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:08.307916 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c9b6ab-ee3d-4077-89be-e608a8039ec0 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:08.327937 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 289/584] 10.222.0.70 () {56 vars in 1137 bytes} [Mon Jul 11 14:27:08 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:08.328838 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c9b6ab-ee3d-4077-89be-e608a8039ec0 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:08.339948 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d8de32-4248-43d5-a74a-42388b55c4b8 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:08.348548 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:08.385449 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:08.391013 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb2956d-4ff1-4921-a913-6387596a9363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:08.392781 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb2956d-4ff1-4921-a913-6387596a9363 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:08.393556 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb2956d-4ff1-4921-a913-6387596a9363 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:08.394436 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb2956d-4ff1-4921-a913-6387596a9363 None admin] PATH_INFO: `/v3/projects` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:08.395920 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb2956d-4ff1-4921-a913-6387596a9363 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:08.396482 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb2956d-4ff1-4921-a913-6387596a9363 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:08.398743 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb2956d-4ff1-4921-a913-6387596a9363 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:08.426495 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 296/585] 10.222.0.70 () {56 vars in 1148 bytes} [Mon Jul 11 14:27:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:08.426495 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb2956d-4ff1-4921-a913-6387596a9363 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:08.481667 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c9b6ab-ee3d-4077-89be-e608a8039ec0 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:08.527033 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651a1680-b9bc-44fe-b1ff-6609972459a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:08.527849 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651a1680-b9bc-44fe-b1ff-6609972459a2 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:08.528144 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651a1680-b9bc-44fe-b1ff-6609972459a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:08.528465 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651a1680-b9bc-44fe-b1ff-6609972459a2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:08.537025 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651a1680-b9bc-44fe-b1ff-6609972459a2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:08.538542 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651a1680-b9bc-44fe-b1ff-6609972459a2 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:08.556349 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-651a1680-b9bc-44fe-b1ff-6609972459a2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 11 14:27:08.556349 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:08.556349 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:08.556349 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:08.556349 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:08.556349 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:08.556349 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:08.556349 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:08.556349 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:08.556349 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:08.556349 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:08.556349 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:08.556349 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 14:27:08.556349 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 14:27:08.556349 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 14:27:08.556349 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 14:27:08.557581 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:08.557581 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:08.557581 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 14:27:08.557581 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:27:08.557581 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 14:27:08.557581 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:27:08.557581 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:08.557581 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:08.557581 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:08.557581 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:08.557581 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:08.557581 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:08.557581 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:08.557581 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:08.557581 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:08.557581 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:08.557581 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:08.557581 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:08.558492 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:08.558492 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:08.558492 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 14:27:08.558492 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 14:27:08.558492 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 14:27:08.558492 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 14:27:08.558492 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 14:27:08.558492 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 14:27:08.558492 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 11 14:27:08.558492 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Jul 11 14:27:08.561964 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 290/586] 10.222.0.70 () {56 vars in 1093 bytes} [Mon Jul 11 14:27:08 2022] GET /identity/v3/users/nova => generated 82 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:27:08.562888 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651a1680-b9bc-44fe-b1ff-6609972459a2 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:08.598071 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb2956d-4ff1-4921-a913-6387596a9363 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:08.663865 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fa54f1-e5f3-41a4-8d7c-dabb26a19e8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:08.665126 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fa54f1-e5f3-41a4-8d7c-dabb26a19e8d None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:08.665414 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fa54f1-e5f3-41a4-8d7c-dabb26a19e8d None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:08.665700 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fa54f1-e5f3-41a4-8d7c-dabb26a19e8d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:08.680141 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:08.685892 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fa54f1-e5f3-41a4-8d7c-dabb26a19e8d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:08.688465 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fa54f1-e5f3-41a4-8d7c-dabb26a19e8d None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:08.719968 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application [None req-f5fa54f1-e5f3-41a4-8d7c-dabb26a19e8d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:27:08.719968 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:08.719968 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:08.719968 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:08.719968 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:08.719968 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:08.719968 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:08.719968 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:08.719968 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:08.719968 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:08.719968 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:08.719968 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:08.719968 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:27:08.719968 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:27:08.719968 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:27:08.721687 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:27:08.721687 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:08.721687 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:08.721687 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:08.721687 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:08.721687 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:08.721687 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:08.721687 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:08.721687 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:08.721687 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:08.721687 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:08.721687 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:08.721687 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:08.721687 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:08.721687 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:08.721687 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:08.721687 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:08.723545 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:27:08.723545 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:27:08.723545 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:27:08.723545 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Jul 11 14:27:08.723545 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 297/587] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 11 14:27:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:27:08.723545 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fa54f1-e5f3-41a4-8d7c-dabb26a19e8d None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:08.744558 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651a1680-b9bc-44fe-b1ff-6609972459a2 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:08.811762 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344eb184-3ea5-41a5-8f96-44f2c0e13768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:08.813100 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344eb184-3ea5-41a5-8f96-44f2c0e13768 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:08.813610 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344eb184-3ea5-41a5-8f96-44f2c0e13768 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:08.814100 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344eb184-3ea5-41a5-8f96-44f2c0e13768 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:08.821218 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:08.834485 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344eb184-3ea5-41a5-8f96-44f2c0e13768 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:08.837015 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344eb184-3ea5-41a5-8f96-44f2c0e13768 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:08.870977 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-344eb184-3ea5-41a5-8f96-44f2c0e13768 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:27:08.870977 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:08.870977 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:08.870977 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:08.870977 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:08.870977 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:08.870977 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:08.870977 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:08.870977 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:08.870977 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:08.870977 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:08.870977 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:08.870977 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:27:08.870977 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:27:08.870977 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:27:08.872139 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:27:08.872139 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:08.872139 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:08.872139 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:08.872139 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:08.872139 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:08.872139 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:08.872139 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:08.872139 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:08.872139 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:08.872139 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:08.872139 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:08.872139 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:08.872139 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:08.872139 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:08.872139 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:08.872139 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:08.874064 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:27:08.874064 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:27:08.874064 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:27:08.874064 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Jul 11 14:27:08.880548 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 291/588] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 11 14:27:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:27:08.881339 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344eb184-3ea5-41a5-8f96-44f2c0e13768 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:08.892128 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fa54f1-e5f3-41a4-8d7c-dabb26a19e8d None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:08.945849 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f165d6a-61c9-4dd2-807e-e54dcb716969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:08.946890 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f165d6a-61c9-4dd2-807e-e54dcb716969 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:08.947338 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f165d6a-61c9-4dd2-807e-e54dcb716969 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:08.947785 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f165d6a-61c9-4dd2-807e-e54dcb716969 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:08.949163 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f165d6a-61c9-4dd2-807e-e54dcb716969 None admin] RBAC: Adding query filter params (role.id=c766eda9743248fa87df72ec905d271e, scope.project.id=ccd34295bf7b435a96b37487c8e89fc3, user.id=0217add2f5e74a80a1a33b160cc57a2b) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:08.949681 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f165d6a-61c9-4dd2-807e-e54dcb716969 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:08.952188 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f165d6a-61c9-4dd2-807e-e54dcb716969 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:08.961231 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 298/589] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Jul 11 14:27:08 2022] GET /identity/v3/role_assignments?user.id=0217add2f5e74a80a1a33b160cc57a2b&scope.project.id=ccd34295bf7b435a96b37487c8e89fc3&role.id=c766eda9743248fa87df72ec905d271e => generated 259 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:08.962561 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f165d6a-61c9-4dd2-807e-e54dcb716969 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:09.078277 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344eb184-3ea5-41a5-8f96-44f2c0e13768 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:09.122593 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:09.145046 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1128b4-c474-4e41-96c5-01078ae829c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:09.146633 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1128b4-c474-4e41-96c5-01078ae829c8 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:09.147374 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1128b4-c474-4e41-96c5-01078ae829c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:09.148067 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1128b4-c474-4e41-96c5-01078ae829c8 None admin] PATH_INFO: `/v3/users` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:09.150014 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1128b4-c474-4e41-96c5-01078ae829c8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:09.150929 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1128b4-c474-4e41-96c5-01078ae829c8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:09.153681 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1128b4-c474-4e41-96c5-01078ae829c8 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:09.156007 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f165d6a-61c9-4dd2-807e-e54dcb716969 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:09.171711 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:09.190449 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 292/590] 10.222.0.70 () {56 vars in 1133 bytes} [Mon Jul 11 14:27:08 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:09.191521 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1128b4-c474-4e41-96c5-01078ae829c8 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:09.220388 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b81a64-0120-4a66-b17b-d83817b817f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:09.221093 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b81a64-0120-4a66-b17b-d83817b817f0 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:09.221378 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b81a64-0120-4a66-b17b-d83817b817f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:09.221912 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b81a64-0120-4a66-b17b-d83817b817f0 None admin] PATH_INFO: `/v3/domains` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:09.222816 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b81a64-0120-4a66-b17b-d83817b817f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:09.223131 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b81a64-0120-4a66-b17b-d83817b817f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:09.224632 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b81a64-0120-4a66-b17b-d83817b817f0 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:09.239446 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 299/591] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jul 11 14:27:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:09.240561 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b81a64-0120-4a66-b17b-d83817b817f0 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:09.336540 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1128b4-c474-4e41-96c5-01078ae829c8 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:09.369309 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b81a64-0120-4a66-b17b-d83817b817f0 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:09.385261 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9930fe-d932-489a-92a3-f505aaab19e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:09.386330 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9930fe-d932-489a-92a3-f505aaab19e1 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:09.386715 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9930fe-d932-489a-92a3-f505aaab19e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:09.387093 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9930fe-d932-489a-92a3-f505aaab19e1 None admin] PATH_INFO: `/v3/domains` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:09.387926 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9930fe-d932-489a-92a3-f505aaab19e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:09.388366 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9930fe-d932-489a-92a3-f505aaab19e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:09.389942 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9930fe-d932-489a-92a3-f505aaab19e1 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:09.403343 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 293/592] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jul 11 14:27:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:09.404393 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9930fe-d932-489a-92a3-f505aaab19e1 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:09.417305 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8b8d85-6838-46db-ae5a-fbd96ea3d8e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:09.418802 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8b8d85-6838-46db-ae5a-fbd96ea3d8e6 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:09.419275 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8b8d85-6838-46db-ae5a-fbd96ea3d8e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:09.420032 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8b8d85-6838-46db-ae5a-fbd96ea3d8e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:09.436242 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8b8d85-6838-46db-ae5a-fbd96ea3d8e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:09.438593 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8b8d85-6838-46db-ae5a-fbd96ea3d8e6 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:09.463167 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application [None req-3f8b8d85-6838-46db-ae5a-fbd96ea3d8e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:27:09.463167 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:09.463167 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:09.463167 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:09.463167 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:09.463167 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:09.463167 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:09.463167 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:09.463167 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:09.463167 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:09.463167 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:09.463167 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:09.463167 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:27:09.463167 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:27:09.463167 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:27:09.464363 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:27:09.464363 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:09.464363 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:09.464363 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:09.464363 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:09.464363 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:09.464363 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:09.464363 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:09.464363 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:09.464363 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:09.464363 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:09.464363 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:09.464363 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:09.464363 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:09.464363 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:09.464363 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:09.464363 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:09.465457 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:27:09.465457 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:27:09.465457 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:27:09.465457 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Jul 11 14:27:09.465847 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:09.468577 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 300/593] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 11 14:27:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:27:09.469687 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8b8d85-6838-46db-ae5a-fbd96ea3d8e6 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:09.501419 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:09.562508 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9930fe-d932-489a-92a3-f505aaab19e1 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:09.623653 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1736fa-dde6-4230-bfff-029e3aeeb2a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:09.624945 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1736fa-dde6-4230-bfff-029e3aeeb2a9 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:09.625430 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1736fa-dde6-4230-bfff-029e3aeeb2a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:09.625914 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1736fa-dde6-4230-bfff-029e3aeeb2a9 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:09.636112 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8b8d85-6838-46db-ae5a-fbd96ea3d8e6 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:09.644019 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1736fa-dde6-4230-bfff-029e3aeeb2a9 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:09.647229 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1736fa-dde6-4230-bfff-029e3aeeb2a9 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:09.678283 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-ce1736fa-dde6-4230-bfff-029e3aeeb2a9 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 11 14:27:09.678283 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:09.678283 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:09.678283 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:09.678283 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:09.678283 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:09.678283 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:09.678283 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:09.678283 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:09.678283 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:09.678283 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:09.678283 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:09.678283 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 14:27:09.678283 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 14:27:09.678283 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 14:27:09.678283 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 14:27:09.679410 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:09.679410 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:09.679410 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 14:27:09.679410 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:27:09.679410 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 14:27:09.679410 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:27:09.679410 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:09.679410 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:09.679410 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:09.679410 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:09.679410 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:09.679410 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:09.679410 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:09.679410 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:09.679410 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:09.679410 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:09.679410 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:09.679410 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:09.680521 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:09.680521 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:09.680521 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 14:27:09.680521 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 14:27:09.680521 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 14:27:09.680521 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 14:27:09.680521 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 14:27:09.680521 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 14:27:09.680521 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 11 14:27:09.680521 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Jul 11 14:27:09.684253 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 294/594] 10.222.0.70 () {56 vars in 1102 bytes} [Mon Jul 11 14:27:09 2022] GET /identity/v3/users/neutron => generated 85 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:27:09.686113 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1736fa-dde6-4230-bfff-029e3aeeb2a9 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:09.696566 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d6cc01-052a-41f7-80ce-f085e231b5ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:09.697766 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d6cc01-052a-41f7-80ce-f085e231b5ee None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:09.698201 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d6cc01-052a-41f7-80ce-f085e231b5ee None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:09.698637 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d6cc01-052a-41f7-80ce-f085e231b5ee None admin] PATH_INFO: `/v3/projects/service` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:09.708870 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d6cc01-052a-41f7-80ce-f085e231b5ee None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:09.710725 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d6cc01-052a-41f7-80ce-f085e231b5ee None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:09.732028 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application [None req-63d6cc01-052a-41f7-80ce-f085e231b5ee None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:27:09.732028 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:09.732028 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:09.732028 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:09.732028 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:09.732028 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:09.732028 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:09.732028 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:09.732028 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:09.732028 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:09.732028 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:09.732028 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:09.732028 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 14:27:09.732028 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 14:27:09.732028 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 14:27:09.733111 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 14:27:09.733111 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:09.733111 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:09.733111 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:09.733111 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:09.733111 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:09.733111 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:09.733111 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:09.733111 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:09.733111 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:09.733111 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:09.733111 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:09.733111 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:09.733111 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:09.733111 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:09.733111 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:09.733111 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:09.734104 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 14:27:09.734104 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 14:27:09.734104 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 14:27:09.734104 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 14:27:09.734104 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 14:27:09.734104 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 14:27:09.734104 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:27:09.734104 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Jul 11 14:27:09.736766 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 301/595] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Jul 11 14:27:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:27:09.738462 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d6cc01-052a-41f7-80ce-f085e231b5ee None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:09.856847 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:09.884590 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d6cc01-052a-41f7-80ce-f085e231b5ee None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:09.885008 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1736fa-dde6-4230-bfff-029e3aeeb2a9 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:09.932872 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edb3aa6-7f28-489e-a569-a5d1f7bda726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:09.934050 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edb3aa6-7f28-489e-a569-a5d1f7bda726 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:09.934499 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edb3aa6-7f28-489e-a569-a5d1f7bda726 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:09.935414 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edb3aa6-7f28-489e-a569-a5d1f7bda726 None admin] PATH_INFO: `/v3/users` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:09.936536 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edb3aa6-7f28-489e-a569-a5d1f7bda726 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:09.937299 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edb3aa6-7f28-489e-a569-a5d1f7bda726 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:09.938915 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edb3aa6-7f28-489e-a569-a5d1f7bda726 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:09.948670 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a36d3e-7f01-4d41-b089-4437de0c907a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:09.950026 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a36d3e-7f01-4d41-b089-4437de0c907a None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:09.950708 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a36d3e-7f01-4d41-b089-4437de0c907a None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:09.952139 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a36d3e-7f01-4d41-b089-4437de0c907a None admin] PATH_INFO: `/v3/domains` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:09.952709 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a36d3e-7f01-4d41-b089-4437de0c907a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:09.953368 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a36d3e-7f01-4d41-b089-4437de0c907a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:09.956656 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a36d3e-7f01-4d41-b089-4437de0c907a None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:09.964122 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 302/596] 10.222.0.70 () {56 vars in 1139 bytes} [Mon Jul 11 14:27:09 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:09.965953 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edb3aa6-7f28-489e-a569-a5d1f7bda726 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:09.972855 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:09.996423 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 295/597] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jul 11 14:27:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:09.998708 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a36d3e-7f01-4d41-b089-4437de0c907a None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:10.107093 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edb3aa6-7f28-489e-a569-a5d1f7bda726 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:10.154855 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c87d79-4c74-48c4-a26a-33d24a28565b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:10.156052 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c87d79-4c74-48c4-a26a-33d24a28565b None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:10.156593 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c87d79-4c74-48c4-a26a-33d24a28565b None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:10.157092 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c87d79-4c74-48c4-a26a-33d24a28565b None admin] PATH_INFO: `/v3/projects` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:10.160400 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c87d79-4c74-48c4-a26a-33d24a28565b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:10.160988 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c87d79-4c74-48c4-a26a-33d24a28565b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:10.165073 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c87d79-4c74-48c4-a26a-33d24a28565b None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:10.189516 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:10.199965 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 303/598] 10.222.0.70 () {56 vars in 1148 bytes} [Mon Jul 11 14:27:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:10.201525 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c87d79-4c74-48c4-a26a-33d24a28565b None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:10.211924 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a36d3e-7f01-4d41-b089-4437de0c907a None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:10.261893 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bf8140-e72d-4fc0-96f6-77b23cbba1cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:10.263116 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bf8140-e72d-4fc0-96f6-77b23cbba1cb None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:10.263600 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bf8140-e72d-4fc0-96f6-77b23cbba1cb None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:10.264071 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bf8140-e72d-4fc0-96f6-77b23cbba1cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:10.279049 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bf8140-e72d-4fc0-96f6-77b23cbba1cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:10.280756 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bf8140-e72d-4fc0-96f6-77b23cbba1cb None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:10.305628 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-e9bf8140-e72d-4fc0-96f6-77b23cbba1cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:27:10.305628 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:10.305628 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:10.305628 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:10.305628 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:10.305628 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:10.305628 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:10.305628 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:10.305628 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:10.305628 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:10.305628 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:10.305628 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:10.305628 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:27:10.305628 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:27:10.305628 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:27:10.307965 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:27:10.307965 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:10.307965 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:10.307965 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:10.307965 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:10.307965 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:10.307965 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:10.307965 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:10.307965 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:10.307965 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:10.307965 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:10.307965 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:10.307965 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:10.307965 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:10.307965 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:10.307965 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:10.307965 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:10.309102 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:27:10.309102 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:27:10.309102 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:27:10.309102 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Jul 11 14:27:10.309102 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 296/599] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 11 14:27:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:27:10.309102 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bf8140-e72d-4fc0-96f6-77b23cbba1cb None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:10.335720 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:10.401107 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c87d79-4c74-48c4-a26a-33d24a28565b None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:10.447541 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb217bc-217c-41ea-af32-505c16fe69c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:10.448541 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb217bc-217c-41ea-af32-505c16fe69c3 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:10.448902 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb217bc-217c-41ea-af32-505c16fe69c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:10.449383 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb217bc-217c-41ea-af32-505c16fe69c3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:10.459065 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb217bc-217c-41ea-af32-505c16fe69c3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:10.460167 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bf8140-e72d-4fc0-96f6-77b23cbba1cb None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:10.460639 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb217bc-217c-41ea-af32-505c16fe69c3 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:10.477602 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application [None req-fdb217bc-217c-41ea-af32-505c16fe69c3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:27:10.477602 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:10.477602 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:10.477602 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:10.477602 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:10.477602 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:10.477602 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:10.477602 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:10.477602 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:10.477602 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:10.477602 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:10.477602 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:10.477602 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 14:27:10.477602 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 14:27:10.477602 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 14:27:10.478552 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 14:27:10.478552 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:10.478552 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:10.478552 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:10.478552 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:10.478552 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:10.478552 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:10.478552 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:10.478552 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:10.478552 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:10.478552 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:10.478552 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:10.478552 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:10.478552 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:10.478552 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:10.478552 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:10.478552 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:10.479445 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 14:27:10.479445 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 14:27:10.479445 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 14:27:10.479445 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 14:27:10.479445 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 14:27:10.479445 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 14:27:10.479445 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:27:10.479445 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Jul 11 14:27:10.483978 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 304/600] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Jul 11 14:27:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:27:10.484834 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb217bc-217c-41ea-af32-505c16fe69c3 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:10.503502 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aefa57a-ef31-43f1-9f5d-dfb3553b5135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:10.505539 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aefa57a-ef31-43f1-9f5d-dfb3553b5135 None admin] REQUEST_METHOD: `PUT` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:10.506079 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aefa57a-ef31-43f1-9f5d-dfb3553b5135 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:10.506579 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aefa57a-ef31-43f1-9f5d-dfb3553b5135 None admin] PATH_INFO: `/v3/projects/ccd34295bf7b435a96b37487c8e89fc3/users/fa21b44163d84534b9ca1ffe5b5a6071/roles/c766eda9743248fa87df72ec905d271e` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:10.523541 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aefa57a-ef31-43f1-9f5d-dfb3553b5135 None admin] RBAC: Authorizing `identity:create_grant(project_id=ccd34295bf7b435a96b37487c8e89fc3, user_id=fa21b44163d84534b9ca1ffe5b5a6071, role_id=c766eda9743248fa87df72ec905d271e)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:10.525452 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aefa57a-ef31-43f1-9f5d-dfb3553b5135 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:10.548413 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 297/601] 10.222.0.70 () {58 vars in 1439 bytes} [Mon Jul 11 14:27:10 2022] PUT /identity/v3/projects/ccd34295bf7b435a96b37487c8e89fc3/users/fa21b44163d84534b9ca1ffe5b5a6071/roles/c766eda9743248fa87df72ec905d271e => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:27:10.549905 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aefa57a-ef31-43f1-9f5d-dfb3553b5135 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:10.564257 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:10.632864 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb217bc-217c-41ea-af32-505c16fe69c3 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:10.679514 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c3e512-bb60-4b62-aefa-4c69eee70d8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:10.681652 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c3e512-bb60-4b62-aefa-4c69eee70d8d None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:10.682710 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c3e512-bb60-4b62-aefa-4c69eee70d8d None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:10.683218 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c3e512-bb60-4b62-aefa-4c69eee70d8d None admin] PATH_INFO: `/v3/domains` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:10.684282 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c3e512-bb60-4b62-aefa-4c69eee70d8d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:10.684844 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c3e512-bb60-4b62-aefa-4c69eee70d8d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:10.686527 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c3e512-bb60-4b62-aefa-4c69eee70d8d None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:10.702911 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 305/602] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jul 11 14:27:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:10.710892 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc237e6-1377-4f09-a8f4-174ba3028dc5 None None] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:10.711426 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc237e6-1377-4f09-a8f4-174ba3028dc5 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:10.711981 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc237e6-1377-4f09-a8f4-174ba3028dc5 None None] PATH_INFO: `/` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:10.714075 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 306/603] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:27:10 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:27:10.715136 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc237e6-1377-4f09-a8f4-174ba3028dc5 None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:10.722402 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:10.790064 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aefa57a-ef31-43f1-9f5d-dfb3553b5135 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:10.846065 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fc39ac-bf9d-4f01-9e10-e6a5b0aa6a04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:10.847571 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fc39ac-bf9d-4f01-9e10-e6a5b0aa6a04 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:10.848117 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fc39ac-bf9d-4f01-9e10-e6a5b0aa6a04 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:10.848669 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fc39ac-bf9d-4f01-9e10-e6a5b0aa6a04 None admin] PATH_INFO: `/v3/projects` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:10.849706 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fc39ac-bf9d-4f01-9e10-e6a5b0aa6a04 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:10.850240 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fc39ac-bf9d-4f01-9e10-e6a5b0aa6a04 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:10.852070 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fc39ac-bf9d-4f01-9e10-e6a5b0aa6a04 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:10.866875 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 298/604] 10.222.0.70 () {56 vars in 1148 bytes} [Mon Jul 11 14:27:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:10.868595 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbe4f9b-b7fd-402f-a0a4-60e02038d75c None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:10.869098 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbe4f9b-b7fd-402f-a0a4-60e02038d75c None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:10.869575 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbe4f9b-b7fd-402f-a0a4-60e02038d75c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:10.875993 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc237e6-1377-4f09-a8f4-174ba3028dc5 None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:10.904673 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-0cbe4f9b-b7fd-402f-a0a4-60e02038d75c None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:27:10.906873 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:10.908889 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-0cbe4f9b-b7fd-402f-a0a4-60e02038d75c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:27:10.945899 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9e8c14-8e34-4d7a-a055-b114429ec638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:10.947588 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9e8c14-8e34-4d7a-a055-b114429ec638 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:10.948354 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9e8c14-8e34-4d7a-a055-b114429ec638 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:10.949026 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9e8c14-8e34-4d7a-a055-b114429ec638 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:10.962400 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9e8c14-8e34-4d7a-a055-b114429ec638 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:10.965323 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9e8c14-8e34-4d7a-a055-b114429ec638 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:10.991439 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application [None req-2b9e8c14-8e34-4d7a-a055-b114429ec638 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:27:10.991439 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:10.991439 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:10.991439 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:10.991439 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:10.991439 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:10.991439 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:10.991439 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:10.991439 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:10.991439 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:10.991439 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:10.991439 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:10.991439 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 14:27:10.991439 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 14:27:10.991439 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 14:27:10.993470 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 14:27:10.993470 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:10.993470 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:10.993470 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:10.993470 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:10.993470 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:10.993470 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:10.993470 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:10.993470 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:10.993470 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:10.993470 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:10.993470 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:10.993470 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:10.993470 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:10.993470 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:10.993470 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:10.993470 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:10.995489 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 14:27:10.995489 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 14:27:10.995489 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 14:27:10.995489 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 14:27:10.995489 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 14:27:10.995489 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 14:27:10.995489 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:27:10.995489 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Jul 11 14:27:11.003599 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 307/605] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Jul 11 14:27:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:27:11.005365 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9e8c14-8e34-4d7a-a055-b114429ec638 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:11.080777 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 299/606] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:27:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:27:11.083181 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbe4f9b-b7fd-402f-a0a4-60e02038d75c None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:11.211441 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:11.223293 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9e8c14-8e34-4d7a-a055-b114429ec638 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:11.303934 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cb8ec7-8088-46ec-8205-9a5310594c32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:11.306215 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cb8ec7-8088-46ec-8205-9a5310594c32 None admin] REQUEST_METHOD: `PUT` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:11.307550 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cb8ec7-8088-46ec-8205-9a5310594c32 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:11.308279 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cb8ec7-8088-46ec-8205-9a5310594c32 None admin] PATH_INFO: `/v3/projects/ccd34295bf7b435a96b37487c8e89fc3/users/f4f8c0d696af4bd5a205ca8e9110b8cc/roles/c766eda9743248fa87df72ec905d271e` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:11.313894 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbe4f9b-b7fd-402f-a0a4-60e02038d75c None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:11.345310 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cb8ec7-8088-46ec-8205-9a5310594c32 None admin] RBAC: Authorizing `identity:create_grant(project_id=ccd34295bf7b435a96b37487c8e89fc3, user_id=f4f8c0d696af4bd5a205ca8e9110b8cc, role_id=c766eda9743248fa87df72ec905d271e)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:11.351367 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cb8ec7-8088-46ec-8205-9a5310594c32 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:11.391962 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 308/607] 10.222.0.70 () {58 vars in 1439 bytes} [Mon Jul 11 14:27:11 2022] PUT /identity/v3/projects/ccd34295bf7b435a96b37487c8e89fc3/users/f4f8c0d696af4bd5a205ca8e9110b8cc/roles/c766eda9743248fa87df72ec905d271e => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:27:11.395024 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cb8ec7-8088-46ec-8205-9a5310594c32 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:11.398710 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e976a00a-acc4-4b29-99f4-937c51f7f29f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:11.399949 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e976a00a-acc4-4b29-99f4-937c51f7f29f None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:11.403865 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e976a00a-acc4-4b29-99f4-937c51f7f29f None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:11.403865 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e976a00a-acc4-4b29-99f4-937c51f7f29f None admin] PATH_INFO: `/v3/projects` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:11.403865 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e976a00a-acc4-4b29-99f4-937c51f7f29f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:11.403865 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e976a00a-acc4-4b29-99f4-937c51f7f29f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:11.408297 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e976a00a-acc4-4b29-99f4-937c51f7f29f None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:11.437727 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 300/608] 10.222.0.70 () {56 vars in 1148 bytes} [Mon Jul 11 14:27:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:11.449070 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e976a00a-acc4-4b29-99f4-937c51f7f29f None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:11.506325 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:11.692349 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e976a00a-acc4-4b29-99f4-937c51f7f29f None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:11.727707 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:11.734717 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cb8ec7-8088-46ec-8205-9a5310594c32 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:11.781590 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0993b1-5f53-4348-8e3a-c4c03a61a113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:11.784837 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0993b1-5f53-4348-8e3a-c4c03a61a113 None admin] REQUEST_METHOD: `PUT` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:11.786044 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0993b1-5f53-4348-8e3a-c4c03a61a113 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:11.786334 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0993b1-5f53-4348-8e3a-c4c03a61a113 None admin] PATH_INFO: `/v3/projects/ccd34295bf7b435a96b37487c8e89fc3/users/20eede5ccd834862b00123310b5c3975/roles/c766eda9743248fa87df72ec905d271e` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:11.789681 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7108faf7-069c-434b-9357-3509d81e4022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:11.790598 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7108faf7-069c-434b-9357-3509d81e4022 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:11.790962 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7108faf7-069c-434b-9357-3509d81e4022 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:11.791302 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7108faf7-069c-434b-9357-3509d81e4022 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:11.807090 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7108faf7-069c-434b-9357-3509d81e4022 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:27:11.816974 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application [None req-7108faf7-069c-434b-9357-3509d81e4022 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:27:11.816974 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:11.816974 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:11.816974 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:11.816974 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:11.816974 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:11.816974 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:11.816974 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:11.816974 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:11.816974 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:11.816974 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:11.816974 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:11.816974 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:27:11.816974 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:27:11.816974 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:27:11.816974 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:27:11.818900 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:27:11.818900 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:27:11.818900 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:27:11.818900 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:27:11.818900 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:11.818900 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:11.818900 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:11.818900 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:11.818900 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:11.818900 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:11.818900 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:11.818900 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:11.818900 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:11.818900 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:11.818900 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:11.818900 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:11.821320 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:11.821320 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:11.821320 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:11.821320 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:11.821320 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:27:11.821320 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:27:11.821320 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:27:11.821320 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:27:11.821320 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:27:11.821320 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:27:11.821320 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:27:11.821320 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Jul 11 14:27:11.821320 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 309/609] 10.222.0.70 () {56 vars in 1102 bytes} [Mon Jul 11 14:27:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 425 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:27:11.821320 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c149c1-1aa4-4ae1-8523-be9fb9da26dc None None] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:11.823063 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c149c1-1aa4-4ae1-8523-be9fb9da26dc None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:11.823063 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c149c1-1aa4-4ae1-8523-be9fb9da26dc None None] PATH_INFO: `/` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:11.824753 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 310/610] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:27:11 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:27:11.828692 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c149c1-1aa4-4ae1-8523-be9fb9da26dc None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:11.831714 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0993b1-5f53-4348-8e3a-c4c03a61a113 None admin] RBAC: Authorizing `identity:create_grant(project_id=ccd34295bf7b435a96b37487c8e89fc3, user_id=20eede5ccd834862b00123310b5c3975, role_id=c766eda9743248fa87df72ec905d271e)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:11.835332 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0993b1-5f53-4348-8e3a-c4c03a61a113 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:11.864377 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 301/611] 10.222.0.70 () {58 vars in 1439 bytes} [Mon Jul 11 14:27:11 2022] PUT /identity/v3/projects/ccd34295bf7b435a96b37487c8e89fc3/users/20eede5ccd834862b00123310b5c3975/roles/c766eda9743248fa87df72ec905d271e => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:27:11.866736 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ef174f-cdd8-4727-9366-c63879566314 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:11.867052 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ef174f-cdd8-4727-9366-c63879566314 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:11.867301 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ef174f-cdd8-4727-9366-c63879566314 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:11.886738 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-48ef174f-cdd8-4727-9366-c63879566314 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:27:11.888021 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-48ef174f-cdd8-4727-9366-c63879566314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:27:12.023831 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 302/612] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:27:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:27:12.056354 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ef174f-cdd8-4727-9366-c63879566314 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:12.059032 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:12.121079 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c149c1-1aa4-4ae1-8523-be9fb9da26dc None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:12.164826 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0735c9-0cac-4009-8f77-11155c1f358c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:12.165522 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0735c9-0cac-4009-8f77-11155c1f358c None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:12.165815 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0735c9-0cac-4009-8f77-11155c1f358c None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:12.166092 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0735c9-0cac-4009-8f77-11155c1f358c None admin] PATH_INFO: `/v3/roles` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:12.167189 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0735c9-0cac-4009-8f77-11155c1f358c None admin] RBAC: Adding query filter params (name=service) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:12.167189 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0735c9-0cac-4009-8f77-11155c1f358c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:12.168665 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0735c9-0cac-4009-8f77-11155c1f358c None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:12.179721 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 311/613] 10.222.0.70 () {56 vars in 1103 bytes} [Mon Jul 11 14:27:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:12.185230 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0735c9-0cac-4009-8f77-11155c1f358c None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:12.263222 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:12.273275 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ef174f-cdd8-4727-9366-c63879566314 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:12.305629 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0735c9-0cac-4009-8f77-11155c1f358c None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:12.351831 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418926cb-d13b-4503-ab90-4d0a77728355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:12.351831 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418926cb-d13b-4503-ab90-4d0a77728355 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:12.351831 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418926cb-d13b-4503-ab90-4d0a77728355 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:12.351831 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418926cb-d13b-4503-ab90-4d0a77728355 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:12.365610 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418926cb-d13b-4503-ab90-4d0a77728355 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:12.367135 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418926cb-d13b-4503-ab90-4d0a77728355 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:12.381780 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ec95f4-5e26-4710-ba7b-722245af3dbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:12.382662 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ec95f4-5e26-4710-ba7b-722245af3dbe None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:12.382888 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ec95f4-5e26-4710-ba7b-722245af3dbe None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:12.383172 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ec95f4-5e26-4710-ba7b-722245af3dbe None admin] PATH_INFO: `/v3/roles/service` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:12.387009 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application [None req-418926cb-d13b-4503-ab90-4d0a77728355 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:27:12.387009 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:12.387009 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:12.387009 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:12.387009 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:12.387009 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:12.387009 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:12.387009 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:12.387009 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:12.387009 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:12.387009 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:12.387009 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:12.387009 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:27:12.387009 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:27:12.387009 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:27:12.388599 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:27:12.388599 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:12.388599 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:12.388599 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:12.388599 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:12.388599 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:12.388599 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:12.388599 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:12.388599 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:12.388599 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:12.388599 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:12.388599 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:12.388599 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:12.388599 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:12.388599 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:12.388599 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:12.388599 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:12.391457 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:27:12.391457 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:27:12.391457 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:27:12.391457 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Jul 11 14:27:12.391457 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 312/614] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 11 14:27:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:27:12.395464 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418926cb-d13b-4503-ab90-4d0a77728355 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:12.401216 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:12.417462 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ec95f4-5e26-4710-ba7b-722245af3dbe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:27:12.425984 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-f5ec95f4-5e26-4710-ba7b-722245af3dbe None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:27:12.425984 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:12.425984 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:12.425984 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:12.425984 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:12.425984 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:12.425984 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:12.425984 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:12.425984 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:12.425984 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:12.425984 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:12.425984 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:12.425984 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:27:12.425984 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:27:12.425984 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:27:12.425984 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:27:12.427794 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:27:12.427794 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:27:12.427794 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:27:12.427794 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:27:12.427794 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:12.427794 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:12.427794 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:12.427794 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:12.427794 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:12.427794 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:12.427794 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:12.427794 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:12.427794 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:12.427794 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:12.427794 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:12.427794 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:12.430297 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:12.430297 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:12.430297 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:12.430297 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:12.430297 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:27:12.430297 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:27:12.430297 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:27:12.430297 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:27:12.430297 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:27:12.430297 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:27:12.430297 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:27:12.430297 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Jul 11 14:27:12.433542 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 303/615] 10.222.0.70 () {56 vars in 1102 bytes} [Mon Jul 11 14:27:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 376 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:27:12.433915 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ec95f4-5e26-4710-ba7b-722245af3dbe None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:12.582711 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418926cb-d13b-4503-ab90-4d0a77728355 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:12.637143 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6464a192-eb3e-4979-ac8e-d94b47dbc777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:12.637876 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6464a192-eb3e-4979-ac8e-d94b47dbc777 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:12.638197 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6464a192-eb3e-4979-ac8e-d94b47dbc777 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:12.638483 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6464a192-eb3e-4979-ac8e-d94b47dbc777 None admin] PATH_INFO: `/v3/domains` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:12.639248 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6464a192-eb3e-4979-ac8e-d94b47dbc777 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:12.639561 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6464a192-eb3e-4979-ac8e-d94b47dbc777 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:12.641012 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6464a192-eb3e-4979-ac8e-d94b47dbc777 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:12.672341 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 313/616] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jul 11 14:27:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:12.678159 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6464a192-eb3e-4979-ac8e-d94b47dbc777 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:12.692595 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ec95f4-5e26-4710-ba7b-722245af3dbe None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:12.740278 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ca9800-38a8-4ca5-8840-20825d17bf1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:12.740977 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ca9800-38a8-4ca5-8840-20825d17bf1a None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:12.741263 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ca9800-38a8-4ca5-8840-20825d17bf1a None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:12.741536 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ca9800-38a8-4ca5-8840-20825d17bf1a None admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:12.742298 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ca9800-38a8-4ca5-8840-20825d17bf1a None admin] RBAC: Adding query filter params (name=service) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:12.742608 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ca9800-38a8-4ca5-8840-20825d17bf1a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:12.744005 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ca9800-38a8-4ca5-8840-20825d17bf1a None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:12.770743 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 304/617] 10.222.0.70 () {56 vars in 1103 bytes} [Mon Jul 11 14:27:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:27:12.776016 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ca9800-38a8-4ca5-8840-20825d17bf1a None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:12.824681 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:12.850213 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:12.929729 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6464a192-eb3e-4979-ac8e-d94b47dbc777 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:13.012227 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1516c061-0a4e-4fc7-a25c-dd12db7a0ea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:13.013581 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1516c061-0a4e-4fc7-a25c-dd12db7a0ea0 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:13.014079 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1516c061-0a4e-4fc7-a25c-dd12db7a0ea0 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:13.014583 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1516c061-0a4e-4fc7-a25c-dd12db7a0ea0 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:13.026403 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ca9800-38a8-4ca5-8840-20825d17bf1a None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:13.051772 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1516c061-0a4e-4fc7-a25c-dd12db7a0ea0 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:13.054996 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1516c061-0a4e-4fc7-a25c-dd12db7a0ea0 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:13.070041 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14325f48-4fa3-4a43-a864-e3613affd4e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:13.071372 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14325f48-4fa3-4a43-a864-e3613affd4e8 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:13.071860 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14325f48-4fa3-4a43-a864-e3613affd4e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:13.072378 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14325f48-4fa3-4a43-a864-e3613affd4e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:13.090357 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application [None req-1516c061-0a4e-4fc7-a25c-dd12db7a0ea0 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 11 14:27:13.090357 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:13.090357 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:13.090357 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:13.090357 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:13.090357 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:13.090357 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:13.090357 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:13.090357 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:13.090357 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:13.090357 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:13.090357 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:13.090357 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 14:27:13.090357 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 14:27:13.090357 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 14:27:13.090357 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 14:27:13.091680 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:13.091680 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:13.091680 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 14:27:13.091680 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:27:13.091680 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 14:27:13.091680 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:27:13.091680 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:13.091680 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:13.091680 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:13.091680 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:13.091680 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:13.091680 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:13.091680 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:13.091680 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:13.091680 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:13.091680 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:13.091680 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:13.091680 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:13.093371 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:13.093371 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:13.093371 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 14:27:13.093371 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 14:27:13.093371 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 14:27:13.093371 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 14:27:13.093371 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 14:27:13.093371 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 14:27:13.093371 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 11 14:27:13.093371 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Jul 11 14:27:13.094389 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 314/618] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Jul 11 14:27:12 2022] GET /identity/v3/users/cinder => generated 84 bytes in 416 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:27:13.104431 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1516c061-0a4e-4fc7-a25c-dd12db7a0ea0 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:13.107253 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14325f48-4fa3-4a43-a864-e3613affd4e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:13.110044 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14325f48-4fa3-4a43-a864-e3613affd4e8 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:13.155853 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-14325f48-4fa3-4a43-a864-e3613affd4e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:27:13.155853 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:13.155853 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:13.155853 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:13.155853 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:13.155853 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:13.155853 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:13.155853 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:13.155853 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:13.155853 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:13.155853 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:13.155853 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:13.155853 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:27:13.155853 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:27:13.155853 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:27:13.159467 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:27:13.159467 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:13.159467 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:13.159467 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:13.159467 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:13.159467 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:13.159467 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:13.159467 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:13.159467 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:13.159467 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:13.159467 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:13.159467 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:13.159467 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:13.159467 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:13.159467 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:13.159467 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:13.159467 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:13.163618 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:27:13.163618 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:27:13.163618 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:27:13.163618 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Jul 11 14:27:13.163618 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 305/619] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 11 14:27:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 386 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:27:13.177347 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14325f48-4fa3-4a43-a864-e3613affd4e8 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:13.347919 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:13.357453 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1516c061-0a4e-4fc7-a25c-dd12db7a0ea0 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:13.388650 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:13.404497 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f4652e-ada1-4731-bec8-ace8f3e5a372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:13.405186 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f4652e-ada1-4731-bec8-ace8f3e5a372 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:13.405483 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f4652e-ada1-4731-bec8-ace8f3e5a372 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:13.405733 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f4652e-ada1-4731-bec8-ace8f3e5a372 None admin] PATH_INFO: `/v3/users` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:13.406591 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f4652e-ada1-4731-bec8-ace8f3e5a372 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:13.406900 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f4652e-ada1-4731-bec8-ace8f3e5a372 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:13.408379 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f4652e-ada1-4731-bec8-ace8f3e5a372 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:13.417914 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14325f48-4fa3-4a43-a864-e3613affd4e8 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:13.434674 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 315/620] 10.222.0.70 () {56 vars in 1137 bytes} [Mon Jul 11 14:27:13 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:13.436175 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c722c749-faec-4b1f-a27c-384f18c7c32c None None] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:13.436507 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c722c749-faec-4b1f-a27c-384f18c7c32c None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:13.436787 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c722c749-faec-4b1f-a27c-384f18c7c32c None None] PATH_INFO: `/` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:13.444251 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 316/621] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:27:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:27:13.444251 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c722c749-faec-4b1f-a27c-384f18c7c32c None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:13.496379 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b864fe-dd15-421e-9093-4484db189e51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:13.497573 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b864fe-dd15-421e-9093-4484db189e51 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:13.498084 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b864fe-dd15-421e-9093-4484db189e51 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:13.498589 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b864fe-dd15-421e-9093-4484db189e51 None admin] PATH_INFO: `/v3/domains` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:13.499928 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b864fe-dd15-421e-9093-4484db189e51 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:13.500541 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b864fe-dd15-421e-9093-4484db189e51 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:13.503729 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b864fe-dd15-421e-9093-4484db189e51 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:13.528342 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 306/622] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jul 11 14:27:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:13.530807 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4d6e05-5e1d-44f6-ad28-5a2f0e81d008 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:13.531314 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4d6e05-5e1d-44f6-ad28-5a2f0e81d008 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:13.531803 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4d6e05-5e1d-44f6-ad28-5a2f0e81d008 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:13.562261 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-4a4d6e05-5e1d-44f6-ad28-5a2f0e81d008 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:27:13.567013 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-4a4d6e05-5e1d-44f6-ad28-5a2f0e81d008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:27:13.590951 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c722c749-faec-4b1f-a27c-384f18c7c32c None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:13.638839 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68c3c90-7361-416b-9375-c82b061b4534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:13.639836 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68c3c90-7361-416b-9375-c82b061b4534 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:13.640423 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68c3c90-7361-416b-9375-c82b061b4534 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:13.640846 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68c3c90-7361-416b-9375-c82b061b4534 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:13.720690 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:13.740863 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 307/623] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:27:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:27:13.742697 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4d6e05-5e1d-44f6-ad28-5a2f0e81d008 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:13.751496 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68c3c90-7361-416b-9375-c82b061b4534 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:13.751496 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68c3c90-7361-416b-9375-c82b061b4534 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:13.849723 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:13.900484 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 317/624] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Jul 11 14:27:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 14:27:13.904533 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68c3c90-7361-416b-9375-c82b061b4534 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:13.910747 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4d6e05-5e1d-44f6-ad28-5a2f0e81d008 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:13.967109 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c55eef-5c13-483c-9808-15fa2cf085d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:13.969072 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c55eef-5c13-483c-9808-15fa2cf085d7 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:13.969863 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c55eef-5c13-483c-9808-15fa2cf085d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:13.970640 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c55eef-5c13-483c-9808-15fa2cf085d7 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:13.988409 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c55eef-5c13-483c-9808-15fa2cf085d7 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:13.991979 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c55eef-5c13-483c-9808-15fa2cf085d7 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:14.026712 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-91c55eef-5c13-483c-9808-15fa2cf085d7 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 11 14:27:14.026712 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:14.026712 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:14.026712 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:14.026712 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:14.026712 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:14.026712 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:14.026712 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:14.026712 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:14.026712 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:14.026712 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:14.026712 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:14.026712 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 14:27:14.026712 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 14:27:14.026712 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 14:27:14.026712 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 14:27:14.029030 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:14.029030 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:14.029030 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 14:27:14.029030 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:27:14.029030 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 14:27:14.029030 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:27:14.029030 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:14.029030 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:14.029030 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:14.029030 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:14.029030 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:14.029030 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:14.029030 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:14.029030 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:14.029030 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:14.029030 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:14.029030 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:14.029030 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:14.030885 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:14.030885 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:14.030885 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 14:27:14.030885 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 14:27:14.030885 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 14:27:14.030885 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 14:27:14.030885 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 14:27:14.030885 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 14:27:14.030885 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 11 14:27:14.030885 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Jul 11 14:27:14.032977 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:14.042968 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 308/625] 10.222.0.70 () {56 vars in 1096 bytes} [Mon Jul 11 14:27:13 2022] GET /identity/v3/users/swift => generated 83 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:27:14.044949 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c55eef-5c13-483c-9808-15fa2cf085d7 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:14.056931 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68c3c90-7361-416b-9375-c82b061b4534 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:14.112237 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b57f4c0-59a4-4958-86f9-f2f907c6976f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:14.112237 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b57f4c0-59a4-4958-86f9-f2f907c6976f None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:14.112237 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b57f4c0-59a4-4958-86f9-f2f907c6976f None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:14.112237 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b57f4c0-59a4-4958-86f9-f2f907c6976f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:14.129284 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b57f4c0-59a4-4958-86f9-f2f907c6976f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:27:14.138742 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application [None req-7b57f4c0-59a4-4958-86f9-f2f907c6976f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:27:14.138742 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:14.138742 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:14.138742 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:14.138742 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:14.138742 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:14.138742 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:14.138742 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:14.138742 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:14.138742 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:14.138742 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:14.138742 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:14.138742 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:27:14.138742 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:27:14.138742 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:27:14.138742 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:27:14.149188 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:27:14.149188 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:27:14.149188 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:27:14.149188 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:27:14.149188 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:14.149188 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:14.149188 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:14.149188 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:14.149188 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:14.149188 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:14.149188 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:14.149188 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:14.149188 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:14.149188 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:14.149188 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:14.149188 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:14.150878 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:14.150878 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:14.150878 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:14.150878 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:14.150878 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:27:14.150878 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:27:14.150878 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:27:14.150878 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:27:14.150878 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:27:14.150878 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:27:14.150878 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:27:14.150878 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Jul 11 14:27:14.150878 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 318/626] 10.222.0.70 () {56 vars in 1102 bytes} [Mon Jul 11 14:27:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:27:14.150878 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b57f4c0-59a4-4958-86f9-f2f907c6976f None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:14.258138 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c55eef-5c13-483c-9808-15fa2cf085d7 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:14.281679 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b57f4c0-59a4-4958-86f9-f2f907c6976f None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:14.292949 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:14.327146 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c67e952-704d-4072-928f-176d40b87083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:14.327843 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264a8cee-0f34-40ac-adad-c8ca6586e014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:14.328584 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264a8cee-0f34-40ac-adad-c8ca6586e014 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:14.328863 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264a8cee-0f34-40ac-adad-c8ca6586e014 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:14.329143 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264a8cee-0f34-40ac-adad-c8ca6586e014 None admin] PATH_INFO: `/v3/users` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:14.330009 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264a8cee-0f34-40ac-adad-c8ca6586e014 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:14.330320 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264a8cee-0f34-40ac-adad-c8ca6586e014 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:14.330906 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c67e952-704d-4072-928f-176d40b87083 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:14.332559 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c67e952-704d-4072-928f-176d40b87083 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:14.332769 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264a8cee-0f34-40ac-adad-c8ca6586e014 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:14.333553 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c67e952-704d-4072-928f-176d40b87083 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:14.354201 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:14.355104 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c67e952-704d-4072-928f-176d40b87083 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:14.359296 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c67e952-704d-4072-928f-176d40b87083 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:14.380521 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 319/627] 10.222.0.70 () {56 vars in 1135 bytes} [Mon Jul 11 14:27:14 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:14.380521 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264a8cee-0f34-40ac-adad-c8ca6586e014 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:14.401533 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-7c67e952-704d-4072-928f-176d40b87083 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:27:14.401533 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:14.401533 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:14.401533 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:14.401533 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:14.401533 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:14.401533 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:14.401533 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:14.401533 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:14.401533 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:14.401533 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:14.401533 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:14.401533 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:27:14.401533 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:27:14.401533 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:27:14.403384 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:27:14.403384 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:14.403384 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:14.403384 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:14.403384 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:14.403384 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:14.403384 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:14.403384 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:14.403384 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:14.403384 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:14.403384 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:14.403384 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:14.403384 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:14.403384 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:14.403384 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:14.403384 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:14.403384 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:14.405178 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:27:14.405178 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:27:14.405178 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:27:14.405178 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Jul 11 14:27:14.415363 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 309/628] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 11 14:27:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 371 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:27:14.417275 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c67e952-704d-4072-928f-176d40b87083 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:14.578192 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264a8cee-0f34-40ac-adad-c8ca6586e014 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:14.594864 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c67e952-704d-4072-928f-176d40b87083 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:14.635191 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373c8efd-ae26-4478-bcf9-4008a808619f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:14.635999 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373c8efd-ae26-4478-bcf9-4008a808619f None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:14.636345 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373c8efd-ae26-4478-bcf9-4008a808619f None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:14.636598 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373c8efd-ae26-4478-bcf9-4008a808619f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:14.637578 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c567547-57c5-44cb-8e1c-264f35d567d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:14.638263 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c567547-57c5-44cb-8e1c-264f35d567d1 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:14.638547 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c567547-57c5-44cb-8e1c-264f35d567d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:14.639026 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c567547-57c5-44cb-8e1c-264f35d567d1 None admin] PATH_INFO: `/v3/roles` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:14.639586 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c567547-57c5-44cb-8e1c-264f35d567d1 None admin] RBAC: Adding query filter params (name=service) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:14.639924 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c567547-57c5-44cb-8e1c-264f35d567d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:14.641325 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c567547-57c5-44cb-8e1c-264f35d567d1 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:14.650724 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373c8efd-ae26-4478-bcf9-4008a808619f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:14.651596 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 320/629] 10.222.0.70 () {56 vars in 1103 bytes} [Mon Jul 11 14:27:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:14.652424 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c567547-57c5-44cb-8e1c-264f35d567d1 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:14.653114 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373c8efd-ae26-4478-bcf9-4008a808619f None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:14.676229 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-373c8efd-ae26-4478-bcf9-4008a808619f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:27:14.676229 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:14.676229 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:14.676229 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:14.676229 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:14.676229 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:14.676229 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:14.676229 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:14.676229 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:14.676229 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:14.676229 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:14.676229 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:14.676229 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:27:14.676229 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:27:14.676229 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:27:14.677594 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:27:14.677594 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:14.677594 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:14.677594 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:14.677594 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:14.677594 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:14.677594 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:14.677594 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:14.677594 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:14.677594 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:14.677594 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:14.677594 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:14.677594 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:14.677594 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:14.677594 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:14.677594 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:14.677594 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:14.679364 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:27:14.679364 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:27:14.679364 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:27:14.679364 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Jul 11 14:27:14.679364 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 310/630] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 11 14:27:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:27:14.679364 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98d0247-e32e-4684-bd88-0d7c527ab749 None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:14.679364 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98d0247-e32e-4684-bd88-0d7c527ab749 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:14.679364 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98d0247-e32e-4684-bd88-0d7c527ab749 None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:14.686582 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 311/631] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:27:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:27:14.686582 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98d0247-e32e-4684-bd88-0d7c527ab749 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:14.717519 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:14.763979 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:14.822745 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c567547-57c5-44cb-8e1c-264f35d567d1 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:14.829324 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98d0247-e32e-4684-bd88-0d7c527ab749 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:14.869704 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f37205-e756-4131-a720-36f5a621685e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:14.870381 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f37205-e756-4131-a720-36f5a621685e None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:14.870666 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f37205-e756-4131-a720-36f5a621685e None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:14.870946 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f37205-e756-4131-a720-36f5a621685e None admin] PATH_INFO: `/v3/domains` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:14.871692 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f37205-e756-4131-a720-36f5a621685e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:14.872134 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f37205-e756-4131-a720-36f5a621685e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:14.873598 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f37205-e756-4131-a720-36f5a621685e None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:14.878982 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b831bd1-a38e-4132-b78f-e3edf22e0ae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:14.880288 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b831bd1-a38e-4132-b78f-e3edf22e0ae6 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:14.880808 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b831bd1-a38e-4132-b78f-e3edf22e0ae6 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:14.881292 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b831bd1-a38e-4132-b78f-e3edf22e0ae6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:14.896265 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 321/632] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jul 11 14:27:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:14.896265 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f37205-e756-4131-a720-36f5a621685e None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:14.896693 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b831bd1-a38e-4132-b78f-e3edf22e0ae6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:14.896840 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b831bd1-a38e-4132-b78f-e3edf22e0ae6 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:14.915921 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-7b831bd1-a38e-4132-b78f-e3edf22e0ae6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:27:14.915921 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:14.915921 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:14.915921 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:14.915921 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:14.915921 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:14.915921 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:14.915921 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:14.915921 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:14.915921 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:14.915921 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:14.915921 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:14.915921 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:27:14.915921 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:27:14.915921 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:27:14.917658 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:27:14.917658 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:14.917658 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:14.917658 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:14.917658 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:14.917658 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:14.917658 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:14.917658 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:14.917658 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:14.917658 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:14.917658 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:14.917658 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:14.917658 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:14.917658 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:14.917658 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:14.917658 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:14.917658 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:14.919387 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:27:14.919387 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:27:14.919387 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:27:14.919387 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Jul 11 14:27:14.919387 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 312/633] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 11 14:27:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:27:14.919387 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636e1ca8-d572-4664-8826-f4c9437902b4 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:14.919387 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636e1ca8-d572-4664-8826-f4c9437902b4 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:14.919387 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636e1ca8-d572-4664-8826-f4c9437902b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:14.941543 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-636e1ca8-d572-4664-8826-f4c9437902b4 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:27:14.942514 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-636e1ca8-d572-4664-8826-f4c9437902b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:27:15.031703 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 313/634] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:27:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:27:15.032631 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636e1ca8-d572-4664-8826-f4c9437902b4 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:15.036193 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f37205-e756-4131-a720-36f5a621685e None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:15.047325 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:15.079017 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:15.101935 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf0b0f3-1eb7-4c22-81ec-9d997e50d03a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:15.102812 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf0b0f3-1eb7-4c22-81ec-9d997e50d03a None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:15.103291 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf0b0f3-1eb7-4c22-81ec-9d997e50d03a None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:15.103688 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf0b0f3-1eb7-4c22-81ec-9d997e50d03a None admin] PATH_INFO: `/v3/domains` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:15.104713 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf0b0f3-1eb7-4c22-81ec-9d997e50d03a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:15.105237 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf0b0f3-1eb7-4c22-81ec-9d997e50d03a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:15.106803 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf0b0f3-1eb7-4c22-81ec-9d997e50d03a None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:15.124583 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 322/635] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jul 11 14:27:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:15.126034 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf0b0f3-1eb7-4c22-81ec-9d997e50d03a None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:15.201441 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636e1ca8-d572-4664-8826-f4c9437902b4 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:15.248033 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ad830b-13dd-4c3a-8799-d0a9a3edbf94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:15.248882 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ad830b-13dd-4c3a-8799-d0a9a3edbf94 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:15.249167 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ad830b-13dd-4c3a-8799-d0a9a3edbf94 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:15.249833 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ad830b-13dd-4c3a-8799-d0a9a3edbf94 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:15.257382 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ad830b-13dd-4c3a-8799-d0a9a3edbf94 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:15.259054 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ad830b-13dd-4c3a-8799-d0a9a3edbf94 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:15.277755 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf0b0f3-1eb7-4c22-81ec-9d997e50d03a None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:15.278031 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-78ad830b-13dd-4c3a-8799-d0a9a3edbf94 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:27:15.278031 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:15.278031 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:15.278031 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:15.278031 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:15.278031 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:15.278031 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:15.278031 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:15.278031 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:15.278031 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:15.278031 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:15.278031 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:15.278031 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 14:27:15.278031 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 14:27:15.278031 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 14:27:15.279994 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 14:27:15.279994 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:15.279994 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:15.279994 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:15.279994 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:15.279994 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:15.279994 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:15.279994 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:15.279994 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:15.279994 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:15.279994 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:15.279994 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:15.279994 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:15.279994 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:15.279994 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:15.279994 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:15.279994 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:15.289474 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 14:27:15.289474 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 14:27:15.289474 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 14:27:15.289474 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 14:27:15.289474 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 14:27:15.289474 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 14:27:15.289474 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:27:15.289474 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Jul 11 14:27:15.289474 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 314/636] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Jul 11 14:27:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:27:15.289474 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ad830b-13dd-4c3a-8799-d0a9a3edbf94 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:15.322310 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8483d1b1-99a3-423a-b21d-0d7d103fe79f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:15.323165 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8483d1b1-99a3-423a-b21d-0d7d103fe79f None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:15.323518 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8483d1b1-99a3-423a-b21d-0d7d103fe79f None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:15.323902 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8483d1b1-99a3-423a-b21d-0d7d103fe79f None admin] PATH_INFO: `/v3/domains` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:15.324827 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8483d1b1-99a3-423a-b21d-0d7d103fe79f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:15.325241 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8483d1b1-99a3-423a-b21d-0d7d103fe79f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:15.326900 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8483d1b1-99a3-423a-b21d-0d7d103fe79f None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:15.341312 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 323/637] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jul 11 14:27:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:15.342272 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8483d1b1-99a3-423a-b21d-0d7d103fe79f None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:15.376977 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:15.401354 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:15.426385 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ad830b-13dd-4c3a-8799-d0a9a3edbf94 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:15.464363 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0deb69e-9471-4648-8c6f-b0e9ec6532b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:15.465085 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0deb69e-9471-4648-8c6f-b0e9ec6532b9 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:15.465368 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0deb69e-9471-4648-8c6f-b0e9ec6532b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:15.465644 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0deb69e-9471-4648-8c6f-b0e9ec6532b9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:15.477020 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0deb69e-9471-4648-8c6f-b0e9ec6532b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:27:15.485008 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-a0deb69e-9471-4648-8c6f-b0e9ec6532b9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:27:15.485008 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:15.485008 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:15.485008 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:15.485008 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:15.485008 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:15.485008 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:15.485008 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:15.485008 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:15.485008 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:15.485008 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:15.485008 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:15.485008 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:27:15.485008 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:27:15.485008 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:27:15.485008 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:27:15.486270 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:27:15.486270 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:27:15.486270 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:27:15.486270 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:27:15.486270 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:15.486270 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:15.486270 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:15.486270 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:15.486270 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:15.486270 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:15.486270 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:15.486270 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:15.486270 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:15.486270 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:15.486270 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:15.486270 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:15.487811 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:15.487811 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:15.487811 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:15.487811 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:15.487811 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:27:15.487811 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:27:15.487811 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:27:15.487811 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:27:15.487811 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:27:15.487811 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:27:15.487811 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:27:15.487811 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Jul 11 14:27:15.487811 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 315/638] 10.222.0.70 () {56 vars in 1102 bytes} [Mon Jul 11 14:27:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:27:15.488716 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd6b2be-8e7b-43b4-ac07-a96df2387aa8 None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:15.488716 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd6b2be-8e7b-43b4-ac07-a96df2387aa8 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:15.488716 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd6b2be-8e7b-43b4-ac07-a96df2387aa8 None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:15.490042 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 316/639] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:27:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:27:15.490662 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd6b2be-8e7b-43b4-ac07-a96df2387aa8 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:15.502435 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8483d1b1-99a3-423a-b21d-0d7d103fe79f None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:15.542469 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b382486-4367-4065-b16d-2929263f93dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:15.543670 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b382486-4367-4065-b16d-2929263f93dd None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:15.544116 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b382486-4367-4065-b16d-2929263f93dd None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:15.544640 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b382486-4367-4065-b16d-2929263f93dd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:15.556346 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b382486-4367-4065-b16d-2929263f93dd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:15.559061 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b382486-4367-4065-b16d-2929263f93dd None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:15.580915 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application [None req-7b382486-4367-4065-b16d-2929263f93dd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:27:15.580915 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:15.580915 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:15.580915 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:15.580915 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:15.580915 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:15.580915 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:15.580915 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:15.580915 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:15.580915 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:15.580915 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:15.580915 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:15.580915 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 14:27:15.580915 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 14:27:15.580915 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 14:27:15.581913 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 14:27:15.581913 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:15.581913 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:15.581913 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:15.581913 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:15.581913 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:15.581913 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:15.581913 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:15.581913 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:15.581913 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:15.581913 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:15.581913 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:15.581913 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:15.581913 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:15.581913 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:15.581913 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:15.581913 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:15.582833 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 14:27:15.582833 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 14:27:15.582833 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 14:27:15.582833 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 14:27:15.582833 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 14:27:15.582833 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 14:27:15.582833 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:27:15.582833 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Jul 11 14:27:15.582833 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 324/640] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Jul 11 14:27:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:27:15.583740 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b382486-4367-4065-b16d-2929263f93dd None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:15.631393 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd6b2be-8e7b-43b4-ac07-a96df2387aa8 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:15.657709 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:15.671643 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e54fe7-24c5-47ba-8090-e14c95f23101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:15.672389 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e54fe7-24c5-47ba-8090-e14c95f23101 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:15.672685 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e54fe7-24c5-47ba-8090-e14c95f23101 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:15.672963 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e54fe7-24c5-47ba-8090-e14c95f23101 None admin] PATH_INFO: `/v3/projects` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:15.673790 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e54fe7-24c5-47ba-8090-e14c95f23101 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:15.674102 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e54fe7-24c5-47ba-8090-e14c95f23101 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:15.675763 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e54fe7-24c5-47ba-8090-e14c95f23101 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:15.691714 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 317/641] 10.222.0.70 () {56 vars in 1148 bytes} [Mon Jul 11 14:27:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:15.693179 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2227bcb-6fa6-48c0-bb57-13b736ed0021 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:15.693472 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2227bcb-6fa6-48c0-bb57-13b736ed0021 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:15.693890 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2227bcb-6fa6-48c0-bb57-13b736ed0021 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:15.701986 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:15.705419 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b382486-4367-4065-b16d-2929263f93dd None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:15.712034 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-d2227bcb-6fa6-48c0-bb57-13b736ed0021 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:27:15.713313 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-d2227bcb-6fa6-48c0-bb57-13b736ed0021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:27:15.744323 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5879313b-2e64-48fa-801e-a1ffe2fcc4f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:15.745233 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5879313b-2e64-48fa-801e-a1ffe2fcc4f8 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:15.745648 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5879313b-2e64-48fa-801e-a1ffe2fcc4f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:15.746026 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5879313b-2e64-48fa-801e-a1ffe2fcc4f8 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:15.755754 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5879313b-2e64-48fa-801e-a1ffe2fcc4f8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:15.757282 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5879313b-2e64-48fa-801e-a1ffe2fcc4f8 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:15.773582 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application [None req-5879313b-2e64-48fa-801e-a1ffe2fcc4f8 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 11 14:27:15.773582 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:15.773582 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:15.773582 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:15.773582 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:15.773582 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:15.773582 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:15.773582 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:15.773582 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:15.773582 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:15.773582 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:15.773582 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:15.773582 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 14:27:15.773582 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 14:27:15.773582 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 14:27:15.773582 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 14:27:15.782881 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:15.782881 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:15.782881 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 14:27:15.782881 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:27:15.782881 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 14:27:15.782881 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:27:15.782881 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:15.782881 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:15.782881 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:15.782881 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:15.782881 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:15.782881 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:15.782881 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:15.782881 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:15.782881 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:15.782881 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:15.782881 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:15.782881 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:15.785149 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:15.785149 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:15.785149 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 14:27:15.785149 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 14:27:15.785149 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 14:27:15.785149 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 14:27:15.785149 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 14:27:15.785149 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 14:27:15.785149 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 11 14:27:15.785149 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Jul 11 14:27:15.785149 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 325/642] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Jul 11 14:27:15 2022] GET /identity/v3/users/glance => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:27:15.785149 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5879313b-2e64-48fa-801e-a1ffe2fcc4f8 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:15.804257 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 318/643] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:27:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:27:15.804257 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2227bcb-6fa6-48c0-bb57-13b736ed0021 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:15.926887 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2227bcb-6fa6-48c0-bb57-13b736ed0021 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:15.942886 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:15.961717 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5879313b-2e64-48fa-801e-a1ffe2fcc4f8 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:15.968248 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552a3e9d-0488-41df-ab14-494a54f2e628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:15.969058 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552a3e9d-0488-41df-ab14-494a54f2e628 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:15.969470 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552a3e9d-0488-41df-ab14-494a54f2e628 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:15.969846 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552a3e9d-0488-41df-ab14-494a54f2e628 None admin] PATH_INFO: `/v3/projects` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:15.970806 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552a3e9d-0488-41df-ab14-494a54f2e628 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:15.971249 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552a3e9d-0488-41df-ab14-494a54f2e628 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:15.973051 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552a3e9d-0488-41df-ab14-494a54f2e628 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:15.989142 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 319/644] 10.222.0.70 () {56 vars in 1148 bytes} [Mon Jul 11 14:27:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:15.990555 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552a3e9d-0488-41df-ab14-494a54f2e628 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:16.002098 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860d7313-5fdf-4863-b04c-349ac49fc151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:16.003155 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860d7313-5fdf-4863-b04c-349ac49fc151 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:16.003450 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860d7313-5fdf-4863-b04c-349ac49fc151 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:16.003797 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860d7313-5fdf-4863-b04c-349ac49fc151 None admin] PATH_INFO: `/v3/roles` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:16.004661 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860d7313-5fdf-4863-b04c-349ac49fc151 None admin] RBAC: Adding query filter params (name=service) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:16.004994 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860d7313-5fdf-4863-b04c-349ac49fc151 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:16.006394 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860d7313-5fdf-4863-b04c-349ac49fc151 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:16.015084 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 326/645] 10.222.0.70 () {56 vars in 1103 bytes} [Mon Jul 11 14:27:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:16.015930 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860d7313-5fdf-4863-b04c-349ac49fc151 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:16.046855 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:16.134961 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552a3e9d-0488-41df-ab14-494a54f2e628 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:16.135707 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860d7313-5fdf-4863-b04c-349ac49fc151 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:16.177476 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd6b636-faf5-49b0-bed2-e7898bc3ae01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:16.178162 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd6b636-faf5-49b0-bed2-e7898bc3ae01 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:16.178461 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd6b636-faf5-49b0-bed2-e7898bc3ae01 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:16.178735 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd6b636-faf5-49b0-bed2-e7898bc3ae01 None admin] PATH_INFO: `/v3/users` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:16.179593 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd6b636-faf5-49b0-bed2-e7898bc3ae01 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:16.179903 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd6b636-faf5-49b0-bed2-e7898bc3ae01 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:16.181396 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd6b636-faf5-49b0-bed2-e7898bc3ae01 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:16.195214 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e6de9f-9dd5-4b27-9cb8-b3438514dc9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:16.196366 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e6de9f-9dd5-4b27-9cb8-b3438514dc9c None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:16.196865 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e6de9f-9dd5-4b27-9cb8-b3438514dc9c None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:16.197359 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e6de9f-9dd5-4b27-9cb8-b3438514dc9c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:16.198946 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e6de9f-9dd5-4b27-9cb8-b3438514dc9c None admin] RBAC: Adding query filter params (role.id=c766eda9743248fa87df72ec905d271e, scope.project.id=ccd34295bf7b435a96b37487c8e89fc3, user.id=868e7c2dec264512b972c8736d659c34) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:16.199496 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e6de9f-9dd5-4b27-9cb8-b3438514dc9c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:16.200796 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 327/646] 10.222.0.70 () {56 vars in 1137 bytes} [Mon Jul 11 14:27:16 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:16.201683 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd6b636-faf5-49b0-bed2-e7898bc3ae01 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:16.202294 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e6de9f-9dd5-4b27-9cb8-b3438514dc9c None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:16.211680 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 320/647] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Jul 11 14:27:15 2022] GET /identity/v3/role_assignments?user.id=868e7c2dec264512b972c8736d659c34&scope.project.id=ccd34295bf7b435a96b37487c8e89fc3&role.id=c766eda9743248fa87df72ec905d271e => generated 608 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:16.212551 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e6de9f-9dd5-4b27-9cb8-b3438514dc9c None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:16.290983 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:16.356542 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:16.387862 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd6b636-faf5-49b0-bed2-e7898bc3ae01 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:16.400594 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e6de9f-9dd5-4b27-9cb8-b3438514dc9c None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:16.454006 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc29d104-bba7-4ce1-97c4-2289cc774d68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:16.455324 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc29d104-bba7-4ce1-97c4-2289cc774d68 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:16.455930 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc29d104-bba7-4ce1-97c4-2289cc774d68 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:16.456045 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43f0da7-b379-4130-a423-9f2d6b943fd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:16.456461 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc29d104-bba7-4ce1-97c4-2289cc774d68 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:16.457875 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43f0da7-b379-4130-a423-9f2d6b943fd7 None admin] REQUEST_METHOD: `PUT` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:16.458371 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43f0da7-b379-4130-a423-9f2d6b943fd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:16.458857 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43f0da7-b379-4130-a423-9f2d6b943fd7 None admin] PATH_INFO: `/v3/projects/ccd34295bf7b435a96b37487c8e89fc3/users/0217add2f5e74a80a1a33b160cc57a2b/roles/c766eda9743248fa87df72ec905d271e` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:16.477661 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc29d104-bba7-4ce1-97c4-2289cc774d68 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:27:16.491334 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43f0da7-b379-4130-a423-9f2d6b943fd7 None admin] RBAC: Authorizing `identity:create_grant(project_id=ccd34295bf7b435a96b37487c8e89fc3, user_id=0217add2f5e74a80a1a33b160cc57a2b, role_id=c766eda9743248fa87df72ec905d271e)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:16.492694 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application [None req-fc29d104-bba7-4ce1-97c4-2289cc774d68 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:27:16.492694 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:16.492694 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:16.492694 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:16.492694 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:16.492694 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:16.492694 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:16.492694 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:16.492694 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:16.492694 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:16.492694 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:16.492694 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:16.492694 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:27:16.492694 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:27:16.492694 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:27:16.492694 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:27:16.493668 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:27:16.493668 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:27:16.493668 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:27:16.493668 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:27:16.493668 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:16.493668 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:16.493668 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:16.493668 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:16.493668 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:16.493668 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:16.493668 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:16.493668 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:16.493668 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:16.493668 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:16.493668 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:16.493668 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:16.494567 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:16.494567 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:16.494567 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:16.494567 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:16.494567 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:27:16.494567 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:27:16.494567 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:27:16.494567 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:27:16.494567 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:27:16.494567 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:27:16.494567 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:27:16.494567 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Jul 11 14:27:16.495254 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43f0da7-b379-4130-a423-9f2d6b943fd7 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:16.495333 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 328/648] 10.222.0.70 () {56 vars in 1102 bytes} [Mon Jul 11 14:27:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:27:16.500505 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc29d104-bba7-4ce1-97c4-2289cc774d68 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:16.529364 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 321/649] 10.222.0.70 () {58 vars in 1439 bytes} [Mon Jul 11 14:27:16 2022] PUT /identity/v3/projects/ccd34295bf7b435a96b37487c8e89fc3/users/0217add2f5e74a80a1a33b160cc57a2b/roles/c766eda9743248fa87df72ec905d271e => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:27:16.529364 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43f0da7-b379-4130-a423-9f2d6b943fd7 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:16.706494 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:16.719021 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc29d104-bba7-4ce1-97c4-2289cc774d68 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:16.724370 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43f0da7-b379-4130-a423-9f2d6b943fd7 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:16.784959 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54ffb0c-d20c-4efb-98b4-0b526c93c4e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:16.785753 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54ffb0c-d20c-4efb-98b4-0b526c93c4e9 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:16.786049 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54ffb0c-d20c-4efb-98b4-0b526c93c4e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:16.786335 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54ffb0c-d20c-4efb-98b4-0b526c93c4e9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:16.800487 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00374abf-002e-4c95-ab18-2eb3ef03250b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:16.801504 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00374abf-002e-4c95-ab18-2eb3ef03250b None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:16.801922 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00374abf-002e-4c95-ab18-2eb3ef03250b None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:16.802336 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00374abf-002e-4c95-ab18-2eb3ef03250b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:16.816935 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:16.819225 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00374abf-002e-4c95-ab18-2eb3ef03250b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:16.821527 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00374abf-002e-4c95-ab18-2eb3ef03250b None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:16.854306 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application [None req-00374abf-002e-4c95-ab18-2eb3ef03250b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:27:16.854306 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:16.854306 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:16.854306 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:16.854306 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:16.854306 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:16.854306 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:16.854306 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:16.854306 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:16.854306 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:16.854306 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:16.854306 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:16.854306 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:27:16.854306 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:27:16.854306 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:27:16.855269 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:27:16.855269 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:16.855269 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:16.855269 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:16.855269 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:16.855269 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:16.855269 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:16.855269 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:16.855269 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:16.855269 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:16.855269 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:16.855269 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:16.855269 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:16.855269 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:16.855269 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:16.855269 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:16.855269 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:16.856166 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:27:16.856166 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:27:16.856166 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:27:16.856166 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Jul 11 14:27:16.856166 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 329/650] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 11 14:27:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 360 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:27:16.856793 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00374abf-002e-4c95-ab18-2eb3ef03250b None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:16.898462 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54ffb0c-d20c-4efb-98b4-0b526c93c4e9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:16.900640 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54ffb0c-d20c-4efb-98b4-0b526c93c4e9 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:16.985584 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00374abf-002e-4c95-ab18-2eb3ef03250b None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:17.003870 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:17.023874 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde7cfaf-0422-4b19-8f4a-7b8af04b3711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:17.024731 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 322/651] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Jul 11 14:27:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 500 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 14:27:17.025224 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde7cfaf-0422-4b19-8f4a-7b8af04b3711 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:17.025675 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54ffb0c-d20c-4efb-98b4-0b526c93c4e9 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:17.025894 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde7cfaf-0422-4b19-8f4a-7b8af04b3711 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:17.026354 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde7cfaf-0422-4b19-8f4a-7b8af04b3711 None admin] PATH_INFO: `/v3/roles` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:17.027305 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde7cfaf-0422-4b19-8f4a-7b8af04b3711 None admin] RBAC: Adding query filter params (name=service) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:17.027794 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde7cfaf-0422-4b19-8f4a-7b8af04b3711 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:17.029431 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde7cfaf-0422-4b19-8f4a-7b8af04b3711 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:17.044632 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 330/652] 10.222.0.70 () {56 vars in 1103 bytes} [Mon Jul 11 14:27:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:17.045952 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde7cfaf-0422-4b19-8f4a-7b8af04b3711 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:17.108403 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:17.146768 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54ffb0c-d20c-4efb-98b4-0b526c93c4e9 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:17.159829 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde7cfaf-0422-4b19-8f4a-7b8af04b3711 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:17.187474 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6988f39c-df04-4746-9abc-866f3e927dc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:17.188322 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6988f39c-df04-4746-9abc-866f3e927dc7 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:17.188662 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6988f39c-df04-4746-9abc-866f3e927dc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:17.189047 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6988f39c-df04-4746-9abc-866f3e927dc7 None admin] PATH_INFO: `/v3/domains` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:17.189829 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6988f39c-df04-4746-9abc-866f3e927dc7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:17.190676 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6988f39c-df04-4746-9abc-866f3e927dc7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:17.192069 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6988f39c-df04-4746-9abc-866f3e927dc7 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:17.208996 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 323/653] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jul 11 14:27:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:17.210025 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6988f39c-df04-4746-9abc-866f3e927dc7 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:17.217079 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b15e59-5f4e-4511-904b-ce0d9969c1e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:17.219551 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b15e59-5f4e-4511-904b-ce0d9969c1e4 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:17.220301 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b15e59-5f4e-4511-904b-ce0d9969c1e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:17.220752 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b15e59-5f4e-4511-904b-ce0d9969c1e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:17.243241 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b15e59-5f4e-4511-904b-ce0d9969c1e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:17.247964 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b15e59-5f4e-4511-904b-ce0d9969c1e4 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:17.279911 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:17.297821 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application [None req-69b15e59-5f4e-4511-904b-ce0d9969c1e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:27:17.297821 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:17.297821 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:17.297821 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:17.297821 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:17.297821 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:17.297821 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:17.297821 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:17.297821 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:17.297821 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:17.297821 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:17.297821 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:17.297821 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:27:17.297821 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:27:17.297821 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:27:17.300018 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:27:17.300018 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:17.300018 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:17.300018 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:17.300018 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:17.300018 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:17.300018 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:17.300018 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:17.300018 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:17.300018 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:17.300018 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:17.300018 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:17.300018 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:17.300018 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:17.300018 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:17.300018 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:17.300018 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:17.309746 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:27:17.309746 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:27:17.309746 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:27:17.309746 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Jul 11 14:27:17.309746 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 331/654] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 11 14:27:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:27:17.309746 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b15e59-5f4e-4511-904b-ce0d9969c1e4 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:17.387199 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6988f39c-df04-4746-9abc-866f3e927dc7 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:17.433373 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f834482-20b4-4239-922b-e3fc6f2f9788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:17.435443 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f834482-20b4-4239-922b-e3fc6f2f9788 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:17.435443 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f834482-20b4-4239-922b-e3fc6f2f9788 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:17.435443 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f834482-20b4-4239-922b-e3fc6f2f9788 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:17.457309 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f834482-20b4-4239-922b-e3fc6f2f9788 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:17.459652 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f834482-20b4-4239-922b-e3fc6f2f9788 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:17.482321 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-5f834482-20b4-4239-922b-e3fc6f2f9788 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:27:17.482321 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:17.482321 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:17.482321 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:17.482321 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:17.482321 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:17.482321 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:17.482321 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:17.482321 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:17.482321 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:17.482321 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:17.482321 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:17.482321 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:27:17.482321 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:27:17.482321 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:27:17.483307 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:27:17.483307 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:17.483307 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:17.483307 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:17.483307 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:17.483307 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:17.483307 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:17.483307 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:17.483307 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:17.483307 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:17.483307 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:17.483307 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:17.483307 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:17.483307 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:17.483307 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:17.483307 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:17.483307 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:17.484235 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:27:17.484235 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:27:17.484235 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:27:17.484235 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Jul 11 14:27:17.484496 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 324/655] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 11 14:27:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:27:17.485286 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f834482-20b4-4239-922b-e3fc6f2f9788 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:17.492006 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b15e59-5f4e-4511-904b-ce0d9969c1e4 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:17.516608 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:17.542955 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a252ecb7-4a9d-428e-8c85-bb9de8e55471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:17.544899 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a252ecb7-4a9d-428e-8c85-bb9de8e55471 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:17.546008 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a252ecb7-4a9d-428e-8c85-bb9de8e55471 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:17.546826 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a252ecb7-4a9d-428e-8c85-bb9de8e55471 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:17.561051 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a252ecb7-4a9d-428e-8c85-bb9de8e55471 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:17.565392 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a252ecb7-4a9d-428e-8c85-bb9de8e55471 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:17.591642 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application [None req-a252ecb7-4a9d-428e-8c85-bb9de8e55471 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 11 14:27:17.591642 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:17.591642 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:17.591642 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:17.591642 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:17.591642 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:17.591642 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:17.591642 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:17.591642 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:17.591642 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:17.591642 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:17.591642 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:17.591642 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 14:27:17.591642 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 14:27:17.591642 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 14:27:17.591642 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 14:27:17.592716 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:17.592716 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:17.592716 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 14:27:17.592716 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:27:17.592716 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 14:27:17.592716 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:27:17.592716 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:17.592716 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:17.592716 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:17.592716 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:17.592716 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:17.592716 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:17.592716 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:17.592716 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:17.592716 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:17.592716 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:17.592716 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:17.592716 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:17.593690 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:17.593690 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:17.593690 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 14:27:17.593690 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 14:27:17.593690 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 14:27:17.593690 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 14:27:17.593690 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 14:27:17.593690 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 14:27:17.593690 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 11 14:27:17.593690 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Jul 11 14:27:17.597638 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 332/656] 10.222.0.70 () {56 vars in 1102 bytes} [Mon Jul 11 14:27:17 2022] GET /identity/v3/users/neutron => generated 85 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:27:17.598849 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a252ecb7-4a9d-428e-8c85-bb9de8e55471 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:17.636504 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:17.642493 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f834482-20b4-4239-922b-e3fc6f2f9788 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:17.691887 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c102d05-d950-4c25-9052-72178f89e707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:17.693843 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c102d05-d950-4c25-9052-72178f89e707 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:17.694291 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c102d05-d950-4c25-9052-72178f89e707 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:17.694739 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c102d05-d950-4c25-9052-72178f89e707 None admin] PATH_INFO: `/v3/domains` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:17.695641 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c102d05-d950-4c25-9052-72178f89e707 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:17.696100 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c102d05-d950-4c25-9052-72178f89e707 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:17.697678 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c102d05-d950-4c25-9052-72178f89e707 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:17.718895 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 325/657] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jul 11 14:27:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:17.721751 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c102d05-d950-4c25-9052-72178f89e707 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:17.754976 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a252ecb7-4a9d-428e-8c85-bb9de8e55471 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:17.804706 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc173cd3-afcd-47cc-85c3-2c3ae92c9682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:17.806082 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc173cd3-afcd-47cc-85c3-2c3ae92c9682 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:17.806706 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc173cd3-afcd-47cc-85c3-2c3ae92c9682 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:17.807874 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc173cd3-afcd-47cc-85c3-2c3ae92c9682 None admin] PATH_INFO: `/v3/domains` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:17.809271 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc173cd3-afcd-47cc-85c3-2c3ae92c9682 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:17.809973 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc173cd3-afcd-47cc-85c3-2c3ae92c9682 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:17.812748 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc173cd3-afcd-47cc-85c3-2c3ae92c9682 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:17.835593 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 333/658] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jul 11 14:27:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:17.837370 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc173cd3-afcd-47cc-85c3-2c3ae92c9682 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:17.860860 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c102d05-d950-4c25-9052-72178f89e707 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:17.881282 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:17.914551 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ed0fbc-c14c-4da9-9338-433f66873c55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:17.915814 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ed0fbc-c14c-4da9-9338-433f66873c55 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:17.916292 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ed0fbc-c14c-4da9-9338-433f66873c55 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:17.916731 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ed0fbc-c14c-4da9-9338-433f66873c55 None admin] PATH_INFO: `/v3/users` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:17.918309 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ed0fbc-c14c-4da9-9338-433f66873c55 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:17.918778 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ed0fbc-c14c-4da9-9338-433f66873c55 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:17.920721 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ed0fbc-c14c-4da9-9338-433f66873c55 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:17.945695 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 326/659] 10.222.0.70 () {56 vars in 1139 bytes} [Mon Jul 11 14:27:17 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:17.946822 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ed0fbc-c14c-4da9-9338-433f66873c55 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:17.971610 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:18.008711 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc173cd3-afcd-47cc-85c3-2c3ae92c9682 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:18.059002 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5084ec-1942-407d-9bf9-50c15c3eb35a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:18.060540 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5084ec-1942-407d-9bf9-50c15c3eb35a None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:18.061182 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5084ec-1942-407d-9bf9-50c15c3eb35a None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:18.061765 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5084ec-1942-407d-9bf9-50c15c3eb35a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:18.075647 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5084ec-1942-407d-9bf9-50c15c3eb35a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:18.078688 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5084ec-1942-407d-9bf9-50c15c3eb35a None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:18.081013 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ed0fbc-c14c-4da9-9338-433f66873c55 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:18.110521 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application [None req-7b5084ec-1942-407d-9bf9-50c15c3eb35a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:27:18.110521 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:18.110521 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:18.110521 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:18.110521 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:18.110521 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:18.110521 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:18.110521 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:18.110521 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:18.110521 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:18.110521 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:18.110521 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:18.110521 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 14:27:18.110521 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 14:27:18.110521 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 14:27:18.112609 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 14:27:18.112609 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:18.112609 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:18.112609 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:18.112609 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:18.112609 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:18.112609 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:18.112609 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:18.112609 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:18.112609 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:18.112609 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:18.112609 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:18.112609 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:18.112609 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:18.112609 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:18.112609 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:18.112609 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:18.113627 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 14:27:18.113627 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 14:27:18.113627 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 14:27:18.113627 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 14:27:18.113627 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 14:27:18.113627 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 14:27:18.113627 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:27:18.113627 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Jul 11 14:27:18.120423 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 334/660] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Jul 11 14:27:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:27:18.121626 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5084ec-1942-407d-9bf9-50c15c3eb35a None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:18.143768 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b755ccc9-137e-40d1-a2ae-6027308ba03d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:18.145005 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b755ccc9-137e-40d1-a2ae-6027308ba03d None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:18.145977 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b755ccc9-137e-40d1-a2ae-6027308ba03d None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:18.146468 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b755ccc9-137e-40d1-a2ae-6027308ba03d None admin] PATH_INFO: `/v3/users/nova` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:18.157816 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b755ccc9-137e-40d1-a2ae-6027308ba03d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:18.161668 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b755ccc9-137e-40d1-a2ae-6027308ba03d None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:18.189029 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-b755ccc9-137e-40d1-a2ae-6027308ba03d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 11 14:27:18.189029 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:18.189029 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:18.189029 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:18.189029 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:18.189029 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:18.189029 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:18.189029 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:18.189029 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:18.189029 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:18.189029 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:18.189029 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:18.189029 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 14:27:18.189029 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 14:27:18.189029 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 14:27:18.189029 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 14:27:18.190657 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:18.190657 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:18.190657 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 14:27:18.190657 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:27:18.190657 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 14:27:18.190657 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:27:18.190657 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:18.190657 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:18.190657 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:18.190657 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:18.190657 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:18.190657 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:18.190657 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:18.190657 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:18.190657 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:18.190657 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:18.190657 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:18.190657 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:18.191836 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:18.191836 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:18.191836 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 14:27:18.191836 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 14:27:18.191836 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 14:27:18.191836 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 14:27:18.191836 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 14:27:18.191836 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 14:27:18.191836 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 11 14:27:18.191836 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Jul 11 14:27:18.191836 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 327/661] 10.222.0.70 () {56 vars in 1093 bytes} [Mon Jul 11 14:27:17 2022] GET /identity/v3/users/nova => generated 82 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:27:18.192589 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b755ccc9-137e-40d1-a2ae-6027308ba03d None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:18.255704 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:18.279527 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5084ec-1942-407d-9bf9-50c15c3eb35a None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:18.313416 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:18.344736 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b755ccc9-137e-40d1-a2ae-6027308ba03d None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:18.349268 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c6f5e3-700c-4458-a8ab-f9413fa7a998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:18.350357 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c6f5e3-700c-4458-a8ab-f9413fa7a998 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:18.350789 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c6f5e3-700c-4458-a8ab-f9413fa7a998 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:18.351299 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c6f5e3-700c-4458-a8ab-f9413fa7a998 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:18.394292 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aba325-37b6-476e-9eff-95680d11b180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:18.395338 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aba325-37b6-476e-9eff-95680d11b180 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:18.395853 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aba325-37b6-476e-9eff-95680d11b180 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:18.396408 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aba325-37b6-476e-9eff-95680d11b180 None admin] PATH_INFO: `/v3/projects` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:18.397439 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74aba325-37b6-476e-9eff-95680d11b180 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:18.397960 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74aba325-37b6-476e-9eff-95680d11b180 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:18.400426 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74aba325-37b6-476e-9eff-95680d11b180 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:18.423335 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 328/662] 10.222.0.70 () {56 vars in 1148 bytes} [Mon Jul 11 14:27:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:18.423335 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aba325-37b6-476e-9eff-95680d11b180 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:18.472336 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c6f5e3-700c-4458-a8ab-f9413fa7a998 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:18.474400 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c6f5e3-700c-4458-a8ab-f9413fa7a998 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:18.596862 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aba325-37b6-476e-9eff-95680d11b180 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:18.645890 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:18.670052 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 335/663] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Jul 11 14:27:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 549 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 14:27:18.671004 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c6f5e3-700c-4458-a8ab-f9413fa7a998 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:18.675827 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f312011-45d8-496d-9295-dae1097a3945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:18.677204 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f312011-45d8-496d-9295-dae1097a3945 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:18.677791 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f312011-45d8-496d-9295-dae1097a3945 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:18.678370 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f312011-45d8-496d-9295-dae1097a3945 None admin] PATH_INFO: `/v3/users` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:18.679913 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f312011-45d8-496d-9295-dae1097a3945 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:18.680601 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f312011-45d8-496d-9295-dae1097a3945 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:18.683608 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f312011-45d8-496d-9295-dae1097a3945 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:18.712057 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:18.739106 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 329/664] 10.222.0.70 () {56 vars in 1133 bytes} [Mon Jul 11 14:27:18 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:18.739106 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebadd2a3-8bc2-472a-beae-8a39fccc4bbe None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:18.739106 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebadd2a3-8bc2-472a-beae-8a39fccc4bbe None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:18.739106 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebadd2a3-8bc2-472a-beae-8a39fccc4bbe None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:18.739106 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 330/665] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:27:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:27:18.740413 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebadd2a3-8bc2-472a-beae-8a39fccc4bbe None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:18.836046 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c6f5e3-700c-4458-a8ab-f9413fa7a998 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:18.914897 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ede43d4-d9eb-43af-946b-d07556a98c2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:18.915837 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ede43d4-d9eb-43af-946b-d07556a98c2d None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:18.916407 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ede43d4-d9eb-43af-946b-d07556a98c2d None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:18.918486 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebadd2a3-8bc2-472a-beae-8a39fccc4bbe None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:18.923278 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ede43d4-d9eb-43af-946b-d07556a98c2d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:18.925179 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ede43d4-d9eb-43af-946b-d07556a98c2d None admin] RBAC: Adding query filter params (role.id=c766eda9743248fa87df72ec905d271e, scope.project.id=ccd34295bf7b435a96b37487c8e89fc3, user.id=fa21b44163d84534b9ca1ffe5b5a6071) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:18.925764 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ede43d4-d9eb-43af-946b-d07556a98c2d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:18.928507 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ede43d4-d9eb-43af-946b-d07556a98c2d None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:18.943759 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 336/666] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Jul 11 14:27:18 2022] GET /identity/v3/role_assignments?user.id=fa21b44163d84534b9ca1ffe5b5a6071&scope.project.id=ccd34295bf7b435a96b37487c8e89fc3&role.id=c766eda9743248fa87df72ec905d271e => generated 608 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:18.945239 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ede43d4-d9eb-43af-946b-d07556a98c2d None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:18.979097 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53f9193-6b34-482c-a077-df2370342d38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:18.980493 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53f9193-6b34-482c-a077-df2370342d38 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:18.980780 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53f9193-6b34-482c-a077-df2370342d38 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:18.981057 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53f9193-6b34-482c-a077-df2370342d38 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:19.001929 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53f9193-6b34-482c-a077-df2370342d38 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:19.004257 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53f9193-6b34-482c-a077-df2370342d38 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:19.027320 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-f53f9193-6b34-482c-a077-df2370342d38 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:27:19.027320 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:19.027320 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:19.027320 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:19.027320 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:19.027320 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:19.027320 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:19.027320 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:19.027320 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:19.027320 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:19.027320 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:19.027320 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:19.027320 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:27:19.027320 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:27:19.027320 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:27:19.028694 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:27:19.028694 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:19.028694 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:19.028694 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:19.028694 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:19.028694 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:19.028694 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:19.028694 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:19.028694 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:19.028694 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:19.028694 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:19.028694 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:19.028694 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:19.028694 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:19.028694 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:19.028694 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:19.028694 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:19.035367 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:27:19.035367 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:27:19.035367 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:27:19.035367 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Jul 11 14:27:19.035367 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 331/667] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 11 14:27:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:27:19.035367 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37cc749-9377-49ed-b981-7ade34c3b35d None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:19.035367 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37cc749-9377-49ed-b981-7ade34c3b35d None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:19.035367 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37cc749-9377-49ed-b981-7ade34c3b35d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:19.050380 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-f37cc749-9377-49ed-b981-7ade34c3b35d None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:27:19.051639 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-f37cc749-9377-49ed-b981-7ade34c3b35d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:27:19.057725 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:19.143812 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:19.145447 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ede43d4-d9eb-43af-946b-d07556a98c2d None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:19.189773 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 332/668] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:27:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:27:19.192001 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718310df-ae90-4d44-bf30-c9d8606b5ad7 None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:19.192349 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718310df-ae90-4d44-bf30-c9d8606b5ad7 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:19.192633 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718310df-ae90-4d44-bf30-c9d8606b5ad7 None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:19.194072 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 333/669] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:27:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:27:19.194883 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718310df-ae90-4d44-bf30-c9d8606b5ad7 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:19.211668 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436b56f5-4ad4-4ef2-b9f6-55554632497f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:19.213642 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436b56f5-4ad4-4ef2-b9f6-55554632497f None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:19.213642 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436b56f5-4ad4-4ef2-b9f6-55554632497f None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:19.213642 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436b56f5-4ad4-4ef2-b9f6-55554632497f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:19.319933 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436b56f5-4ad4-4ef2-b9f6-55554632497f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:19.321393 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436b56f5-4ad4-4ef2-b9f6-55554632497f None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:19.359779 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718310df-ae90-4d44-bf30-c9d8606b5ad7 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:19.400155 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:19.405822 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1767fd0-a000-4e5c-81bc-678cdc2e3f92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:19.406514 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1767fd0-a000-4e5c-81bc-678cdc2e3f92 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:19.406795 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1767fd0-a000-4e5c-81bc-678cdc2e3f92 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:19.407072 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1767fd0-a000-4e5c-81bc-678cdc2e3f92 None admin] PATH_INFO: `/v3/domains` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:19.407823 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1767fd0-a000-4e5c-81bc-678cdc2e3f92 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:19.408135 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1767fd0-a000-4e5c-81bc-678cdc2e3f92 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:19.410002 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1767fd0-a000-4e5c-81bc-678cdc2e3f92 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:19.425520 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 334/670] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jul 11 14:27:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:19.426599 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98943f86-1036-41d0-93be-bc6709b42718 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:19.426896 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98943f86-1036-41d0-93be-bc6709b42718 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:19.427174 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98943f86-1036-41d0-93be-bc6709b42718 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:19.446361 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-98943f86-1036-41d0-93be-bc6709b42718 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:27:19.447799 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-98943f86-1036-41d0-93be-bc6709b42718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:27:19.500190 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:19.508678 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 337/671] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Jul 11 14:27:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 557 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 14:27:19.508678 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436b56f5-4ad4-4ef2-b9f6-55554632497f None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:19.591292 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 335/672] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:27:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:27:19.592589 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98943f86-1036-41d0-93be-bc6709b42718 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:19.663491 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436b56f5-4ad4-4ef2-b9f6-55554632497f None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:19.707555 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab9308c-b14c-42bc-988d-d8b1d176cf49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:19.708427 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab9308c-b14c-42bc-988d-d8b1d176cf49 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:19.708718 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab9308c-b14c-42bc-988d-d8b1d176cf49 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:19.708998 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab9308c-b14c-42bc-988d-d8b1d176cf49 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:19.709666 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab9308c-b14c-42bc-988d-d8b1d176cf49 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:19.711097 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab9308c-b14c-42bc-988d-d8b1d176cf49 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:19.734624 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application [None req-eab9308c-b14c-42bc-988d-d8b1d176cf49 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 11 14:27:19.734624 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:19.734624 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 14:27:19.734624 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 14:27:19.734624 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 14:27:19.734624 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 14:27:19.734624 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 14:27:19.734624 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:27:19.734624 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 11 14:27:19.734624 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Jul 11 14:27:19.734624 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 14:27:19.734624 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Jul 11 14:27:19.734624 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:19.734624 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:19.734624 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:19.734624 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:19.735704 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:19.735704 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:19.735704 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:19.735704 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:19.735704 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:19.735704 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:19.735704 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:19.735704 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 14:27:19.735704 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 14:27:19.735704 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 14:27:19.735704 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 14:27:19.735704 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:19.735704 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:19.735704 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:19.735704 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:19.735704 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:19.736793 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:19.736793 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:19.736793 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:19.736793 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:19.736793 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:19.736793 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:19.736793 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:19.736793 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:19.736793 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:19.736793 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:19.736793 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:19.736793 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 14:27:19.736793 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:27:19.736793 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 11 14:27:19.736793 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Jul 11 14:27:19.744947 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 338/673] 10.222.0.70 () {56 vars in 1129 bytes} [Mon Jul 11 14:27:19 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:27:19.746159 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab9308c-b14c-42bc-988d-d8b1d176cf49 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:19.776159 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:19.788917 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98943f86-1036-41d0-93be-bc6709b42718 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:19.851458 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55a25f9-cda8-4bbb-9041-ac2d2a6b8cc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:19.852707 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55a25f9-cda8-4bbb-9041-ac2d2a6b8cc9 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:19.853233 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55a25f9-cda8-4bbb-9041-ac2d2a6b8cc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:19.853701 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55a25f9-cda8-4bbb-9041-ac2d2a6b8cc9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:19.863199 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55a25f9-cda8-4bbb-9041-ac2d2a6b8cc9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:19.865039 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55a25f9-cda8-4bbb-9041-ac2d2a6b8cc9 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:19.883116 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-c55a25f9-cda8-4bbb-9041-ac2d2a6b8cc9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:27:19.883116 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:19.883116 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:19.883116 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:19.883116 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:19.883116 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:19.883116 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:19.883116 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:19.883116 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:19.883116 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:19.883116 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:19.883116 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:19.883116 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 14:27:19.883116 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 14:27:19.883116 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 14:27:19.884124 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 14:27:19.884124 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:19.884124 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:19.884124 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:19.884124 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:19.884124 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:19.884124 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:19.884124 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:19.884124 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:19.884124 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:19.884124 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:19.884124 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:19.884124 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:19.884124 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:19.884124 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:19.884124 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:19.884124 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:19.885059 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 14:27:19.885059 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 14:27:19.885059 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 14:27:19.885059 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 14:27:19.885059 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 14:27:19.885059 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 14:27:19.885059 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:27:19.885059 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Jul 11 14:27:19.885059 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 336/674] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Jul 11 14:27:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:27:19.885547 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55a25f9-cda8-4bbb-9041-ac2d2a6b8cc9 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:19.929804 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab9308c-b14c-42bc-988d-d8b1d176cf49 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:19.938224 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:20.001012 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e441395-d343-485b-aca7-6bb25bfdb571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:20.003506 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e441395-d343-485b-aca7-6bb25bfdb571 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:20.004002 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e441395-d343-485b-aca7-6bb25bfdb571 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:20.004517 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e441395-d343-485b-aca7-6bb25bfdb571 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:20.024644 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e441395-d343-485b-aca7-6bb25bfdb571 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:20.027315 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e441395-d343-485b-aca7-6bb25bfdb571 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:20.040071 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55a25f9-cda8-4bbb-9041-ac2d2a6b8cc9 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:20.060711 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application [None req-2e441395-d343-485b-aca7-6bb25bfdb571 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:27:20.060711 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:20.060711 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:20.060711 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:20.060711 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:20.060711 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:20.060711 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:20.060711 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:20.060711 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:20.060711 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:20.060711 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:20.060711 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:20.060711 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:27:20.060711 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:27:20.060711 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:27:20.062487 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:27:20.062487 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:20.062487 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:20.062487 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:20.062487 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:20.062487 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:20.062487 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:20.062487 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:20.062487 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:20.062487 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:20.062487 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:20.062487 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:20.062487 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:20.062487 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:20.062487 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:20.062487 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:20.062487 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:20.063977 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:27:20.063977 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:27:20.063977 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:27:20.063977 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Jul 11 14:27:20.068439 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 339/675] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 11 14:27:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:27:20.070058 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e441395-d343-485b-aca7-6bb25bfdb571 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:20.102506 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7ec11d-dc03-4363-b154-8c92acdbb362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:20.103431 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7ec11d-dc03-4363-b154-8c92acdbb362 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:20.103897 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7ec11d-dc03-4363-b154-8c92acdbb362 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:20.104388 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7ec11d-dc03-4363-b154-8c92acdbb362 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:20.119727 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7ec11d-dc03-4363-b154-8c92acdbb362 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:27:20.131812 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-5b7ec11d-dc03-4363-b154-8c92acdbb362 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:27:20.131812 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:20.131812 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:20.131812 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:20.131812 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:20.131812 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:20.131812 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:20.131812 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:20.131812 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:20.131812 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:20.131812 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:20.131812 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:20.131812 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:27:20.131812 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:27:20.131812 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:27:20.131812 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:27:20.133957 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:27:20.133957 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:27:20.133957 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:27:20.133957 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:27:20.133957 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:20.133957 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:20.133957 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:20.133957 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:20.133957 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:20.133957 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:20.133957 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:20.133957 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:20.133957 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:20.133957 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:20.133957 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:20.133957 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:20.135638 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:20.135638 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:20.135638 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:20.135638 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:20.135638 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:27:20.135638 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:27:20.135638 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:27:20.135638 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:27:20.135638 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:27:20.135638 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:27:20.135638 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:27:20.135638 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Jul 11 14:27:20.141107 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 337/676] 10.222.0.70 () {56 vars in 1102 bytes} [Mon Jul 11 14:27:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:27:20.142262 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7ec11d-dc03-4363-b154-8c92acdbb362 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:20.206218 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:20.266187 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e441395-d343-485b-aca7-6bb25bfdb571 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:20.295488 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:20.310677 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd81a19d-5b1e-45de-ba3a-71e23c102f5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:20.313089 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd81a19d-5b1e-45de-ba3a-71e23c102f5e None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:20.313089 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd81a19d-5b1e-45de-ba3a-71e23c102f5e None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:20.313089 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd81a19d-5b1e-45de-ba3a-71e23c102f5e None admin] PATH_INFO: `/v3/services` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:20.313089 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd81a19d-5b1e-45de-ba3a-71e23c102f5e None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:20.313675 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd81a19d-5b1e-45de-ba3a-71e23c102f5e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:20.314527 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd81a19d-5b1e-45de-ba3a-71e23c102f5e None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:20.322836 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 340/677] 10.222.0.70 () {56 vars in 1124 bytes} [Mon Jul 11 14:27:20 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:20.324318 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd81a19d-5b1e-45de-ba3a-71e23c102f5e None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:20.326706 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7ec11d-dc03-4363-b154-8c92acdbb362 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:20.375058 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5eaec9c-0192-45f5-bbda-3589aa0faaa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:20.375873 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eaec9c-0192-45f5-bbda-3589aa0faaa4 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:20.376497 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eaec9c-0192-45f5-bbda-3589aa0faaa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:20.376958 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eaec9c-0192-45f5-bbda-3589aa0faaa4 None admin] PATH_INFO: `/v3/projects` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:20.378201 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5eaec9c-0192-45f5-bbda-3589aa0faaa4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:20.378661 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5eaec9c-0192-45f5-bbda-3589aa0faaa4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:20.380647 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5eaec9c-0192-45f5-bbda-3589aa0faaa4 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:20.399029 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 338/678] 10.222.0.70 () {56 vars in 1148 bytes} [Mon Jul 11 14:27:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:20.403929 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5eaec9c-0192-45f5-bbda-3589aa0faaa4 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:20.510448 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd81a19d-5b1e-45de-ba3a-71e23c102f5e None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:20.555392 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5eaec9c-0192-45f5-bbda-3589aa0faaa4 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:20.574506 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:20.583227 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf114631-b2d5-4ee9-84ed-99184f79be5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:20.583906 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf114631-b2d5-4ee9-84ed-99184f79be5a None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:20.584188 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf114631-b2d5-4ee9-84ed-99184f79be5a None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:20.584489 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf114631-b2d5-4ee9-84ed-99184f79be5a None admin] PATH_INFO: `/v3/domains` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:20.586710 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf114631-b2d5-4ee9-84ed-99184f79be5a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:20.587102 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf114631-b2d5-4ee9-84ed-99184f79be5a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:20.588986 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf114631-b2d5-4ee9-84ed-99184f79be5a None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:20.604574 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 341/679] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jul 11 14:27:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:20.607353 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf114631-b2d5-4ee9-84ed-99184f79be5a None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:20.624709 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0444916-987c-4432-93b9-38524fb73ba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:20.625839 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0444916-987c-4432-93b9-38524fb73ba0 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:20.626227 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0444916-987c-4432-93b9-38524fb73ba0 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:20.626683 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0444916-987c-4432-93b9-38524fb73ba0 None admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:20.628499 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0444916-987c-4432-93b9-38524fb73ba0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:20.629000 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0444916-987c-4432-93b9-38524fb73ba0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:20.631391 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0444916-987c-4432-93b9-38524fb73ba0 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:20.648706 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 339/680] 10.222.0.70 () {56 vars in 1103 bytes} [Mon Jul 11 14:27:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:20.650944 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0444916-987c-4432-93b9-38524fb73ba0 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:20.670130 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:20.777782 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf114631-b2d5-4ee9-84ed-99184f79be5a None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:20.848635 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812e4dc9-937d-4866-afa8-301b8a7a8bd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:20.849689 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812e4dc9-937d-4866-afa8-301b8a7a8bd3 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:20.850153 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812e4dc9-937d-4866-afa8-301b8a7a8bd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:20.850601 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812e4dc9-937d-4866-afa8-301b8a7a8bd3 None admin] PATH_INFO: `/v3/services` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:20.851639 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812e4dc9-937d-4866-afa8-301b8a7a8bd3 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:20.852141 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812e4dc9-937d-4866-afa8-301b8a7a8bd3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:20.854343 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0444916-987c-4432-93b9-38524fb73ba0 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:20.855143 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812e4dc9-937d-4866-afa8-301b8a7a8bd3 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:20.866389 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 342/681] 10.222.0.70 () {56 vars in 1124 bytes} [Mon Jul 11 14:27:20 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:20.867812 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812e4dc9-937d-4866-afa8-301b8a7a8bd3 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:20.929093 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85bdae3-6e50-4434-8ac9-b0f44ef6bd58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:20.930583 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85bdae3-6e50-4434-8ac9-b0f44ef6bd58 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:20.931247 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85bdae3-6e50-4434-8ac9-b0f44ef6bd58 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:20.931860 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85bdae3-6e50-4434-8ac9-b0f44ef6bd58 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:20.934055 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85bdae3-6e50-4434-8ac9-b0f44ef6bd58 None admin] RBAC: Adding query filter params (role.id=c766eda9743248fa87df72ec905d271e, scope.project.id=ccd34295bf7b435a96b37487c8e89fc3, user.id=20eede5ccd834862b00123310b5c3975) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:20.934693 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85bdae3-6e50-4434-8ac9-b0f44ef6bd58 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:20.937762 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85bdae3-6e50-4434-8ac9-b0f44ef6bd58 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:20.950586 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 340/682] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Jul 11 14:27:20 2022] GET /identity/v3/role_assignments?user.id=20eede5ccd834862b00123310b5c3975&scope.project.id=ccd34295bf7b435a96b37487c8e89fc3&role.id=c766eda9743248fa87df72ec905d271e => generated 608 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:20.952180 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85bdae3-6e50-4434-8ac9-b0f44ef6bd58 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:21.032839 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:21.192002 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:21.213203 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812e4dc9-937d-4866-afa8-301b8a7a8bd3 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:21.240057 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85bdae3-6e50-4434-8ac9-b0f44ef6bd58 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:21.267234 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5312ac-210a-4897-9386-0026e31cf52c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:21.270161 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5312ac-210a-4897-9386-0026e31cf52c None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:21.270161 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5312ac-210a-4897-9386-0026e31cf52c None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:21.270161 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5312ac-210a-4897-9386-0026e31cf52c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:21.290422 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5312ac-210a-4897-9386-0026e31cf52c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:21.293759 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5312ac-210a-4897-9386-0026e31cf52c None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:21.307267 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae169f4e-ca39-4cba-99ab-9d1fb6d45de8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:21.309890 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae169f4e-ca39-4cba-99ab-9d1fb6d45de8 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:21.310416 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae169f4e-ca39-4cba-99ab-9d1fb6d45de8 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:21.310925 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae169f4e-ca39-4cba-99ab-9d1fb6d45de8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:21.331704 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application [None req-6f5312ac-210a-4897-9386-0026e31cf52c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:27:21.331704 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:21.331704 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:21.331704 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:21.331704 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:21.331704 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:21.331704 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:21.331704 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:21.331704 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:21.331704 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:21.331704 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:21.331704 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:21.331704 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 14:27:21.331704 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 14:27:21.331704 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 14:27:21.333343 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 14:27:21.333343 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:21.333343 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:21.333343 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:21.333343 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:21.333343 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:21.333343 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:21.333343 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:21.333343 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:21.333343 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:21.333343 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:21.333343 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:21.333343 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:21.333343 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:21.333343 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:21.333343 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:21.333343 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:21.335004 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 14:27:21.335004 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 14:27:21.335004 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 14:27:21.335004 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 14:27:21.335004 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 14:27:21.335004 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 14:27:21.335004 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:27:21.335004 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Jul 11 14:27:21.335826 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae169f4e-ca39-4cba-99ab-9d1fb6d45de8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:21.336857 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae169f4e-ca39-4cba-99ab-9d1fb6d45de8 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:21.344405 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 343/683] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Jul 11 14:27:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 473 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:27:21.350561 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5312ac-210a-4897-9386-0026e31cf52c None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:21.380695 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-ae169f4e-ca39-4cba-99ab-9d1fb6d45de8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:27:21.380695 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:21.380695 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:21.380695 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:21.380695 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:21.380695 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:21.380695 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:21.380695 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:21.380695 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:21.380695 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:21.380695 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:21.380695 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:21.380695 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:27:21.380695 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:27:21.380695 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:27:21.382349 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:27:21.382349 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:21.382349 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:21.382349 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:21.382349 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:21.382349 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:21.382349 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:21.382349 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:21.382349 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:21.382349 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:21.382349 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:21.382349 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:21.382349 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:21.382349 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:21.382349 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:21.382349 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:21.382349 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:21.385181 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:27:21.385181 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:27:21.385181 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:27:21.385181 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Jul 11 14:27:21.385181 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 341/684] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 11 14:27:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 432 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:27:21.394054 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae169f4e-ca39-4cba-99ab-9d1fb6d45de8 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:21.594961 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5312ac-210a-4897-9386-0026e31cf52c None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:21.648865 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:21.680258 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ccfc46-c478-4e78-87c0-4edc0b75022f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:21.682291 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ccfc46-c478-4e78-87c0-4edc0b75022f None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:21.685254 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ccfc46-c478-4e78-87c0-4edc0b75022f None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:21.687777 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ccfc46-c478-4e78-87c0-4edc0b75022f None admin] PATH_INFO: `/v3/projects` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:21.690107 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ccfc46-c478-4e78-87c0-4edc0b75022f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:21.691550 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ccfc46-c478-4e78-87c0-4edc0b75022f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:21.697269 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ccfc46-c478-4e78-87c0-4edc0b75022f None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:21.732301 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae169f4e-ca39-4cba-99ab-9d1fb6d45de8 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:21.736370 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 344/685] 10.222.0.70 () {56 vars in 1148 bytes} [Mon Jul 11 14:27:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 387 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:27:21.746432 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ccfc46-c478-4e78-87c0-4edc0b75022f None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:21.785137 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:21.804728 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfb2b4c-bec8-4e9d-a821-47dec371f0c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:21.805399 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfb2b4c-bec8-4e9d-a821-47dec371f0c3 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:21.807377 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfb2b4c-bec8-4e9d-a821-47dec371f0c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:21.807377 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfb2b4c-bec8-4e9d-a821-47dec371f0c3 None admin] PATH_INFO: `/v3/domains` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:21.807807 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfb2b4c-bec8-4e9d-a821-47dec371f0c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:21.808113 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfb2b4c-bec8-4e9d-a821-47dec371f0c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:21.809562 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfb2b4c-bec8-4e9d-a821-47dec371f0c3 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:21.840906 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 342/686] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jul 11 14:27:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 448 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:27:21.844621 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ecdb7d-afa0-4f49-b5e7-ebe803c6d3c9 None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:21.844947 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ecdb7d-afa0-4f49-b5e7-ebe803c6d3c9 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:21.845243 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ecdb7d-afa0-4f49-b5e7-ebe803c6d3c9 None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:21.847694 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 343/687] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:27:21 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:27:21.849077 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ecdb7d-afa0-4f49-b5e7-ebe803c6d3c9 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:21.905385 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ccfc46-c478-4e78-87c0-4edc0b75022f None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:21.987133 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7809fcb1-a98d-4918-9a4c-e6be7f49a16f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:21.989620 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7809fcb1-a98d-4918-9a4c-e6be7f49a16f None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:21.990728 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7809fcb1-a98d-4918-9a4c-e6be7f49a16f None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:21.992314 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7809fcb1-a98d-4918-9a4c-e6be7f49a16f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:21.995002 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7809fcb1-a98d-4918-9a4c-e6be7f49a16f None admin] RBAC: Adding query filter params (role.id=c766eda9743248fa87df72ec905d271e, scope.project.id=ccd34295bf7b435a96b37487c8e89fc3, user.id=f4f8c0d696af4bd5a205ca8e9110b8cc) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:21.996656 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7809fcb1-a98d-4918-9a4c-e6be7f49a16f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:22.001049 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7809fcb1-a98d-4918-9a4c-e6be7f49a16f None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:22.015738 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ecdb7d-afa0-4f49-b5e7-ebe803c6d3c9 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:22.021942 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 345/688] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Jul 11 14:27:21 2022] GET /identity/v3/role_assignments?user.id=f4f8c0d696af4bd5a205ca8e9110b8cc&scope.project.id=ccd34295bf7b435a96b37487c8e89fc3&role.id=c766eda9743248fa87df72ec905d271e => generated 608 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:27:22.024919 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8547576f-ab48-4831-907e-8badd691d8b3 None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:22.026845 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8547576f-ab48-4831-907e-8badd691d8b3 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:22.027765 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8547576f-ab48-4831-907e-8badd691d8b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:22.067643 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-8547576f-ab48-4831-907e-8badd691d8b3 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:27:22.071282 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-8547576f-ab48-4831-907e-8badd691d8b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:27:22.094387 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1399b903-a4c2-4feb-8efe-929b93d6bf0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:22.095188 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1399b903-a4c2-4feb-8efe-929b93d6bf0d None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:22.095502 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1399b903-a4c2-4feb-8efe-929b93d6bf0d None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:22.097040 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1399b903-a4c2-4feb-8efe-929b93d6bf0d None admin] PATH_INFO: `/v3/users/swift` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:22.121812 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1399b903-a4c2-4feb-8efe-929b93d6bf0d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:22.123422 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1399b903-a4c2-4feb-8efe-929b93d6bf0d None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:22.149349 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:22.167638 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-1399b903-a4c2-4feb-8efe-929b93d6bf0d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 11 14:27:22.167638 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:22.167638 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:22.167638 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:22.167638 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:22.167638 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:22.167638 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:22.167638 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:22.167638 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:22.167638 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:22.167638 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:22.167638 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:22.167638 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 14:27:22.167638 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 14:27:22.167638 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 14:27:22.167638 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 14:27:22.169780 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:22.169780 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:22.169780 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 14:27:22.169780 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:27:22.169780 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 14:27:22.169780 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:27:22.169780 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:22.169780 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:22.169780 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:22.169780 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:22.169780 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:22.169780 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:22.169780 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:22.169780 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:22.169780 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:22.169780 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:22.169780 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:22.169780 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:22.172329 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:22.172329 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:22.172329 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 14:27:22.172329 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 14:27:22.172329 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 14:27:22.172329 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 14:27:22.172329 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 14:27:22.172329 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 14:27:22.172329 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 11 14:27:22.172329 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Jul 11 14:27:22.172329 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 344/689] 10.222.0.70 () {56 vars in 1096 bytes} [Mon Jul 11 14:27:21 2022] GET /identity/v3/users/swift => generated 83 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:27:22.178327 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1399b903-a4c2-4feb-8efe-929b93d6bf0d None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:22.281441 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 346/690] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:27:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:27:22.292005 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:22.336690 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8547576f-ab48-4831-907e-8badd691d8b3 None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:22.390986 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1399b903-a4c2-4feb-8efe-929b93d6bf0d None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:22.438612 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69412f3c-a263-4330-9cf8-7082c9591571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:22.439299 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69412f3c-a263-4330-9cf8-7082c9591571 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:22.440000 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69412f3c-a263-4330-9cf8-7082c9591571 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:22.440000 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69412f3c-a263-4330-9cf8-7082c9591571 None admin] PATH_INFO: `/v3/users` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:22.441068 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69412f3c-a263-4330-9cf8-7082c9591571 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:22.441398 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69412f3c-a263-4330-9cf8-7082c9591571 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:22.442830 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69412f3c-a263-4330-9cf8-7082c9591571 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:22.473581 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 345/691] 10.222.0.70 () {56 vars in 1135 bytes} [Mon Jul 11 14:27:22 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:22.481680 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69412f3c-a263-4330-9cf8-7082c9591571 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:22.520515 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8547576f-ab48-4831-907e-8badd691d8b3 None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:22.571000 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc05ac7b-e11a-456d-bf33-4be0d56c5f3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:22.572960 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc05ac7b-e11a-456d-bf33-4be0d56c5f3d None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:22.573803 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc05ac7b-e11a-456d-bf33-4be0d56c5f3d None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:22.574284 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc05ac7b-e11a-456d-bf33-4be0d56c5f3d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:22.598149 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc05ac7b-e11a-456d-bf33-4be0d56c5f3d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:22.602488 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc05ac7b-e11a-456d-bf33-4be0d56c5f3d None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:22.642242 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application [None req-dc05ac7b-e11a-456d-bf33-4be0d56c5f3d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:27:22.642242 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:22.642242 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:22.642242 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:22.642242 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:22.642242 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:22.642242 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:22.642242 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:22.642242 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:22.642242 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:22.642242 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:22.642242 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:22.642242 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:27:22.642242 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:27:22.642242 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:27:22.643717 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:27:22.643717 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:22.643717 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:22.643717 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:22.643717 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:22.643717 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:22.643717 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:22.643717 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:22.643717 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:22.643717 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:22.643717 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:22.643717 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:22.643717 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:22.643717 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:22.643717 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:22.643717 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:22.643717 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:22.644644 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:27:22.644644 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:27:22.644644 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:27:22.644644 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Jul 11 14:27:22.645960 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 347/692] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 11 14:27:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:27:22.654910 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc05ac7b-e11a-456d-bf33-4be0d56c5f3d None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:22.662279 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69412f3c-a263-4330-9cf8-7082c9591571 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:22.667479 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:22.711063 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:22.712640 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ff82ae-c38b-48e8-9fcc-7aad6875e443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:22.713487 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ff82ae-c38b-48e8-9fcc-7aad6875e443 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:22.713947 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ff82ae-c38b-48e8-9fcc-7aad6875e443 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:22.714394 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ff82ae-c38b-48e8-9fcc-7aad6875e443 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:22.917662 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc05ac7b-e11a-456d-bf33-4be0d56c5f3d None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:22.954168 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ff82ae-c38b-48e8-9fcc-7aad6875e443 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:22.959186 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ff82ae-c38b-48e8-9fcc-7aad6875e443 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:23.049533 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c12b88-e421-4b7b-a405-8d08f4d55328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:23.050294 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c12b88-e421-4b7b-a405-8d08f4d55328 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:23.050583 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c12b88-e421-4b7b-a405-8d08f4d55328 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:23.050857 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c12b88-e421-4b7b-a405-8d08f4d55328 None admin] PATH_INFO: `/v3/domains` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:23.051618 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c12b88-e421-4b7b-a405-8d08f4d55328 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:23.051930 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c12b88-e421-4b7b-a405-8d08f4d55328 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:23.053376 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c12b88-e421-4b7b-a405-8d08f4d55328 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:23.084623 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 348/693] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jul 11 14:27:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 431 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:23.090109 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c12b88-e421-4b7b-a405-8d08f4d55328 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:23.202617 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 346/694] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Jul 11 14:27:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 721 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 11 14:27:23.219738 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ff82ae-c38b-48e8-9fcc-7aad6875e443 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:23.225358 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:23.388479 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:23.433387 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ff82ae-c38b-48e8-9fcc-7aad6875e443 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:23.467718 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c12b88-e421-4b7b-a405-8d08f4d55328 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:23.525267 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab45cf20-d111-44c9-a8d6-17dea8201ed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:23.526088 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab45cf20-d111-44c9-a8d6-17dea8201ed0 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:23.526374 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab45cf20-d111-44c9-a8d6-17dea8201ed0 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:23.526653 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab45cf20-d111-44c9-a8d6-17dea8201ed0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:23.561451 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab45cf20-d111-44c9-a8d6-17dea8201ed0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:23.565382 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab45cf20-d111-44c9-a8d6-17dea8201ed0 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:23.572773 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e71ec16-d31a-4e2b-987d-930bb6e174e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:23.574341 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e71ec16-d31a-4e2b-987d-930bb6e174e2 None admin] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:23.576816 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e71ec16-d31a-4e2b-987d-930bb6e174e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:23.577934 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e71ec16-d31a-4e2b-987d-930bb6e174e2 None admin] PATH_INFO: `/v3/users` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:23.578891 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e71ec16-d31a-4e2b-987d-930bb6e174e2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:23.581795 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e71ec16-d31a-4e2b-987d-930bb6e174e2 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:23.622073 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-ab45cf20-d111-44c9-a8d6-17dea8201ed0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:27:23.622073 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:23.622073 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:23.622073 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:23.622073 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:23.622073 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:23.622073 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:23.622073 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:23.622073 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:23.622073 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:23.622073 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:23.622073 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:23.622073 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:27:23.622073 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:27:23.622073 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:27:23.624120 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:27:23.624120 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:23.624120 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:23.624120 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:23.624120 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:23.624120 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:23.624120 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:23.624120 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:23.624120 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:23.624120 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:23.624120 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:23.624120 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:23.624120 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:23.624120 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:23.624120 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:23.624120 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:23.624120 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:23.631042 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:27:23.631042 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:27:23.631042 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:27:23.631042 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Jul 11 14:27:23.631042 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 347/695] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 11 14:27:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 405 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:27:23.631042 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f309511c-d733-4d16-91dd-eec4ca10c762 None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:23.631042 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f309511c-d733-4d16-91dd-eec4ca10c762 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:23.631042 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f309511c-d733-4d16-91dd-eec4ca10c762 None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:23.632439 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 348/696] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:27:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:27:23.634485 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce772531-0799-4435-8250-4e5d68cf499f None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:23.634855 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce772531-0799-4435-8250-4e5d68cf499f None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:23.635204 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce772531-0799-4435-8250-4e5d68cf499f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:23.653408 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 349/697] 10.222.0.70 () {60 vars in 1132 bytes} [Mon Jul 11 14:27:23 2022] POST /identity/v3/users => generated 254 bytes in 564 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:27:23.655384 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e71ec16-d31a-4e2b-987d-930bb6e174e2 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:23.660067 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-ce772531-0799-4435-8250-4e5d68cf499f None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:27:23.661214 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-ce772531-0799-4435-8250-4e5d68cf499f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:27:23.734011 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:23.785468 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 349/698] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:27:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 14:27:23.877089 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce772531-0799-4435-8250-4e5d68cf499f None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:23.905409 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e71ec16-d31a-4e2b-987d-930bb6e174e2 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:23.963349 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b119cc2-58c2-4403-bcc2-e84e746d9db1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:23.964600 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b119cc2-58c2-4403-bcc2-e84e746d9db1 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:23.965080 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b119cc2-58c2-4403-bcc2-e84e746d9db1 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:23.965577 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b119cc2-58c2-4403-bcc2-e84e746d9db1 None admin] PATH_INFO: `/v3/domains` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:23.967439 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b119cc2-58c2-4403-bcc2-e84e746d9db1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:23.967624 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b119cc2-58c2-4403-bcc2-e84e746d9db1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:23.970228 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b119cc2-58c2-4403-bcc2-e84e746d9db1 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:23.976052 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:24.008478 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 350/699] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jul 11 14:27:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:24.013404 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b119cc2-58c2-4403-bcc2-e84e746d9db1 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:24.135217 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce772531-0799-4435-8250-4e5d68cf499f None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:24.221211 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858fd8fd-8cf0-4d31-8f47-320715aa04e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:24.222231 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858fd8fd-8cf0-4d31-8f47-320715aa04e1 None admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:24.222231 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858fd8fd-8cf0-4d31-8f47-320715aa04e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:24.222450 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858fd8fd-8cf0-4d31-8f47-320715aa04e1 None admin] PATH_INFO: `/v3/services` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:24.223193 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858fd8fd-8cf0-4d31-8f47-320715aa04e1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:24.224608 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858fd8fd-8cf0-4d31-8f47-320715aa04e1 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:24.239610 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b119cc2-58c2-4403-bcc2-e84e746d9db1 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:24.247161 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 350/700] 10.222.0.70 () {60 vars in 1141 bytes} [Mon Jul 11 14:27:23 2022] POST /identity/v3/services => generated 251 bytes in 371 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:27:24.248785 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a08acb4-946d-4517-b30c-38a13b185f3d None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:24.249143 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a08acb4-946d-4517-b30c-38a13b185f3d None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:24.249605 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a08acb4-946d-4517-b30c-38a13b185f3d None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:24.253293 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 351/701] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:27:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:27:24.259243 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c41f747-4918-4e97-953a-8c37d29d148e None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:24.259524 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c41f747-4918-4e97-953a-8c37d29d148e None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:24.259788 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c41f747-4918-4e97-953a-8c37d29d148e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:24.280488 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-2c41f747-4918-4e97-953a-8c37d29d148e None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:27:24.281507 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-2c41f747-4918-4e97-953a-8c37d29d148e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:27:24.341862 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c34343-b4ca-46b3-8b26-dd08a3860e90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:24.343093 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c34343-b4ca-46b3-8b26-dd08a3860e90 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:24.343722 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c34343-b4ca-46b3-8b26-dd08a3860e90 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:24.344406 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c34343-b4ca-46b3-8b26-dd08a3860e90 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:24.355239 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:24.358357 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c34343-b4ca-46b3-8b26-dd08a3860e90 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:24.360583 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c34343-b4ca-46b3-8b26-dd08a3860e90 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:24.379864 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application [None req-09c34343-b4ca-46b3-8b26-dd08a3860e90 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:27:24.379864 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:24.379864 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:24.379864 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:24.379864 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:24.379864 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:24.379864 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:24.379864 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:24.379864 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:24.379864 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:24.379864 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:24.379864 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:24.379864 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 14:27:24.379864 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 14:27:24.379864 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 14:27:24.380897 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 14:27:24.380897 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:24.380897 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:24.380897 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:24.380897 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:24.380897 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:24.380897 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:24.380897 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:24.380897 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:24.380897 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:24.380897 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:24.380897 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:24.380897 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:24.380897 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:24.380897 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:24.380897 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:24.380897 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:24.381784 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 14:27:24.381784 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 14:27:24.381784 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 14:27:24.381784 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 14:27:24.381784 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 14:27:24.381784 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 14:27:24.381784 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:27:24.381784 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Jul 11 14:27:24.384495 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 351/702] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Jul 11 14:27:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 372 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:27:24.393540 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c34343-b4ca-46b3-8b26-dd08a3860e90 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:24.426070 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 352/703] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:27:24 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:27:24.453301 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c41f747-4918-4e97-953a-8c37d29d148e None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:24.500965 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:24.590800 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c34343-b4ca-46b3-8b26-dd08a3860e90 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:24.632406 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac692a1a-18e8-42ca-8003-eb6dac9f9f09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:24.633478 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac692a1a-18e8-42ca-8003-eb6dac9f9f09 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:24.633986 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac692a1a-18e8-42ca-8003-eb6dac9f9f09 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:24.634464 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac692a1a-18e8-42ca-8003-eb6dac9f9f09 None admin] PATH_INFO: `/v3/projects` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:24.635469 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac692a1a-18e8-42ca-8003-eb6dac9f9f09 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:24.636023 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac692a1a-18e8-42ca-8003-eb6dac9f9f09 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:24.640752 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac692a1a-18e8-42ca-8003-eb6dac9f9f09 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:24.655987 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c41f747-4918-4e97-953a-8c37d29d148e None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:24.667389 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 352/704] 10.222.0.70 () {56 vars in 1148 bytes} [Mon Jul 11 14:27:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:27:24.673285 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac692a1a-18e8-42ca-8003-eb6dac9f9f09 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:24.709671 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6aa603-9339-4110-8c9c-213d7eb504e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:24.711595 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6aa603-9339-4110-8c9c-213d7eb504e5 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:24.712103 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6aa603-9339-4110-8c9c-213d7eb504e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:24.712946 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6aa603-9339-4110-8c9c-213d7eb504e5 None admin] PATH_INFO: `/v3/services/network` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:24.714159 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6aa603-9339-4110-8c9c-213d7eb504e5 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:24.716741 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6aa603-9339-4110-8c9c-213d7eb504e5 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:24.737311 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-5d6aa603-9339-4110-8c9c-213d7eb504e5 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 11 14:27:24.737311 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:24.737311 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 14:27:24.737311 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 14:27:24.737311 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 14:27:24.737311 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 14:27:24.737311 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 14:27:24.737311 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:27:24.737311 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 11 14:27:24.737311 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Jul 11 14:27:24.737311 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 14:27:24.737311 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Jul 11 14:27:24.737311 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:24.737311 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:24.737311 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:24.737311 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:24.737311 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:24.738479 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:24.738479 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:24.738479 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:24.738479 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:24.738479 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:24.738479 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:24.738479 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 14:27:24.738479 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 14:27:24.738479 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 14:27:24.738479 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 14:27:24.738479 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:24.738479 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:24.738479 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:24.738479 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:24.738479 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:24.738479 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:24.739430 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:24.739430 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:24.739430 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:24.739430 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:24.739430 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:24.739430 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:24.739430 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:24.739430 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:24.739430 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:24.739430 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:24.739430 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 14:27:24.739430 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:27:24.739430 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 11 14:27:24.739430 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Jul 11 14:27:24.742991 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 353/705] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Jul 11 14:27:24 2022] GET /identity/v3/services/network => generated 88 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:27:24.750864 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6aa603-9339-4110-8c9c-213d7eb504e5 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:24.801602 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:24.846313 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac692a1a-18e8-42ca-8003-eb6dac9f9f09 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:24.864499 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:24.877470 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6aa603-9339-4110-8c9c-213d7eb504e5 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:24.891040 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd8067f-31fe-4ad7-932d-fd2d951ad831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:24.892107 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd8067f-31fe-4ad7-932d-fd2d951ad831 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:24.894063 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd8067f-31fe-4ad7-932d-fd2d951ad831 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:24.894673 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd8067f-31fe-4ad7-932d-fd2d951ad831 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:24.895824 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd8067f-31fe-4ad7-932d-fd2d951ad831 None admin] RBAC: Adding query filter params (role.id=c766eda9743248fa87df72ec905d271e, scope.project.id=ccd34295bf7b435a96b37487c8e89fc3, user.id=0217add2f5e74a80a1a33b160cc57a2b) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:24.896450 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd8067f-31fe-4ad7-932d-fd2d951ad831 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:24.898237 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd8067f-31fe-4ad7-932d-fd2d951ad831 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:24.905928 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 353/706] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Jul 11 14:27:24 2022] GET /identity/v3/role_assignments?user.id=0217add2f5e74a80a1a33b160cc57a2b&scope.project.id=ccd34295bf7b435a96b37487c8e89fc3&role.id=c766eda9743248fa87df72ec905d271e => generated 608 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:27:24.942410 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fb6a34-fdef-4bb0-9d1c-b3da04769402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:24.943548 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fb6a34-fdef-4bb0-9d1c-b3da04769402 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:24.944042 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fb6a34-fdef-4bb0-9d1c-b3da04769402 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:24.944574 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fb6a34-fdef-4bb0-9d1c-b3da04769402 None admin] PATH_INFO: `/v3/services` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:24.945712 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fb6a34-fdef-4bb0-9d1c-b3da04769402 None admin] RBAC: Adding query filter params (name=network) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:24.946227 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fb6a34-fdef-4bb0-9d1c-b3da04769402 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:24.948807 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fb6a34-fdef-4bb0-9d1c-b3da04769402 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:24.958504 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 354/707] 10.222.0.70 () {56 vars in 1112 bytes} [Mon Jul 11 14:27:24 2022] GET /identity/v3/services?name=network => generated 124 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:24.964407 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd8067f-31fe-4ad7-932d-fd2d951ad831 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:25.167537 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd8067f-31fe-4ad7-932d-fd2d951ad831 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:25.231434 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861cbdef-25f9-4ef2-bf5c-2c228c5502bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:25.232186 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861cbdef-25f9-4ef2-bf5c-2c228c5502bd None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:25.232521 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861cbdef-25f9-4ef2-bf5c-2c228c5502bd None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:25.232858 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861cbdef-25f9-4ef2-bf5c-2c228c5502bd None admin] PATH_INFO: `/v3/services` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:25.233603 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861cbdef-25f9-4ef2-bf5c-2c228c5502bd None admin] RBAC: Adding query filter params (type=network) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:25.233913 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861cbdef-25f9-4ef2-bf5c-2c228c5502bd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:25.235309 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861cbdef-25f9-4ef2-bf5c-2c228c5502bd None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:25.241664 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 354/708] 10.222.0.70 () {56 vars in 1112 bytes} [Mon Jul 11 14:27:24 2022] GET /identity/v3/services?type=network => generated 124 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:25.571526 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01fd081-69d2-490b-b688-3761a9de8d1a None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:25.571526 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01fd081-69d2-490b-b688-3761a9de8d1a None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:25.571526 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01fd081-69d2-490b-b688-3761a9de8d1a None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:25.573267 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 355/709] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:27:25 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:27:25.580964 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7755021b-f61c-406b-a30f-af4f5a8be2ae None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:25.581742 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7755021b-f61c-406b-a30f-af4f5a8be2ae None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:25.582138 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7755021b-f61c-406b-a30f-af4f5a8be2ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:25.630115 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-7755021b-f61c-406b-a30f-af4f5a8be2ae None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:27:25.632164 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-7755021b-f61c-406b-a30f-af4f5a8be2ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:27:25.684591 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:25.738030 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 355/710] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:27:25 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 14:27:25.781843 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01fd081-69d2-490b-b688-3761a9de8d1a None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:25.998971 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01fd081-69d2-490b-b688-3761a9de8d1a None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:26.004731 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:26.078796 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb8e75a-ee2a-4bc7-bcaf-20d3db2410c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:26.080764 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb8e75a-ee2a-4bc7-bcaf-20d3db2410c0 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:26.081264 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb8e75a-ee2a-4bc7-bcaf-20d3db2410c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:26.081757 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb8e75a-ee2a-4bc7-bcaf-20d3db2410c0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:26.102652 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb8e75a-ee2a-4bc7-bcaf-20d3db2410c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:27:26.118435 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-3cb8e75a-ee2a-4bc7-bcaf-20d3db2410c0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:27:26.118435 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:26.118435 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:26.118435 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:26.118435 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:26.118435 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:26.118435 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:26.118435 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:26.118435 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:26.118435 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:26.118435 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:26.118435 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:26.118435 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:27:26.118435 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:27:26.118435 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:27:26.118435 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:27:26.119448 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:27:26.119448 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:27:26.119448 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:27:26.119448 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:27:26.119448 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:26.119448 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:26.119448 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:26.119448 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:26.119448 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:26.119448 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:26.119448 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:26.119448 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:26.119448 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:26.119448 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:26.119448 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:26.119448 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:26.120333 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:26.120333 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:26.120333 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:26.120333 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:26.120333 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:27:26.120333 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:27:26.120333 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:27:26.120333 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:27:26.120333 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:27:26.120333 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:27:26.120333 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:27:26.120333 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Jul 11 14:27:26.121466 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 356/711] 10.222.0.70 () {56 vars in 1096 bytes} [Mon Jul 11 14:27:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:27:26.127756 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7755021b-f61c-406b-a30f-af4f5a8be2ae None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:26.332376 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7755021b-f61c-406b-a30f-af4f5a8be2ae None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:26.394827 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3edd64-7747-4324-9b19-4ba27c265230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:26.396012 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3edd64-7747-4324-9b19-4ba27c265230 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:26.396513 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3edd64-7747-4324-9b19-4ba27c265230 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:26.397014 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3edd64-7747-4324-9b19-4ba27c265230 None admin] PATH_INFO: `/v3/roles` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:26.398456 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3edd64-7747-4324-9b19-4ba27c265230 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:26.398969 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3edd64-7747-4324-9b19-4ba27c265230 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:26.401488 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3edd64-7747-4324-9b19-4ba27c265230 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:26.418375 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 356/712] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Jul 11 14:27:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:26.426289 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb8e75a-ee2a-4bc7-bcaf-20d3db2410c0 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:26.650070 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb8e75a-ee2a-4bc7-bcaf-20d3db2410c0 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:26.722279 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff53442-673a-4696-b46a-450f2baf0a92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:26.723737 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff53442-673a-4696-b46a-450f2baf0a92 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:26.724283 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff53442-673a-4696-b46a-450f2baf0a92 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:26.724791 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff53442-673a-4696-b46a-450f2baf0a92 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:26.748348 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff53442-673a-4696-b46a-450f2baf0a92 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:26.751308 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff53442-673a-4696-b46a-450f2baf0a92 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:26.789103 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-2ff53442-673a-4696-b46a-450f2baf0a92 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:27:26.789103 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:26.789103 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:26.789103 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:26.789103 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:26.789103 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:26.789103 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:26.789103 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:26.789103 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:26.789103 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:26.789103 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:26.789103 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:26.789103 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:27:26.789103 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:27:26.789103 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:27:26.790109 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:27:26.790109 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:26.790109 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:26.790109 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:26.790109 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:26.790109 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:26.790109 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:26.790109 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:26.790109 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:26.790109 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:26.790109 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:26.790109 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:26.790109 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:26.790109 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:26.790109 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:26.790109 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:26.790109 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:26.791027 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:27:26.791027 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:27:26.791027 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:27:26.791027 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Jul 11 14:27:26.796240 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 357/713] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 11 14:27:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 367 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:27:26.798389 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3edd64-7747-4324-9b19-4ba27c265230 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:26.863928 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:27.012902 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3edd64-7747-4324-9b19-4ba27c265230 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:27.089978 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a79aaf-a5e5-4a30-a744-bc61c3d7a8fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:27.091461 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a79aaf-a5e5-4a30-a744-bc61c3d7a8fb None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:27.092174 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a79aaf-a5e5-4a30-a744-bc61c3d7a8fb None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:27.092869 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a79aaf-a5e5-4a30-a744-bc61c3d7a8fb None admin] PATH_INFO: `/v3/domains` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:27.094482 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a79aaf-a5e5-4a30-a744-bc61c3d7a8fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:27.095190 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a79aaf-a5e5-4a30-a744-bc61c3d7a8fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:27.102398 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a79aaf-a5e5-4a30-a744-bc61c3d7a8fb None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:27.127792 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 357/714] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jul 11 14:27:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:27.134065 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff53442-673a-4696-b46a-450f2baf0a92 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:27.184628 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:27.328607 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54b1b81-d0e0-4daa-9cb3-c3050d50acef None None] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:27.328986 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54b1b81-d0e0-4daa-9cb3-c3050d50acef None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:27.329460 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54b1b81-d0e0-4daa-9cb3-c3050d50acef None None] PATH_INFO: `/` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:27.332157 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 358/715] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:27:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:27:27.338245 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c59dd31-2c43-406f-8916-3b67da395b7f None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:27.338624 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c59dd31-2c43-406f-8916-3b67da395b7f None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:27.338845 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c59dd31-2c43-406f-8916-3b67da395b7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:27.370638 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff53442-673a-4696-b46a-450f2baf0a92 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:27.373430 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-2c59dd31-2c43-406f-8916-3b67da395b7f None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:27:27.374679 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-2c59dd31-2c43-406f-8916-3b67da395b7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:27:27.487150 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d96da2d-05a5-4802-8988-3d7c6dba65dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:27.488805 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d96da2d-05a5-4802-8988-3d7c6dba65dd None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:27.489307 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d96da2d-05a5-4802-8988-3d7c6dba65dd None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:27.489780 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d96da2d-05a5-4802-8988-3d7c6dba65dd None admin] PATH_INFO: `/v3/users/nova` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:27.515313 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d96da2d-05a5-4802-8988-3d7c6dba65dd None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:27.518141 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d96da2d-05a5-4802-8988-3d7c6dba65dd None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:27.580593 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-1d96da2d-05a5-4802-8988-3d7c6dba65dd None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 11 14:27:27.580593 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:27.580593 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:27.580593 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:27.580593 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:27.580593 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:27.580593 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:27.580593 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:27.580593 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:27.580593 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:27.580593 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:27.580593 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:27.580593 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 14:27:27.580593 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 14:27:27.580593 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 14:27:27.580593 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 14:27:27.581627 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:27.581627 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:27.581627 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 14:27:27.581627 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:27:27.581627 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 14:27:27.581627 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:27:27.581627 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:27.581627 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:27.581627 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:27.581627 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:27.581627 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:27.581627 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:27.581627 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:27.581627 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:27.581627 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:27.581627 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:27.581627 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:27.581627 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:27.583131 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:27.583131 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:27.583131 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 14:27:27.583131 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 14:27:27.583131 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 14:27:27.583131 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 14:27:27.583131 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 14:27:27.583131 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 14:27:27.583131 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 11 14:27:27.583131 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Jul 11 14:27:27.583939 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 358/716] 10.222.0.70 () {56 vars in 1093 bytes} [Mon Jul 11 14:27:27 2022] GET /identity/v3/users/nova => generated 82 bytes in 450 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:27:27.588037 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d96da2d-05a5-4802-8988-3d7c6dba65dd None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:27.623501 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 359/717] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:27:27 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:27:27.668503 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c59dd31-2c43-406f-8916-3b67da395b7f None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:27.696428 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:27.746673 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:27.788950 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c59dd31-2c43-406f-8916-3b67da395b7f None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:27.814328 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d96da2d-05a5-4802-8988-3d7c6dba65dd None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:27.834019 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d57c9aa-974f-4869-8f60-afbc68e34d2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:27.835747 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d57c9aa-974f-4869-8f60-afbc68e34d2c None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:27.837415 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d57c9aa-974f-4869-8f60-afbc68e34d2c None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:27.838103 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d57c9aa-974f-4869-8f60-afbc68e34d2c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:27.861911 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d57c9aa-974f-4869-8f60-afbc68e34d2c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:27:27.877599 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application [None req-9d57c9aa-974f-4869-8f60-afbc68e34d2c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:27:27.877599 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:27.877599 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:27.877599 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:27.877599 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:27.877599 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:27.877599 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:27.877599 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:27.877599 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:27.877599 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:27.877599 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:27.877599 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:27.877599 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:27:27.877599 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:27:27.877599 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:27:27.877599 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:27:27.878953 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:27:27.878953 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:27:27.878953 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:27:27.878953 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:27:27.878953 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:27.878953 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:27.878953 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:27.878953 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:27.878953 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:27.878953 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:27.878953 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:27.878953 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:27.878953 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:27.878953 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:27.878953 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:27.878953 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:27.879788 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:27.879788 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:27.879788 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:27.879788 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:27.879788 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:27:27.879788 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:27:27.879788 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:27:27.879788 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:27:27.879788 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:27:27.879788 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:27:27.879788 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:27:27.879788 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Jul 11 14:27:27.885161 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 360/718] 10.222.0.70 () {56 vars in 1102 bytes} [Mon Jul 11 14:27:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:27:27.894547 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d57c9aa-974f-4869-8f60-afbc68e34d2c None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:27.901987 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4933427-27ff-4d50-a63f-dc2de5e1e455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:27.902739 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4933427-27ff-4d50-a63f-dc2de5e1e455 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:27.903022 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4933427-27ff-4d50-a63f-dc2de5e1e455 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:27.903292 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4933427-27ff-4d50-a63f-dc2de5e1e455 None admin] PATH_INFO: `/v3/users` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:27.904281 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4933427-27ff-4d50-a63f-dc2de5e1e455 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:27.904557 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4933427-27ff-4d50-a63f-dc2de5e1e455 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:27.906016 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4933427-27ff-4d50-a63f-dc2de5e1e455 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:27.951523 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 359/719] 10.222.0.70 () {56 vars in 1133 bytes} [Mon Jul 11 14:27:27 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 361 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:27.951523 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75714dce-3a8e-4f7d-8f7b-5cbb08433739 None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:27.951523 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75714dce-3a8e-4f7d-8f7b-5cbb08433739 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:27.951523 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75714dce-3a8e-4f7d-8f7b-5cbb08433739 None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:27.951523 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 360/720] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:27:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:27:27.957211 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ee55c3-0a75-46a9-b832-f76f5931797e None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:27.958468 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ee55c3-0a75-46a9-b832-f76f5931797e None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:27.958468 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ee55c3-0a75-46a9-b832-f76f5931797e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:27.976724 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-c6ee55c3-0a75-46a9-b832-f76f5931797e None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:27:27.978099 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-c6ee55c3-0a75-46a9-b832-f76f5931797e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:27:28.017017 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:28.043140 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d57c9aa-974f-4869-8f60-afbc68e34d2c None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:28.078074 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 361/721] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:27:27 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:27:28.079045 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ee55c3-0a75-46a9-b832-f76f5931797e None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:28.081663 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88759eb-c07f-41e7-b050-a59aba38594e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:28.082626 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88759eb-c07f-41e7-b050-a59aba38594e None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:28.083101 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88759eb-c07f-41e7-b050-a59aba38594e None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:28.083623 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88759eb-c07f-41e7-b050-a59aba38594e None admin] PATH_INFO: `/v3/roles` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:28.084760 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88759eb-c07f-41e7-b050-a59aba38594e None admin] RBAC: Adding query filter params (name=service) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:28.085290 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88759eb-c07f-41e7-b050-a59aba38594e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:28.086915 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88759eb-c07f-41e7-b050-a59aba38594e None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:28.098441 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 361/722] 10.222.0.70 () {56 vars in 1103 bytes} [Mon Jul 11 14:27:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:28.105383 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88759eb-c07f-41e7-b050-a59aba38594e None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:28.154164 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:28.201653 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ee55c3-0a75-46a9-b832-f76f5931797e None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:28.221754 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88759eb-c07f-41e7-b050-a59aba38594e None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:28.245398 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c7050f-8925-4de5-8992-33985a7da072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:28.246285 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c7050f-8925-4de5-8992-33985a7da072 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:28.246709 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c7050f-8925-4de5-8992-33985a7da072 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:28.247181 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c7050f-8925-4de5-8992-33985a7da072 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:28.264105 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c65f8b1-0d5e-46b1-852b-6b8f64176cba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:28.265403 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c65f8b1-0d5e-46b1-852b-6b8f64176cba None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:28.266014 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c65f8b1-0d5e-46b1-852b-6b8f64176cba None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:28.266481 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c65f8b1-0d5e-46b1-852b-6b8f64176cba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:28.284278 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c65f8b1-0d5e-46b1-852b-6b8f64176cba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:28.287062 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c65f8b1-0d5e-46b1-852b-6b8f64176cba None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:28.298361 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:28.321462 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application [None req-3c65f8b1-0d5e-46b1-852b-6b8f64176cba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:27:28.321462 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:28.321462 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:28.321462 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:28.321462 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:28.321462 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:28.321462 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:28.321462 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:28.321462 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:28.321462 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:28.321462 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:28.321462 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:28.321462 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:27:28.321462 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:27:28.321462 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:27:28.322423 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:27:28.322423 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:28.322423 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:28.322423 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:28.322423 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:28.322423 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:28.322423 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:28.322423 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:28.322423 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:28.322423 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:28.322423 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:28.322423 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:28.322423 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:28.322423 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:28.322423 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:28.322423 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:28.322423 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:28.323333 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:27:28.323333 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:27:28.323333 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:27:28.323333 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Jul 11 14:27:28.323333 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 362/723] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 11 14:27:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:27:28.324659 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c65f8b1-0d5e-46b1-852b-6b8f64176cba None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:28.353881 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c7050f-8925-4de5-8992-33985a7da072 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:28.355261 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c7050f-8925-4de5-8992-33985a7da072 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:28.438733 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:28.475755 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c65f8b1-0d5e-46b1-852b-6b8f64176cba None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:28.487715 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 362/724] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Jul 11 14:27:28 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 14:27:28.491977 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27283b6e-9768-4afd-a68f-f4b77ebf9a18 None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:28.492986 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27283b6e-9768-4afd-a68f-f4b77ebf9a18 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:28.493652 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27283b6e-9768-4afd-a68f-f4b77ebf9a18 None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:28.496122 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 363/725] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:27:28 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:27:28.497706 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27283b6e-9768-4afd-a68f-f4b77ebf9a18 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:28.514143 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c553332-b3f6-4860-a491-b7e13ffeb0c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:28.514953 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c553332-b3f6-4860-a491-b7e13ffeb0c8 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:28.515234 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c553332-b3f6-4860-a491-b7e13ffeb0c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:28.515507 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c553332-b3f6-4860-a491-b7e13ffeb0c8 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:28.516165 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c553332-b3f6-4860-a491-b7e13ffeb0c8 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:28.518233 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c553332-b3f6-4860-a491-b7e13ffeb0c8 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:28.534048 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application [None req-9c553332-b3f6-4860-a491-b7e13ffeb0c8 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 11 14:27:28.534048 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:28.534048 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 14:27:28.534048 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 14:27:28.534048 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 14:27:28.534048 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 14:27:28.534048 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 14:27:28.534048 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:27:28.534048 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 11 14:27:28.534048 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Jul 11 14:27:28.534048 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 14:27:28.534048 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Jul 11 14:27:28.534048 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:28.534048 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:28.534048 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:28.534048 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:28.535063 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:28.535063 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:28.535063 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:28.535063 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:28.535063 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:28.535063 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:28.535063 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:28.535063 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 14:27:28.535063 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 14:27:28.535063 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 14:27:28.535063 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 14:27:28.535063 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:28.535063 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:28.535063 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:28.535063 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:28.535063 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:28.535928 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:28.535928 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:28.535928 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:28.535928 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:28.535928 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:28.535928 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:28.535928 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:28.535928 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:28.535928 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:28.535928 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:28.535928 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:28.535928 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 14:27:28.535928 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:27:28.535928 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 11 14:27:28.535928 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Jul 11 14:27:28.535928 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 363/726] 10.222.0.70 () {56 vars in 1129 bytes} [Mon Jul 11 14:27:28 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:27:28.536841 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c553332-b3f6-4860-a491-b7e13ffeb0c8 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:28.630085 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:28.661065 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27283b6e-9768-4afd-a68f-f4b77ebf9a18 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:28.700058 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c553332-b3f6-4860-a491-b7e13ffeb0c8 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:28.708881 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244a3c61-a249-4c33-824b-1b1f097dc873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:28.709547 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244a3c61-a249-4c33-824b-1b1f097dc873 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:28.709833 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244a3c61-a249-4c33-824b-1b1f097dc873 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:28.710116 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244a3c61-a249-4c33-824b-1b1f097dc873 None admin] PATH_INFO: `/v3/domains` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:28.710843 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244a3c61-a249-4c33-824b-1b1f097dc873 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:28.711148 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244a3c61-a249-4c33-824b-1b1f097dc873 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:28.712551 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244a3c61-a249-4c33-824b-1b1f097dc873 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:28.725610 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 364/727] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jul 11 14:27:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:28.726888 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0eb923-c4d3-4134-b117-b84cfc54e17f None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:28.727179 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0eb923-c4d3-4134-b117-b84cfc54e17f None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:28.727460 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0eb923-c4d3-4134-b117-b84cfc54e17f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:28.742992 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52f6465-1e58-4e86-8c0d-a240d9d5da9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:28.744414 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52f6465-1e58-4e86-8c0d-a240d9d5da9a None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:28.744907 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52f6465-1e58-4e86-8c0d-a240d9d5da9a None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:28.745409 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52f6465-1e58-4e86-8c0d-a240d9d5da9a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:28.749162 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-6f0eb923-c4d3-4134-b117-b84cfc54e17f None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:27:28.750382 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-6f0eb923-c4d3-4134-b117-b84cfc54e17f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:27:28.766685 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52f6465-1e58-4e86-8c0d-a240d9d5da9a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:28.770034 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:28.770644 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52f6465-1e58-4e86-8c0d-a240d9d5da9a None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:28.805315 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application [None req-b52f6465-1e58-4e86-8c0d-a240d9d5da9a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:27:28.805315 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:28.805315 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:28.805315 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:28.805315 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:28.805315 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:28.805315 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:28.805315 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:28.805315 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:28.805315 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:28.805315 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:28.805315 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:28.805315 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:27:28.805315 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:27:28.805315 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:27:28.807464 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:27:28.807464 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:28.807464 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:28.807464 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:28.807464 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:28.807464 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:28.807464 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:28.807464 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:28.807464 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:28.807464 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:28.807464 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:28.807464 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:28.807464 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:28.807464 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:28.807464 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:28.807464 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:28.807464 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:28.809332 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:27:28.809332 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:27:28.809332 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:27:28.809332 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Jul 11 14:27:28.809332 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 364/728] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 11 14:27:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:27:28.809332 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52f6465-1e58-4e86-8c0d-a240d9d5da9a None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:28.828068 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 365/729] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:27:28 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:27:28.829469 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253367dd-c898-478e-9b07-8395e2da213a None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:28.831792 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253367dd-c898-478e-9b07-8395e2da213a None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:28.831792 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253367dd-c898-478e-9b07-8395e2da213a None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:28.831792 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 366/730] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:27:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:27:28.832605 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253367dd-c898-478e-9b07-8395e2da213a None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:28.953196 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253367dd-c898-478e-9b07-8395e2da213a None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:28.958048 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52f6465-1e58-4e86-8c0d-a240d9d5da9a None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:28.976125 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:29.004886 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531191ff-e851-49e4-910a-15c6d3eb0ac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:29.006281 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531191ff-e851-49e4-910a-15c6d3eb0ac8 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:29.006774 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531191ff-e851-49e4-910a-15c6d3eb0ac8 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:29.007263 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531191ff-e851-49e4-910a-15c6d3eb0ac8 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:29.007956 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8ff4fd-4458-4c85-88c2-5ff42195f3ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:29.008991 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8ff4fd-4458-4c85-88c2-5ff42195f3ad None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:29.009441 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8ff4fd-4458-4c85-88c2-5ff42195f3ad None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:29.009728 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8ff4fd-4458-4c85-88c2-5ff42195f3ad None admin] PATH_INFO: `/v3/services` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:29.010461 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8ff4fd-4458-4c85-88c2-5ff42195f3ad None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:29.010768 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8ff4fd-4458-4c85-88c2-5ff42195f3ad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:29.012148 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8ff4fd-4458-4c85-88c2-5ff42195f3ad None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:29.016951 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 365/731] 10.222.0.70 () {56 vars in 1124 bytes} [Mon Jul 11 14:27:28 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:29.017953 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8ff4fd-4458-4c85-88c2-5ff42195f3ad None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:29.021352 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531191ff-e851-49e4-910a-15c6d3eb0ac8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:29.024437 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531191ff-e851-49e4-910a-15c6d3eb0ac8 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:29.053150 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-531191ff-e851-49e4-910a-15c6d3eb0ac8 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 11 14:27:29.053150 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:29.053150 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:29.053150 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:29.053150 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:29.053150 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:29.053150 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:29.053150 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:29.053150 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:29.053150 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:29.053150 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:29.053150 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:29.053150 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 14:27:29.053150 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 14:27:29.053150 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 14:27:29.053150 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 14:27:29.054174 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:29.054174 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:29.054174 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 14:27:29.054174 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:27:29.054174 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 14:27:29.054174 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:27:29.054174 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:29.054174 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:29.054174 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:29.054174 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:29.054174 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:29.054174 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:29.054174 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:29.054174 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:29.054174 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:29.054174 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:29.054174 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:29.054174 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:29.055090 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:29.055090 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:29.055090 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 14:27:29.055090 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 14:27:29.055090 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 14:27:29.055090 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 14:27:29.055090 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 14:27:29.055090 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 14:27:29.055090 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 11 14:27:29.055090 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Jul 11 14:27:29.061426 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 367/732] 10.222.0.70 () {56 vars in 1117 bytes} [Mon Jul 11 14:27:28 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:27:29.061426 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d43da5b-dfe7-46c6-a17f-c9333fd29aba None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:29.061426 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d43da5b-dfe7-46c6-a17f-c9333fd29aba None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:29.061426 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d43da5b-dfe7-46c6-a17f-c9333fd29aba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:29.084792 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-6d43da5b-dfe7-46c6-a17f-c9333fd29aba None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:27:29.086875 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-6d43da5b-dfe7-46c6-a17f-c9333fd29aba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:27:29.105732 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:29.140151 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8ff4fd-4458-4c85-88c2-5ff42195f3ad None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:29.177732 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 368/733] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:27:29 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:27:29.177732 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d43da5b-dfe7-46c6-a17f-c9333fd29aba None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:29.210337 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cb88ae-a9ab-40ea-842c-ffe9568f7f12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:29.211313 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cb88ae-a9ab-40ea-842c-ffe9568f7f12 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:29.211814 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cb88ae-a9ab-40ea-842c-ffe9568f7f12 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:29.212351 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cb88ae-a9ab-40ea-842c-ffe9568f7f12 None admin] PATH_INFO: `/v3/domains` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:29.213764 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cb88ae-a9ab-40ea-842c-ffe9568f7f12 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:29.214314 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cb88ae-a9ab-40ea-842c-ffe9568f7f12 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:29.216911 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cb88ae-a9ab-40ea-842c-ffe9568f7f12 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:29.240723 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 366/734] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jul 11 14:27:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:29.241149 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cb88ae-a9ab-40ea-842c-ffe9568f7f12 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:29.291212 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d43da5b-dfe7-46c6-a17f-c9333fd29aba None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:29.302921 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:29.330481 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7891d075-e0f0-430e-9332-a2ffaae0090f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:29.331255 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7891d075-e0f0-430e-9332-a2ffaae0090f None admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:29.331541 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7891d075-e0f0-430e-9332-a2ffaae0090f None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:29.331820 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7891d075-e0f0-430e-9332-a2ffaae0090f None admin] PATH_INFO: `/v3/services` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:29.332593 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7891d075-e0f0-430e-9332-a2ffaae0090f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:29.333993 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7891d075-e0f0-430e-9332-a2ffaae0090f None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:29.349650 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 369/735] 10.222.0.70 () {60 vars in 1141 bytes} [Mon Jul 11 14:27:29 2022] POST /identity/v3/services => generated 240 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:27:29.350513 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7891d075-e0f0-430e-9332-a2ffaae0090f None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:29.354113 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:29.456478 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cb88ae-a9ab-40ea-842c-ffe9568f7f12 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:29.511255 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7891d075-e0f0-430e-9332-a2ffaae0090f None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:29.514424 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32fbcbe-4193-4f63-b501-73633c44eff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:29.515114 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32fbcbe-4193-4f63-b501-73633c44eff8 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:29.515396 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32fbcbe-4193-4f63-b501-73633c44eff8 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:29.515678 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32fbcbe-4193-4f63-b501-73633c44eff8 None admin] PATH_INFO: `/v3/services` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:29.516456 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32fbcbe-4193-4f63-b501-73633c44eff8 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:29.516770 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32fbcbe-4193-4f63-b501-73633c44eff8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:29.518338 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32fbcbe-4193-4f63-b501-73633c44eff8 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:29.530333 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 367/736] 10.222.0.70 () {56 vars in 1124 bytes} [Mon Jul 11 14:27:29 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:29.530333 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32fbcbe-4193-4f63-b501-73633c44eff8 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:29.588634 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4a8b43-c6a7-486e-b4f0-ae15c4041f32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:29.589670 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4a8b43-c6a7-486e-b4f0-ae15c4041f32 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:29.590071 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4a8b43-c6a7-486e-b4f0-ae15c4041f32 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:29.590449 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4a8b43-c6a7-486e-b4f0-ae15c4041f32 None admin] PATH_INFO: `/v3/users` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:29.591429 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4a8b43-c6a7-486e-b4f0-ae15c4041f32 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:29.591828 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4a8b43-c6a7-486e-b4f0-ae15c4041f32 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:29.594676 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4a8b43-c6a7-486e-b4f0-ae15c4041f32 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:29.616386 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 370/737] 10.222.0.70 () {56 vars in 1149 bytes} [Mon Jul 11 14:27:29 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:29.617236 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4a8b43-c6a7-486e-b4f0-ae15c4041f32 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:29.676254 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:29.679824 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32fbcbe-4193-4f63-b501-73633c44eff8 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:29.690855 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:29.728732 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3414252-1c22-426c-828c-af0d62497db5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:29.729557 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3414252-1c22-426c-828c-af0d62497db5 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:29.729841 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3414252-1c22-426c-828c-af0d62497db5 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:29.730118 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3414252-1c22-426c-828c-af0d62497db5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:29.744125 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3414252-1c22-426c-828c-af0d62497db5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:27:29.754719 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application [None req-a3414252-1c22-426c-828c-af0d62497db5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:27:29.754719 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:29.754719 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:29.754719 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:29.754719 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:29.754719 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:29.754719 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:29.754719 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:29.754719 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:29.754719 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:29.754719 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:29.754719 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:29.754719 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:27:29.754719 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:27:29.754719 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:27:29.754719 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:27:29.756872 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:27:29.756872 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:27:29.756872 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:27:29.756872 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:27:29.756872 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:29.756872 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:29.756872 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:29.756872 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:29.756872 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:29.756872 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:29.756872 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:29.756872 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:29.756872 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:29.756872 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:29.756872 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:29.756872 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:29.759378 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:29.759378 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:29.759378 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:29.759378 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:29.759378 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:27:29.759378 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:27:29.759378 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:27:29.759378 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:27:29.759378 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:27:29.759378 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:27:29.759378 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:27:29.759378 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Jul 11 14:27:29.760782 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4a8b43-c6a7-486e-b4f0-ae15c4041f32 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:29.761435 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 368/738] 10.222.0.70 () {56 vars in 1096 bytes} [Mon Jul 11 14:27:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:27:29.761435 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3414252-1c22-426c-828c-af0d62497db5 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:29.824932 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e8bc38-8731-4ccc-8b44-aa86da895d5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:29.826262 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e8bc38-8731-4ccc-8b44-aa86da895d5e None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:29.826744 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e8bc38-8731-4ccc-8b44-aa86da895d5e None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:29.827230 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e8bc38-8731-4ccc-8b44-aa86da895d5e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:29.840802 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e8bc38-8731-4ccc-8b44-aa86da895d5e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:29.843494 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e8bc38-8731-4ccc-8b44-aa86da895d5e None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:29.868838 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-89e8bc38-8731-4ccc-8b44-aa86da895d5e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:27:29.868838 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:29.868838 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:29.868838 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:29.868838 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:29.868838 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:29.868838 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:29.868838 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:29.868838 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:29.868838 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:29.868838 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:29.868838 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:29.868838 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 14:27:29.868838 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 14:27:29.868838 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 14:27:29.870711 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 14:27:29.870711 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:29.870711 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:29.870711 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:29.870711 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:29.870711 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:29.870711 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:29.870711 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:29.870711 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:29.870711 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:29.870711 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:29.870711 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:29.870711 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:29.870711 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:29.870711 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:29.870711 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:29.870711 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:29.872838 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 14:27:29.872838 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 14:27:29.872838 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 14:27:29.872838 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 14:27:29.872838 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 14:27:29.872838 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 14:27:29.872838 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:27:29.872838 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Jul 11 14:27:29.872838 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 371/739] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Jul 11 14:27:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:27:29.872838 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e8bc38-8731-4ccc-8b44-aa86da895d5e None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:29.957584 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3414252-1c22-426c-828c-af0d62497db5 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:30.010263 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e8bc38-8731-4ccc-8b44-aa86da895d5e None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:30.020835 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49e12be-b05d-4fb3-9c75-6e94d5e065fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:30.022142 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49e12be-b05d-4fb3-9c75-6e94d5e065fb None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:30.022922 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49e12be-b05d-4fb3-9c75-6e94d5e065fb None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:30.023501 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49e12be-b05d-4fb3-9c75-6e94d5e065fb None admin] PATH_INFO: `/v3/endpoints` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:30.025108 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49e12be-b05d-4fb3-9c75-6e94d5e065fb None admin] RBAC: Adding query filter params (interface=public, service_id=1dea1be2e23f4f1cbb6bae3cbad2d4eb, region_id=RegionOne) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:30.025625 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49e12be-b05d-4fb3-9c75-6e94d5e065fb None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:30.028233 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49e12be-b05d-4fb3-9c75-6e94d5e065fb None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:30.033540 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:30.043363 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 369/740] 10.222.0.70 () {56 vars in 1251 bytes} [Mon Jul 11 14:27:29 2022] GET /identity/v3/endpoints?service_id=1dea1be2e23f4f1cbb6bae3cbad2d4eb&interface=public®ion_id=RegionOne => generated 194 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:30.044736 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49e12be-b05d-4fb3-9c75-6e94d5e065fb None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:30.062807 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab23e677-30f9-4608-ba07-24250ff670a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:30.063479 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab23e677-30f9-4608-ba07-24250ff670a6 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:30.063768 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab23e677-30f9-4608-ba07-24250ff670a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:30.064938 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab23e677-30f9-4608-ba07-24250ff670a6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:30.090516 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:30.198292 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab23e677-30f9-4608-ba07-24250ff670a6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:30.200967 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab23e677-30f9-4608-ba07-24250ff670a6 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:30.222737 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49e12be-b05d-4fb3-9c75-6e94d5e065fb None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:30.291196 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e425036-a46f-40ca-b911-5731415ced14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:30.291196 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e425036-a46f-40ca-b911-5731415ced14 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:30.291475 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e425036-a46f-40ca-b911-5731415ced14 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:30.291700 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e425036-a46f-40ca-b911-5731415ced14 None admin] PATH_INFO: `/v3/roles` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:30.292515 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e425036-a46f-40ca-b911-5731415ced14 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:30.292830 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e425036-a46f-40ca-b911-5731415ced14 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:30.294250 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e425036-a46f-40ca-b911-5731415ced14 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:30.309520 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 370/741] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Jul 11 14:27:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:30.309520 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e425036-a46f-40ca-b911-5731415ced14 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:30.336918 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 372/742] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Jul 11 14:27:29 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 11 14:27:30.338755 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab23e677-30f9-4608-ba07-24250ff670a6 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:30.373781 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:30.458135 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:30.487498 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e425036-a46f-40ca-b911-5731415ced14 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:30.499843 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab23e677-30f9-4608-ba07-24250ff670a6 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:30.542161 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c8a337-a683-4e8e-abc9-ab392c6f040d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:30.542752 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c8a337-a683-4e8e-abc9-ab392c6f040d None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:30.543085 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c8a337-a683-4e8e-abc9-ab392c6f040d None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:30.543370 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c8a337-a683-4e8e-abc9-ab392c6f040d None admin] PATH_INFO: `/v3/services` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:30.544089 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c8a337-a683-4e8e-abc9-ab392c6f040d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:30.545554 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c8a337-a683-4e8e-abc9-ab392c6f040d None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:30.552523 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 373/743] 10.222.0.70 () {56 vars in 1087 bytes} [Mon Jul 11 14:27:30 2022] GET /identity/v3/services => generated 772 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:30.553147 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c8a337-a683-4e8e-abc9-ab392c6f040d None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:30.581976 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaf8d15-6aee-4432-abd7-5fe41f272622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:30.583020 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaf8d15-6aee-4432-abd7-5fe41f272622 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:30.583454 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaf8d15-6aee-4432-abd7-5fe41f272622 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:30.583928 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaf8d15-6aee-4432-abd7-5fe41f272622 None admin] PATH_INFO: `/v3/projects` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:30.587886 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baaf8d15-6aee-4432-abd7-5fe41f272622 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:30.588414 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baaf8d15-6aee-4432-abd7-5fe41f272622 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:30.590106 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baaf8d15-6aee-4432-abd7-5fe41f272622 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:30.605530 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 371/744] 10.222.0.70 () {56 vars in 1148 bytes} [Mon Jul 11 14:27:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:30.606439 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaf8d15-6aee-4432-abd7-5fe41f272622 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:30.752353 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:30.772349 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaf8d15-6aee-4432-abd7-5fe41f272622 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:30.795479 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c8a337-a683-4e8e-abc9-ab392c6f040d None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:30.851471 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd243584-4bdb-43b1-bf8a-be7b26877365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:30.853745 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd243584-4bdb-43b1-bf8a-be7b26877365 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:30.854843 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd243584-4bdb-43b1-bf8a-be7b26877365 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:30.855005 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd243584-4bdb-43b1-bf8a-be7b26877365 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:30.860318 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e6137d-af5e-4c7c-93a3-3a057f0ae789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:30.861802 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e6137d-af5e-4c7c-93a3-3a057f0ae789 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:30.862074 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e6137d-af5e-4c7c-93a3-3a057f0ae789 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:30.862339 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e6137d-af5e-4c7c-93a3-3a057f0ae789 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:30.874286 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e6137d-af5e-4c7c-93a3-3a057f0ae789 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:30.875903 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e6137d-af5e-4c7c-93a3-3a057f0ae789 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:30.880451 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd243584-4bdb-43b1-bf8a-be7b26877365 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:30.883206 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd243584-4bdb-43b1-bf8a-be7b26877365 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:30.898318 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:30.899915 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-39e6137d-af5e-4c7c-93a3-3a057f0ae789 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:27:30.899915 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:30.899915 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:30.899915 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:30.899915 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:30.899915 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:30.899915 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:30.899915 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:30.899915 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:30.899915 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:30.899915 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:30.899915 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:30.899915 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:27:30.899915 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:27:30.899915 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:27:30.902100 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:27:30.902100 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:30.902100 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:30.902100 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:30.902100 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:30.902100 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:30.902100 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:30.902100 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:30.902100 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:30.902100 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:30.902100 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:30.902100 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:30.902100 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:30.902100 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:30.902100 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:30.902100 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:30.902100 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:30.904865 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:27:30.904865 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:27:30.904865 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:27:30.904865 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Jul 11 14:27:30.904865 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 374/745] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 11 14:27:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 349 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:27:30.904865 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e6137d-af5e-4c7c-93a3-3a057f0ae789 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:30.934867 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application [None req-cd243584-4bdb-43b1-bf8a-be7b26877365 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:27:30.934867 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:30.934867 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:30.934867 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:30.934867 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:30.934867 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:30.934867 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:30.934867 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:30.934867 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:30.934867 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:30.934867 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:30.934867 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:30.934867 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:27:30.934867 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:27:30.934867 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:27:30.936886 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:27:30.936886 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:30.936886 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:30.936886 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:30.936886 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:30.936886 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:30.936886 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:30.936886 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:30.936886 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:30.936886 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:30.936886 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:30.936886 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:30.936886 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:30.936886 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:30.936886 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:30.936886 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:30.936886 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:30.939733 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:27:30.939733 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:27:30.939733 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:27:30.939733 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Jul 11 14:27:30.939733 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 372/746] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 11 14:27:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:27:30.948234 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd243584-4bdb-43b1-bf8a-be7b26877365 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:31.076436 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd243584-4bdb-43b1-bf8a-be7b26877365 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:31.088047 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e6137d-af5e-4c7c-93a3-3a057f0ae789 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:31.128831 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6759ef2a-5e77-492c-909e-78705c0a0f02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:31.128831 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6759ef2a-5e77-492c-909e-78705c0a0f02 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:31.128831 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6759ef2a-5e77-492c-909e-78705c0a0f02 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:31.128831 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6759ef2a-5e77-492c-909e-78705c0a0f02 None admin] PATH_INFO: `/v3/domains` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:31.129806 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6759ef2a-5e77-492c-909e-78705c0a0f02 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:31.129806 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6759ef2a-5e77-492c-909e-78705c0a0f02 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:31.129806 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6759ef2a-5e77-492c-909e-78705c0a0f02 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:31.143472 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 373/747] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jul 11 14:27:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:31.149703 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6759ef2a-5e77-492c-909e-78705c0a0f02 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:31.162930 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188acbbb-1888-4583-b839-5f8286044e14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:31.164127 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188acbbb-1888-4583-b839-5f8286044e14 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:31.164748 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188acbbb-1888-4583-b839-5f8286044e14 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:31.165260 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188acbbb-1888-4583-b839-5f8286044e14 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:31.166933 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188acbbb-1888-4583-b839-5f8286044e14 None admin] RBAC: Adding query filter params (role.id=b46df176b0fe479da63c318db225bed4, scope.project.id=ccd34295bf7b435a96b37487c8e89fc3, user.id=f4f8c0d696af4bd5a205ca8e9110b8cc) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:31.167510 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188acbbb-1888-4583-b839-5f8286044e14 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:31.170465 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188acbbb-1888-4583-b839-5f8286044e14 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:31.175019 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:31.184619 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 375/748] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Jul 11 14:27:30 2022] GET /identity/v3/role_assignments?user.id=f4f8c0d696af4bd5a205ca8e9110b8cc&scope.project.id=ccd34295bf7b435a96b37487c8e89fc3&role.id=b46df176b0fe479da63c318db225bed4 => generated 259 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:31.186199 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188acbbb-1888-4583-b839-5f8286044e14 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:31.232348 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:31.287854 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6759ef2a-5e77-492c-909e-78705c0a0f02 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:31.333255 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2d0b55-ef04-4191-98e4-e456799628bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:31.334291 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2d0b55-ef04-4191-98e4-e456799628bc None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:31.334792 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2d0b55-ef04-4191-98e4-e456799628bc None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:31.335262 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2d0b55-ef04-4191-98e4-e456799628bc None admin] PATH_INFO: `/v3/domains` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:31.336282 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2d0b55-ef04-4191-98e4-e456799628bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:31.336804 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2d0b55-ef04-4191-98e4-e456799628bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:31.338615 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2d0b55-ef04-4191-98e4-e456799628bc None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:31.354619 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 374/749] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jul 11 14:27:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:31.360751 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2d0b55-ef04-4191-98e4-e456799628bc None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:31.462624 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188acbbb-1888-4583-b839-5f8286044e14 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:31.494483 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2d0b55-ef04-4191-98e4-e456799628bc None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:31.516687 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67de4f7e-d7f4-4bda-94dc-7e582b2c9081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:31.518463 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67de4f7e-d7f4-4bda-94dc-7e582b2c9081 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:31.518778 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67de4f7e-d7f4-4bda-94dc-7e582b2c9081 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:31.519057 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67de4f7e-d7f4-4bda-94dc-7e582b2c9081 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:31.520317 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:31.530360 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67de4f7e-d7f4-4bda-94dc-7e582b2c9081 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:31.532239 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67de4f7e-d7f4-4bda-94dc-7e582b2c9081 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:31.542364 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1335b373-2723-4470-bd0e-dee5eff446f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:31.543762 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1335b373-2723-4470-bd0e-dee5eff446f5 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:31.544310 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1335b373-2723-4470-bd0e-dee5eff446f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:31.544806 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1335b373-2723-4470-bd0e-dee5eff446f5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:31.553276 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-67de4f7e-d7f4-4bda-94dc-7e582b2c9081 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 11 14:27:31.553276 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:31.553276 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:31.553276 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:31.553276 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:31.553276 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:31.553276 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:31.553276 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:31.553276 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:31.553276 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:31.553276 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:31.553276 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:31.553276 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 14:27:31.553276 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 14:27:31.553276 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 14:27:31.553276 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 14:27:31.554259 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:31.554259 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:31.554259 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 14:27:31.554259 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:27:31.554259 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 14:27:31.554259 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:27:31.554259 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:31.554259 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:31.554259 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:31.554259 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:31.554259 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:31.554259 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:31.554259 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:31.554259 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:31.554259 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:31.554259 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:31.554259 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:31.554259 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:31.555198 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:31.555198 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:31.555198 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 14:27:31.555198 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 14:27:31.555198 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 14:27:31.555198 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 14:27:31.555198 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 14:27:31.555198 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 14:27:31.555198 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 11 14:27:31.555198 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Jul 11 14:27:31.555198 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 376/750] 10.222.0.70 () {56 vars in 1096 bytes} [Mon Jul 11 14:27:31 2022] GET /identity/v3/users/swift => generated 83 bytes in 367 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:27:31.562892 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67de4f7e-d7f4-4bda-94dc-7e582b2c9081 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:31.567448 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1335b373-2723-4470-bd0e-dee5eff446f5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:31.574627 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1335b373-2723-4470-bd0e-dee5eff446f5 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:31.604370 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application [None req-1335b373-2723-4470-bd0e-dee5eff446f5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:27:31.604370 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:31.604370 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:31.604370 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:31.604370 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:31.604370 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:31.604370 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:31.604370 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:31.604370 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:31.604370 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:31.604370 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:31.604370 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:31.604370 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 14:27:31.604370 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 14:27:31.604370 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 14:27:31.606039 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 14:27:31.606039 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:31.606039 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:31.606039 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:31.606039 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:31.606039 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:31.606039 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:31.606039 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:31.606039 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:31.606039 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:31.606039 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:31.606039 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:31.606039 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:31.606039 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:31.606039 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:31.606039 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:31.606039 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:31.607724 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 14:27:31.607724 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 14:27:31.607724 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 14:27:31.607724 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 14:27:31.607724 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 14:27:31.607724 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 14:27:31.607724 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:27:31.607724 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Jul 11 14:27:31.607724 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 375/751] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Jul 11 14:27:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:27:31.614410 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1335b373-2723-4470-bd0e-dee5eff446f5 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:31.712389 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:31.807964 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67de4f7e-d7f4-4bda-94dc-7e582b2c9081 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:31.891572 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6fa471-b50c-47c2-af90-38ec304ce477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:31.892786 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6fa471-b50c-47c2-af90-38ec304ce477 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:31.893285 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6fa471-b50c-47c2-af90-38ec304ce477 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:31.893774 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6fa471-b50c-47c2-af90-38ec304ce477 None admin] PATH_INFO: `/v3/users` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:31.895423 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6fa471-b50c-47c2-af90-38ec304ce477 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:31.896054 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6fa471-b50c-47c2-af90-38ec304ce477 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:31.899702 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6fa471-b50c-47c2-af90-38ec304ce477 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:31.933057 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1335b373-2723-4470-bd0e-dee5eff446f5 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:31.940611 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 377/752] 10.222.0.70 () {56 vars in 1135 bytes} [Mon Jul 11 14:27:31 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 380 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:31.949886 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6fa471-b50c-47c2-af90-38ec304ce477 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:31.997032 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08db2e3d-5ea1-407d-a48a-9c66129fa691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:31.997846 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08db2e3d-5ea1-407d-a48a-9c66129fa691 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:31.998127 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08db2e3d-5ea1-407d-a48a-9c66129fa691 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:31.998404 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08db2e3d-5ea1-407d-a48a-9c66129fa691 None admin] PATH_INFO: `/v3/projects` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:31.999212 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08db2e3d-5ea1-407d-a48a-9c66129fa691 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:31.999519 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08db2e3d-5ea1-407d-a48a-9c66129fa691 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:32.001015 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08db2e3d-5ea1-407d-a48a-9c66129fa691 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:32.044573 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 376/753] 10.222.0.70 () {56 vars in 1148 bytes} [Mon Jul 11 14:27:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 431 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:32.046935 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ed80b6-202b-40af-8e44-4653350d89e3 None None] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:32.047439 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ed80b6-202b-40af-8e44-4653350d89e3 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:32.047927 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ed80b6-202b-40af-8e44-4653350d89e3 None None] PATH_INFO: `/` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:32.057295 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 377/754] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:27:32 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:27:32.058799 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ed80b6-202b-40af-8e44-4653350d89e3 None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:32.125509 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:32.156730 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6fa471-b50c-47c2-af90-38ec304ce477 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:32.194113 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:32.226965 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdc1163-5e72-4124-b447-f4dc407cc218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:32.228354 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdc1163-5e72-4124-b447-f4dc407cc218 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:32.228824 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdc1163-5e72-4124-b447-f4dc407cc218 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:32.229296 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdc1163-5e72-4124-b447-f4dc407cc218 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:32.232340 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ed80b6-202b-40af-8e44-4653350d89e3 None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:32.295435 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2bcf1a-59d0-45ee-bda9-81a4f382f57a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:32.296892 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2bcf1a-59d0-45ee-bda9-81a4f382f57a None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:32.297496 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2bcf1a-59d0-45ee-bda9-81a4f382f57a None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:32.298137 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2bcf1a-59d0-45ee-bda9-81a4f382f57a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:32.300348 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2bcf1a-59d0-45ee-bda9-81a4f382f57a None admin] RBAC: Adding query filter params (role.id=c766eda9743248fa87df72ec905d271e, scope.project.id=ccd34295bf7b435a96b37487c8e89fc3, user.id=2ef7b195b623456aa0b12dac0a4bf4d3) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:32.300997 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2bcf1a-59d0-45ee-bda9-81a4f382f57a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:32.303708 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2bcf1a-59d0-45ee-bda9-81a4f382f57a None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:32.315186 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 378/755] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Jul 11 14:27:32 2022] GET /identity/v3/role_assignments?user.id=2ef7b195b623456aa0b12dac0a4bf4d3&scope.project.id=ccd34295bf7b435a96b37487c8e89fc3&role.id=c766eda9743248fa87df72ec905d271e => generated 259 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:32.317614 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf38861-5901-4255-a7c5-f1d6086294b5 None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:32.318234 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf38861-5901-4255-a7c5-f1d6086294b5 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:32.318835 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf38861-5901-4255-a7c5-f1d6086294b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:32.352668 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-daf38861-5901-4255-a7c5-f1d6086294b5 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:27:32.354524 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-daf38861-5901-4255-a7c5-f1d6086294b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:27:32.417835 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdc1163-5e72-4124-b447-f4dc407cc218 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:32.420238 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdc1163-5e72-4124-b447-f4dc407cc218 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:32.614712 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 379/756] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:27:32 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:27:32.641669 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf38861-5901-4255-a7c5-f1d6086294b5 None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:32.676902 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 378/757] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Jul 11 14:27:31 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 728 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 11 14:27:32.686021 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdc1163-5e72-4124-b447-f4dc407cc218 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:32.716601 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:32.746335 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:32.913070 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf38861-5901-4255-a7c5-f1d6086294b5 None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:32.949162 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdc1163-5e72-4124-b447-f4dc407cc218 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:32.994191 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fa09e2-78ec-453a-ba6b-0dad1124f276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:32.996310 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fa09e2-78ec-453a-ba6b-0dad1124f276 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:32.996606 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fa09e2-78ec-453a-ba6b-0dad1124f276 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:32.996850 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fa09e2-78ec-453a-ba6b-0dad1124f276 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:33.012852 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4837e24d-029e-4e55-87de-8c65a8129bf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:33.013675 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4837e24d-029e-4e55-87de-8c65a8129bf1 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:33.013959 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4837e24d-029e-4e55-87de-8c65a8129bf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:33.014231 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4837e24d-029e-4e55-87de-8c65a8129bf1 None admin] PATH_INFO: `/v3/services/network` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:33.014904 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4837e24d-029e-4e55-87de-8c65a8129bf1 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:33.016333 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4837e24d-029e-4e55-87de-8c65a8129bf1 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:33.024392 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fa09e2-78ec-453a-ba6b-0dad1124f276 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:33.026250 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fa09e2-78ec-453a-ba6b-0dad1124f276 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:33.041438 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application [None req-4837e24d-029e-4e55-87de-8c65a8129bf1 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 11 14:27:33.041438 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:33.041438 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 14:27:33.041438 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 14:27:33.041438 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 14:27:33.041438 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 14:27:33.041438 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 14:27:33.041438 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:27:33.041438 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 11 14:27:33.041438 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Jul 11 14:27:33.041438 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 14:27:33.041438 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Jul 11 14:27:33.041438 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:33.041438 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:33.041438 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:33.041438 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:33.041438 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:33.042595 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:33.042595 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:33.042595 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:33.042595 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:33.042595 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:33.042595 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:33.042595 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 14:27:33.042595 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 14:27:33.042595 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 14:27:33.042595 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 14:27:33.042595 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:33.042595 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:33.042595 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:33.042595 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:33.042595 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:33.042595 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:33.043549 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:33.043549 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:33.043549 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:33.043549 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:33.043549 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:33.043549 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:33.043549 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:33.043549 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:33.043549 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:33.043549 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:33.043549 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 14:27:33.043549 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:27:33.043549 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 11 14:27:33.043549 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Jul 11 14:27:33.043549 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 380/758] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Jul 11 14:27:32 2022] GET /identity/v3/services/network => generated 88 bytes in 403 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:27:33.050017 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4837e24d-029e-4e55-87de-8c65a8129bf1 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:33.065071 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-33fa09e2-78ec-453a-ba6b-0dad1124f276 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:27:33.065071 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:33.065071 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:33.065071 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:33.065071 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:33.065071 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:33.065071 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:33.065071 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:33.065071 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:33.065071 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:33.065071 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:33.065071 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:33.065071 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:27:33.065071 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:27:33.065071 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:27:33.066193 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:27:33.066193 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:33.066193 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:33.066193 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:33.066193 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:33.066193 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:33.066193 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:33.066193 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:33.066193 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:33.066193 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:33.066193 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:33.066193 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:33.066193 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:33.066193 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:33.066193 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:33.066193 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:33.066193 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:33.067104 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:27:33.067104 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:27:33.067104 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:27:33.067104 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Jul 11 14:27:33.069582 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 379/759] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 11 14:27:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 384 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:27:33.075591 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fa09e2-78ec-453a-ba6b-0dad1124f276 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:33.198633 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:33.231729 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:33.241189 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4837e24d-029e-4e55-87de-8c65a8129bf1 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:33.278779 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fa09e2-78ec-453a-ba6b-0dad1124f276 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:33.307053 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caa0413-1a1a-4ce7-ab34-0b7fa6f41949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:33.310130 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caa0413-1a1a-4ce7-ab34-0b7fa6f41949 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:33.312284 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caa0413-1a1a-4ce7-ab34-0b7fa6f41949 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:33.312825 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caa0413-1a1a-4ce7-ab34-0b7fa6f41949 None admin] PATH_INFO: `/v3/services` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:33.316854 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8caa0413-1a1a-4ce7-ab34-0b7fa6f41949 None admin] RBAC: Adding query filter params (name=network) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:33.317521 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8caa0413-1a1a-4ce7-ab34-0b7fa6f41949 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:33.319200 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8caa0413-1a1a-4ce7-ab34-0b7fa6f41949 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:33.328488 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 381/760] 10.222.0.70 () {56 vars in 1112 bytes} [Mon Jul 11 14:27:33 2022] GET /identity/v3/services?name=network => generated 124 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:33.341508 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caa0413-1a1a-4ce7-ab34-0b7fa6f41949 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:33.360534 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a7bdf1-febb-4661-8a08-69312a4bacf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:33.362527 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a7bdf1-febb-4661-8a08-69312a4bacf1 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:33.363903 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a7bdf1-febb-4661-8a08-69312a4bacf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:33.364630 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a7bdf1-febb-4661-8a08-69312a4bacf1 None admin] PATH_INFO: `/v3/domains` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:33.367231 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a7bdf1-febb-4661-8a08-69312a4bacf1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:33.367786 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a7bdf1-febb-4661-8a08-69312a4bacf1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:33.370348 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a7bdf1-febb-4661-8a08-69312a4bacf1 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:33.402434 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 380/761] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jul 11 14:27:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:27:33.403878 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a7bdf1-febb-4661-8a08-69312a4bacf1 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:33.533752 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caa0413-1a1a-4ce7-ab34-0b7fa6f41949 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:33.546682 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a7bdf1-febb-4661-8a08-69312a4bacf1 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:33.577922 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:33.587268 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba98e90-2529-4eff-9bb5-bba8502c9904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:33.588618 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba98e90-2529-4eff-9bb5-bba8502c9904 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:33.588804 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba98e90-2529-4eff-9bb5-bba8502c9904 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:33.589024 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba98e90-2529-4eff-9bb5-bba8502c9904 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:33.597311 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba98e90-2529-4eff-9bb5-bba8502c9904 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:33.598853 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba98e90-2529-4eff-9bb5-bba8502c9904 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:33.617936 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-fba98e90-2529-4eff-9bb5-bba8502c9904 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:27:33.617936 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:33.617936 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:33.617936 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:33.617936 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:33.617936 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:33.617936 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:33.617936 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:33.617936 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:33.617936 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:33.617936 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:33.617936 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:33.617936 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 14:27:33.617936 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 14:27:33.617936 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 14:27:33.619679 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 14:27:33.619679 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:33.619679 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:33.619679 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:33.619679 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:33.619679 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:33.619679 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:33.619679 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:33.619679 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:33.619679 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:33.619679 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:33.619679 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:33.619679 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:33.619679 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:33.619679 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:33.619679 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:33.619679 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:33.621476 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 14:27:33.621476 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 14:27:33.621476 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 14:27:33.621476 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 14:27:33.621476 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 14:27:33.621476 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 14:27:33.621476 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:27:33.621476 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Jul 11 14:27:33.621476 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 381/762] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Jul 11 14:27:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:27:33.622454 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d5d5e9-e836-4464-a613-0e777880fa57 None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:33.622454 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d5d5e9-e836-4464-a613-0e777880fa57 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:33.622693 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d5d5e9-e836-4464-a613-0e777880fa57 None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:33.628251 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 382/763] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:27:33 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:27:33.629177 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d5d5e9-e836-4464-a613-0e777880fa57 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:33.635983 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d284649b-f315-4743-a1cc-25769c239022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:33.637624 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d284649b-f315-4743-a1cc-25769c239022 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:33.638594 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d284649b-f315-4743-a1cc-25769c239022 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:33.639372 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d284649b-f315-4743-a1cc-25769c239022 None admin] PATH_INFO: `/v3/services` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:33.641136 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d284649b-f315-4743-a1cc-25769c239022 None admin] RBAC: Adding query filter params (type=network) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:33.642852 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d284649b-f315-4743-a1cc-25769c239022 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:33.647025 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d284649b-f315-4743-a1cc-25769c239022 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:33.657278 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 382/764] 10.222.0.70 () {56 vars in 1112 bytes} [Mon Jul 11 14:27:33 2022] GET /identity/v3/services?type=network => generated 350 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:33.660874 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07652096-f5d6-45d8-b265-a59d39a10d87 None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:33.661772 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07652096-f5d6-45d8-b265-a59d39a10d87 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:33.662449 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07652096-f5d6-45d8-b265-a59d39a10d87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:33.702631 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-07652096-f5d6-45d8-b265-a59d39a10d87 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:27:33.706399 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-07652096-f5d6-45d8-b265-a59d39a10d87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:27:33.752871 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:33.763305 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d5d5e9-e836-4464-a613-0e777880fa57 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:33.805196 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd1f559-f232-4f67-a507-36a85b1369de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:33.806234 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd1f559-f232-4f67-a507-36a85b1369de None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:33.806980 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd1f559-f232-4f67-a507-36a85b1369de None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:33.807461 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd1f559-f232-4f67-a507-36a85b1369de None admin] PATH_INFO: `/v3/projects` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:33.808527 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd1f559-f232-4f67-a507-36a85b1369de None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:33.809054 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd1f559-f232-4f67-a507-36a85b1369de None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:33.810720 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd1f559-f232-4f67-a507-36a85b1369de None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:33.828575 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 383/765] 10.222.0.70 () {56 vars in 1148 bytes} [Mon Jul 11 14:27:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:33.830585 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd1f559-f232-4f67-a507-36a85b1369de None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:33.847449 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 383/766] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:27:33 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:27:33.849309 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07652096-f5d6-45d8-b265-a59d39a10d87 None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:33.894730 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:33.965203 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd1f559-f232-4f67-a507-36a85b1369de None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:34.009912 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc7b948-736e-4b16-abeb-39f7961252c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:34.011012 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc7b948-736e-4b16-abeb-39f7961252c4 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:34.011513 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc7b948-736e-4b16-abeb-39f7961252c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:34.012002 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc7b948-736e-4b16-abeb-39f7961252c4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:34.013099 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc7b948-736e-4b16-abeb-39f7961252c4 None admin] RBAC: Adding query filter params (interface=public, service_id=a8f43631039641b4b9164574134f97fc, region_id=RegionOne) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:34.013641 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc7b948-736e-4b16-abeb-39f7961252c4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:34.015339 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc7b948-736e-4b16-abeb-39f7961252c4 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:34.025494 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 384/767] 10.222.0.70 () {56 vars in 1251 bytes} [Mon Jul 11 14:27:33 2022] GET /identity/v3/endpoints?service_id=a8f43631039641b4b9164574134f97fc&interface=public®ion_id=RegionOne => generated 194 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:34.026921 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc7b948-736e-4b16-abeb-39f7961252c4 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:34.156331 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc7b948-736e-4b16-abeb-39f7961252c4 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:34.173567 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:34.182650 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07652096-f5d6-45d8-b265-a59d39a10d87 None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:34.203630 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5204f8c5-e977-4bfe-b12f-1177a342bf9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:34.205015 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5204f8c5-e977-4bfe-b12f-1177a342bf9d None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:34.205528 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5204f8c5-e977-4bfe-b12f-1177a342bf9d None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:34.206052 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5204f8c5-e977-4bfe-b12f-1177a342bf9d None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:34.206951 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5204f8c5-e977-4bfe-b12f-1177a342bf9d None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:34.208699 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5204f8c5-e977-4bfe-b12f-1177a342bf9d None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:34.223552 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-5204f8c5-e977-4bfe-b12f-1177a342bf9d None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 11 14:27:34.223552 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:34.223552 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 14:27:34.223552 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 14:27:34.223552 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 14:27:34.223552 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 14:27:34.223552 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 14:27:34.223552 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:27:34.223552 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 11 14:27:34.223552 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Jul 11 14:27:34.223552 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 14:27:34.223552 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Jul 11 14:27:34.223552 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:34.223552 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:34.223552 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:34.223552 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:34.224630 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:34.224630 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:34.224630 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:34.224630 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:34.224630 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:34.224630 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:34.224630 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:34.224630 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 14:27:34.224630 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 14:27:34.224630 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 14:27:34.224630 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 14:27:34.224630 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:34.224630 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:34.224630 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:34.224630 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:34.224630 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:34.225472 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:34.225472 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:34.225472 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:34.225472 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:34.225472 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:34.225472 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:34.225472 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:34.225472 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:34.225472 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:34.225472 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:34.225472 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:34.225472 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 14:27:34.225472 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:27:34.225472 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 11 14:27:34.225472 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Jul 11 14:27:34.226271 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 385/768] 10.222.0.70 () {56 vars in 1129 bytes} [Mon Jul 11 14:27:34 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:27:34.226951 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5204f8c5-e977-4bfe-b12f-1177a342bf9d None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:34.232021 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35073302-6aab-4dac-a9c0-2dd6d40f39b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:34.233539 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35073302-6aab-4dac-a9c0-2dd6d40f39b4 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:34.234095 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35073302-6aab-4dac-a9c0-2dd6d40f39b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:34.234611 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35073302-6aab-4dac-a9c0-2dd6d40f39b4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:34.235891 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35073302-6aab-4dac-a9c0-2dd6d40f39b4 None admin] RBAC: Adding query filter params (role.id=b46df176b0fe479da63c318db225bed4, scope.project.id=ccd34295bf7b435a96b37487c8e89fc3, user.id=0217add2f5e74a80a1a33b160cc57a2b) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:34.236628 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35073302-6aab-4dac-a9c0-2dd6d40f39b4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:34.239277 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35073302-6aab-4dac-a9c0-2dd6d40f39b4 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:34.249134 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 384/769] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Jul 11 14:27:33 2022] GET /identity/v3/role_assignments?user.id=0217add2f5e74a80a1a33b160cc57a2b&scope.project.id=ccd34295bf7b435a96b37487c8e89fc3&role.id=b46df176b0fe479da63c318db225bed4 => generated 259 bytes in 401 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:34.250521 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35073302-6aab-4dac-a9c0-2dd6d40f39b4 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:34.293992 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:34.456332 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5204f8c5-e977-4bfe-b12f-1177a342bf9d None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:34.493947 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67faa0e-9735-4be5-8bcc-1cd415dc7774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:34.494631 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67faa0e-9735-4be5-8bcc-1cd415dc7774 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:34.494910 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67faa0e-9735-4be5-8bcc-1cd415dc7774 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:34.495193 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67faa0e-9735-4be5-8bcc-1cd415dc7774 None admin] PATH_INFO: `/v3/services` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:34.496121 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67faa0e-9735-4be5-8bcc-1cd415dc7774 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:34.497433 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67faa0e-9735-4be5-8bcc-1cd415dc7774 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:34.504247 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 386/770] 10.222.0.70 () {56 vars in 1087 bytes} [Mon Jul 11 14:27:34 2022] GET /identity/v3/services => generated 772 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:34.544671 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35073302-6aab-4dac-a9c0-2dd6d40f39b4 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:34.638158 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7e671a-60ca-412b-bdd4-d3ac536d492b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:34.639857 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7e671a-60ca-412b-bdd4-d3ac536d492b None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:34.640746 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7e671a-60ca-412b-bdd4-d3ac536d492b None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:34.641553 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7e671a-60ca-412b-bdd4-d3ac536d492b None admin] PATH_INFO: `/v3/services` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:34.643808 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7e671a-60ca-412b-bdd4-d3ac536d492b None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:34.644752 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7e671a-60ca-412b-bdd4-d3ac536d492b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:34.647772 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7e671a-60ca-412b-bdd4-d3ac536d492b None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:34.659116 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 385/771] 10.222.0.70 () {56 vars in 1124 bytes} [Mon Jul 11 14:27:34 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 409 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:34.664533 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67faa0e-9735-4be5-8bcc-1cd415dc7774 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:34.735034 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:34.809932 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852ef028-3c90-4531-b966-19c06d96d395 None None] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:34.810929 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852ef028-3c90-4531-b966-19c06d96d395 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:34.811861 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852ef028-3c90-4531-b966-19c06d96d395 None None] PATH_INFO: `/` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:34.817280 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 386/772] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:27:34 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:27:34.824904 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b50299f-031f-464b-834d-42567dccc8fb None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:34.825902 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b50299f-031f-464b-834d-42567dccc8fb None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:34.826258 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b50299f-031f-464b-834d-42567dccc8fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:34.844185 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67faa0e-9735-4be5-8bcc-1cd415dc7774 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:34.859788 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-4b50299f-031f-464b-834d-42567dccc8fb None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:27:34.861099 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-4b50299f-031f-464b-834d-42567dccc8fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:27:34.933487 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4605f3-46dd-4daa-a182-31a009923027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:34.935171 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4605f3-46dd-4daa-a182-31a009923027 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:34.935989 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4605f3-46dd-4daa-a182-31a009923027 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:34.936834 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4605f3-46dd-4daa-a182-31a009923027 None admin] PATH_INFO: `/v3/services` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:34.938610 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4605f3-46dd-4daa-a182-31a009923027 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:34.940023 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4605f3-46dd-4daa-a182-31a009923027 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:34.943151 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4605f3-46dd-4daa-a182-31a009923027 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:34.956752 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 387/773] 10.222.0.70 () {56 vars in 1124 bytes} [Mon Jul 11 14:27:34 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:34.965413 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4605f3-46dd-4daa-a182-31a009923027 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:34.975982 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 387/774] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:27:34 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:27:35.059132 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b50299f-031f-464b-834d-42567dccc8fb None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:35.096190 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:35.148257 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4605f3-46dd-4daa-a182-31a009923027 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:35.156879 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:35.185968 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243dd33a-b265-493b-bd02-b6794956a3fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:35.186674 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243dd33a-b265-493b-bd02-b6794956a3fd None admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:35.186931 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243dd33a-b265-493b-bd02-b6794956a3fd None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:35.187209 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243dd33a-b265-493b-bd02-b6794956a3fd None admin] PATH_INFO: `/v3/endpoints` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:35.188056 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243dd33a-b265-493b-bd02-b6794956a3fd None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:35.190193 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243dd33a-b265-493b-bd02-b6794956a3fd None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:35.215510 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 388/775] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Jul 11 14:27:34 2022] POST /identity/v3/endpoints => generated 346 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:27:35.216967 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21de2919-ce75-45c8-b137-f382b318debd None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:35.217427 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21de2919-ce75-45c8-b137-f382b318debd None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:35.217942 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21de2919-ce75-45c8-b137-f382b318debd None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:35.224786 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 389/776] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:27:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:27:35.227038 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dd2a51-a670-4e73-bcad-0ad7710c27a2 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:35.227512 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dd2a51-a670-4e73-bcad-0ad7710c27a2 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:35.228057 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dd2a51-a670-4e73-bcad-0ad7710c27a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:35.248521 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-80dd2a51-a670-4e73-bcad-0ad7710c27a2 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:27:35.250063 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-80dd2a51-a670-4e73-bcad-0ad7710c27a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:27:35.254741 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b50299f-031f-464b-834d-42567dccc8fb None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:35.304073 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f03c947-9d7c-44e9-a421-5156b6160bbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:35.305263 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f03c947-9d7c-44e9-a421-5156b6160bbe None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:35.305691 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f03c947-9d7c-44e9-a421-5156b6160bbe None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:35.306107 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f03c947-9d7c-44e9-a421-5156b6160bbe None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:35.319805 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f03c947-9d7c-44e9-a421-5156b6160bbe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:27:35.328257 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application [None req-9f03c947-9d7c-44e9-a421-5156b6160bbe None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:27:35.328257 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:35.328257 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:35.328257 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:35.328257 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:35.328257 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:35.328257 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:35.328257 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:35.328257 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:35.328257 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:35.328257 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:35.328257 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:35.328257 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:27:35.328257 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:27:35.328257 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:27:35.328257 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:27:35.329370 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:27:35.329370 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:27:35.329370 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:27:35.329370 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:27:35.329370 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:35.329370 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:35.329370 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:35.329370 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:35.329370 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:35.329370 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:35.329370 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:35.329370 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:35.329370 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:35.329370 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:35.329370 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:35.329370 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:35.331107 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:35.331107 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:35.331107 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:35.331107 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:35.331107 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:27:35.331107 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:27:35.331107 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:27:35.331107 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:27:35.331107 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:27:35.331107 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:27:35.331107 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:27:35.331107 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Jul 11 14:27:35.333736 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 388/777] 10.222.0.70 () {56 vars in 1096 bytes} [Mon Jul 11 14:27:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:27:35.338034 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 390/778] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:27:35 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 14:27:35.348842 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f03c947-9d7c-44e9-a421-5156b6160bbe None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:35.364154 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dd2a51-a670-4e73-bcad-0ad7710c27a2 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:35.479653 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:35.543633 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:35.585910 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dd2a51-a670-4e73-bcad-0ad7710c27a2 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:35.609414 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f03c947-9d7c-44e9-a421-5156b6160bbe None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:35.670963 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4a451f-93aa-4a25-b413-c4ef35722219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:35.673590 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4a451f-93aa-4a25-b413-c4ef35722219 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:35.673590 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4a451f-93aa-4a25-b413-c4ef35722219 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:35.674832 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4a451f-93aa-4a25-b413-c4ef35722219 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:35.686214 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85414dfd-a70d-481e-8ca6-fac66bc554c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:35.687685 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85414dfd-a70d-481e-8ca6-fac66bc554c1 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:35.688427 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85414dfd-a70d-481e-8ca6-fac66bc554c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:35.689735 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85414dfd-a70d-481e-8ca6-fac66bc554c1 None admin] PATH_INFO: `/v3/roles` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:35.691642 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85414dfd-a70d-481e-8ca6-fac66bc554c1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:35.692480 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85414dfd-a70d-481e-8ca6-fac66bc554c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:35.695558 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85414dfd-a70d-481e-8ca6-fac66bc554c1 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:35.698662 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4a451f-93aa-4a25-b413-c4ef35722219 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:27:35.712876 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 389/779] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Jul 11 14:27:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:27:35.717535 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-6d4a451f-93aa-4a25-b413-c4ef35722219 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:27:35.717535 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:35.717535 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:35.717535 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:35.717535 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:35.717535 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:35.717535 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:35.717535 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:35.717535 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:35.717535 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:35.717535 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:35.717535 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:35.717535 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:27:35.717535 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:27:35.717535 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:27:35.717535 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:27:35.719601 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:27:35.719601 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:27:35.719601 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:27:35.719601 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:27:35.719601 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:35.719601 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:35.719601 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:35.719601 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:35.719601 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:35.719601 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:35.719601 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:35.719601 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:35.719601 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:35.719601 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:35.719601 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:35.719601 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:35.721891 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:35.721891 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:35.721891 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:35.721891 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:35.721891 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:27:35.721891 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:27:35.721891 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:27:35.721891 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:27:35.721891 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:27:35.721891 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:27:35.721891 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:27:35.721891 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Jul 11 14:27:35.724673 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 391/780] 10.222.0.70 () {56 vars in 1102 bytes} [Mon Jul 11 14:27:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 361 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:27:35.725674 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85414dfd-a70d-481e-8ca6-fac66bc554c1 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:35.730725 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4a451f-93aa-4a25-b413-c4ef35722219 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:35.959070 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85414dfd-a70d-481e-8ca6-fac66bc554c1 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:35.969769 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4a451f-93aa-4a25-b413-c4ef35722219 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:36.023637 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:36.043347 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2a3717-37d6-4d7d-9e85-1853e4b0f78c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:36.045037 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2a3717-37d6-4d7d-9e85-1853e4b0f78c None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:36.045750 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2a3717-37d6-4d7d-9e85-1853e4b0f78c None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:36.046470 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2a3717-37d6-4d7d-9e85-1853e4b0f78c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:36.066520 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccec477-36f1-4edf-9fa4-4c0b4ed2da37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:36.068109 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccec477-36f1-4edf-9fa4-4c0b4ed2da37 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:36.068943 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccec477-36f1-4edf-9fa4-4c0b4ed2da37 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:36.069683 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccec477-36f1-4edf-9fa4-4c0b4ed2da37 None admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:36.071319 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccec477-36f1-4edf-9fa4-4c0b4ed2da37 None admin] RBAC: Adding query filter params (name=service) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:36.071828 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccec477-36f1-4edf-9fa4-4c0b4ed2da37 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:36.074772 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccec477-36f1-4edf-9fa4-4c0b4ed2da37 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:36.084995 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2a3717-37d6-4d7d-9e85-1853e4b0f78c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:36.089931 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2a3717-37d6-4d7d-9e85-1853e4b0f78c None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:36.116245 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 392/781] 10.222.0.70 () {56 vars in 1103 bytes} [Mon Jul 11 14:27:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 382 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:27:36.118089 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccec477-36f1-4edf-9fa4-4c0b4ed2da37 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:36.138674 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application [None req-ff2a3717-37d6-4d7d-9e85-1853e4b0f78c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:27:36.138674 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:36.138674 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:36.138674 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:36.138674 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:36.138674 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:36.138674 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:36.138674 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:36.138674 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:36.138674 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:36.138674 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:36.138674 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:36.138674 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:27:36.138674 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:27:36.138674 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:27:36.140648 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:27:36.140648 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:36.140648 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:36.140648 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:36.140648 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:36.140648 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:36.140648 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:36.140648 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:36.140648 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:36.140648 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:36.140648 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:36.140648 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:36.140648 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:36.140648 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:36.140648 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:36.140648 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:36.140648 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:36.143255 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:27:36.143255 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:27:36.143255 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:27:36.143255 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Jul 11 14:27:36.146172 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 390/782] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 11 14:27:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 422 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:27:36.153952 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:36.155257 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2a3717-37d6-4d7d-9e85-1853e4b0f78c None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:36.394259 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccec477-36f1-4edf-9fa4-4c0b4ed2da37 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:36.452616 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2a3717-37d6-4d7d-9e85-1853e4b0f78c None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:36.490381 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b00961-91cc-492d-aca0-c3b65ecd9b98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:36.491775 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b00961-91cc-492d-aca0-c3b65ecd9b98 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:36.492301 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b00961-91cc-492d-aca0-c3b65ecd9b98 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:36.492794 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b00961-91cc-492d-aca0-c3b65ecd9b98 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:36.527608 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8f841f-7d6a-4c4a-ab16-844376ca3c5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:36.529473 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8f841f-7d6a-4c4a-ab16-844376ca3c5a None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:36.531876 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8f841f-7d6a-4c4a-ab16-844376ca3c5a None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:36.532947 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8f841f-7d6a-4c4a-ab16-844376ca3c5a None admin] PATH_INFO: `/v3/domains` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:36.534529 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b00961-91cc-492d-aca0-c3b65ecd9b98 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:36.536258 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8f841f-7d6a-4c4a-ab16-844376ca3c5a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:36.539257 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b00961-91cc-492d-aca0-c3b65ecd9b98 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:36.540109 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8f841f-7d6a-4c4a-ab16-844376ca3c5a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:36.542942 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8f841f-7d6a-4c4a-ab16-844376ca3c5a None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:36.586950 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 391/783] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jul 11 14:27:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 433 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:36.595980 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8f841f-7d6a-4c4a-ab16-844376ca3c5a None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:36.605078 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-39b00961-91cc-492d-aca0-c3b65ecd9b98 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:27:36.605078 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:36.605078 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:36.605078 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:36.605078 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:36.605078 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:36.605078 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:36.605078 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:36.605078 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:36.605078 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:36.605078 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:36.605078 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:36.605078 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:27:36.605078 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:27:36.605078 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:27:36.607052 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:27:36.607052 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:36.607052 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:36.607052 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:36.607052 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:36.607052 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:36.607052 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:36.607052 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:36.607052 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:36.607052 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:36.607052 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:36.607052 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:36.607052 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:36.607052 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:36.607052 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:36.607052 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:36.607052 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:36.609027 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:27:36.609027 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:27:36.609027 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:27:36.609027 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Jul 11 14:27:36.609027 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 393/784] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 11 14:27:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 490 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:27:36.614360 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b00961-91cc-492d-aca0-c3b65ecd9b98 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:36.724596 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:36.773767 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:36.879156 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b00961-91cc-492d-aca0-c3b65ecd9b98 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:36.882636 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8f841f-7d6a-4c4a-ab16-844376ca3c5a None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:36.954428 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc82b11a-6caf-473a-a2d4-eb6ebda6b9a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:36.955643 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc82b11a-6caf-473a-a2d4-eb6ebda6b9a1 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:36.955933 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc82b11a-6caf-473a-a2d4-eb6ebda6b9a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:36.956232 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc82b11a-6caf-473a-a2d4-eb6ebda6b9a1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:36.979462 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc82b11a-6caf-473a-a2d4-eb6ebda6b9a1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:36.980900 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc82b11a-6caf-473a-a2d4-eb6ebda6b9a1 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:36.995841 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bae2fe-0c57-43ba-8257-054b0be79862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:36.996556 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bae2fe-0c57-43ba-8257-054b0be79862 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:36.996829 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bae2fe-0c57-43ba-8257-054b0be79862 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:36.997099 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bae2fe-0c57-43ba-8257-054b0be79862 None admin] PATH_INFO: `/v3/domains` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:36.997838 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bae2fe-0c57-43ba-8257-054b0be79862 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:36.998149 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bae2fe-0c57-43ba-8257-054b0be79862 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:36.999552 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bae2fe-0c57-43ba-8257-054b0be79862 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:37.012780 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application [None req-cc82b11a-6caf-473a-a2d4-eb6ebda6b9a1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 11 14:27:37.012780 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:37.012780 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:37.012780 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:37.012780 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:37.012780 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:37.012780 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:37.012780 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:37.012780 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:37.012780 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:37.012780 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:37.012780 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:37.012780 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 14:27:37.012780 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 14:27:37.012780 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 14:27:37.012780 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 14:27:37.013791 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:37.013791 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:37.013791 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 14:27:37.013791 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:27:37.013791 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 14:27:37.013791 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:27:37.013791 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:37.013791 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:37.013791 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:37.013791 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:37.013791 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:37.013791 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:37.013791 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:37.013791 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:37.013791 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:37.013791 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:37.013791 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:37.013791 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:37.015305 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:37.015305 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:37.015305 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 14:27:37.015305 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 14:27:37.015305 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 14:27:37.015305 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 14:27:37.015305 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 14:27:37.015305 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 14:27:37.015305 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 11 14:27:37.015305 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Jul 11 14:27:37.015831 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 394/785] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jul 11 14:27:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 401 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:27:37.018125 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 392/786] 10.222.0.70 () {56 vars in 1093 bytes} [Mon Jul 11 14:27:36 2022] GET /identity/v3/users/nova => generated 82 bytes in 423 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:27:37.023626 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bae2fe-0c57-43ba-8257-054b0be79862 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:37.026193 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc82b11a-6caf-473a-a2d4-eb6ebda6b9a1 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:37.236452 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bae2fe-0c57-43ba-8257-054b0be79862 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:37.237701 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc82b11a-6caf-473a-a2d4-eb6ebda6b9a1 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:37.239969 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:37.298988 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18394875-c453-4ec4-9d04-8b7f47072e9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:37.300073 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18394875-c453-4ec4-9d04-8b7f47072e9a None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:37.300390 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18394875-c453-4ec4-9d04-8b7f47072e9a None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:37.300842 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18394875-c453-4ec4-9d04-8b7f47072e9a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:37.301123 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:37.313074 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18394875-c453-4ec4-9d04-8b7f47072e9a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:37.314974 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18394875-c453-4ec4-9d04-8b7f47072e9a None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:37.323479 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c357480-b2dd-4a9d-862b-97459133dc7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:37.324495 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c357480-b2dd-4a9d-862b-97459133dc7c None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:37.325097 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c357480-b2dd-4a9d-862b-97459133dc7c None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:37.325730 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c357480-b2dd-4a9d-862b-97459133dc7c None admin] PATH_INFO: `/v3/users` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:37.327506 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c357480-b2dd-4a9d-862b-97459133dc7c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:37.328260 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c357480-b2dd-4a9d-862b-97459133dc7c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:37.331463 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c357480-b2dd-4a9d-862b-97459133dc7c None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:37.342665 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application [None req-18394875-c453-4ec4-9d04-8b7f47072e9a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 11 14:27:37.342665 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:37.342665 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:37.342665 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:37.342665 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:37.342665 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:37.342665 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:37.342665 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:37.342665 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:37.342665 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:37.342665 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:37.342665 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:37.342665 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 14:27:37.342665 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 14:27:37.342665 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 14:27:37.342665 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 14:27:37.344380 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:37.344380 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:37.344380 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 14:27:37.344380 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:27:37.344380 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 14:27:37.344380 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:27:37.344380 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:37.344380 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:37.344380 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:37.344380 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:37.344380 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:37.344380 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:37.344380 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:37.344380 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:37.344380 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:37.344380 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:37.344380 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:37.344380 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:37.345816 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:37.345816 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:37.345816 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 14:27:37.345816 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 14:27:37.345816 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 14:27:37.345816 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 14:27:37.345816 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 14:27:37.345816 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 14:27:37.345816 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 11 14:27:37.345816 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Jul 11 14:27:37.352837 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 393/787] 10.222.0.70 () {56 vars in 1117 bytes} [Mon Jul 11 14:27:37 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:27:37.355348 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fee03c-9854-48fb-af87-9c16c9f3bd91 None None] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:37.355862 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fee03c-9854-48fb-af87-9c16c9f3bd91 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:37.356382 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fee03c-9854-48fb-af87-9c16c9f3bd91 None None] PATH_INFO: `/` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:37.359261 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 394/788] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:27:37 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:27:37.366292 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fee03c-9854-48fb-af87-9c16c9f3bd91 None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:37.372852 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 395/789] 10.222.0.70 () {56 vars in 1133 bytes} [Mon Jul 11 14:27:37 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:37.378392 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef98778-c8b4-4645-b29e-cbd78a679063 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:37.379190 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef98778-c8b4-4645-b29e-cbd78a679063 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:37.379730 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef98778-c8b4-4645-b29e-cbd78a679063 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:37.418878 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-eef98778-c8b4-4645-b29e-cbd78a679063 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:27:37.420617 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-eef98778-c8b4-4645-b29e-cbd78a679063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:27:37.519933 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 396/790] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:27:37 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:27:37.521274 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef98778-c8b4-4645-b29e-cbd78a679063 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:37.534939 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fee03c-9854-48fb-af87-9c16c9f3bd91 None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:37.586441 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ab88aa-b7a3-4065-8a1e-5fd82c5effa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:37.587452 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ab88aa-b7a3-4065-8a1e-5fd82c5effa5 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:37.587879 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ab88aa-b7a3-4065-8a1e-5fd82c5effa5 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:37.588327 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ab88aa-b7a3-4065-8a1e-5fd82c5effa5 None admin] PATH_INFO: `/v3/users` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:37.589436 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ab88aa-b7a3-4065-8a1e-5fd82c5effa5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:37.589893 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ab88aa-b7a3-4065-8a1e-5fd82c5effa5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:37.591585 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ab88aa-b7a3-4065-8a1e-5fd82c5effa5 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:37.612664 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 395/791] 10.222.0.70 () {56 vars in 1149 bytes} [Mon Jul 11 14:27:37 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:37.613864 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ab88aa-b7a3-4065-8a1e-5fd82c5effa5 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:37.640189 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:37.656990 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef98778-c8b4-4645-b29e-cbd78a679063 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:37.675606 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:37.702257 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4311658-c968-4bd5-b7e5-6687f41061f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:37.703461 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4311658-c968-4bd5-b7e5-6687f41061f8 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:37.704011 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4311658-c968-4bd5-b7e5-6687f41061f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:37.704574 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4311658-c968-4bd5-b7e5-6687f41061f8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:37.717019 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4311658-c968-4bd5-b7e5-6687f41061f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:37.718853 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4311658-c968-4bd5-b7e5-6687f41061f8 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:37.731516 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ab88aa-b7a3-4065-8a1e-5fd82c5effa5 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:37.740697 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-a4311658-c968-4bd5-b7e5-6687f41061f8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:27:37.740697 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:37.740697 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:37.740697 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:37.740697 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:37.740697 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:37.740697 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:37.740697 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:37.740697 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:37.740697 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:37.740697 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:37.740697 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:37.740697 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:27:37.740697 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:27:37.740697 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:27:37.741853 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:27:37.741853 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:37.741853 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:37.741853 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:37.741853 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:37.741853 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:37.741853 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:37.741853 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:37.741853 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:37.741853 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:37.741853 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:37.741853 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:37.741853 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:37.741853 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:37.741853 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:37.741853 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:37.741853 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:37.742888 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:27:37.742888 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:27:37.742888 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:27:37.742888 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Jul 11 14:27:37.749594 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 397/792] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 11 14:27:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:27:37.750752 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4311658-c968-4bd5-b7e5-6687f41061f8 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:37.771607 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b9c220-a640-4944-8b04-52d6f2793c66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:37.772359 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b9c220-a640-4944-8b04-52d6f2793c66 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:37.772643 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b9c220-a640-4944-8b04-52d6f2793c66 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:37.772913 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b9c220-a640-4944-8b04-52d6f2793c66 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:37.785976 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b9c220-a640-4944-8b04-52d6f2793c66 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:27:37.794514 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application [None req-a6b9c220-a640-4944-8b04-52d6f2793c66 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:27:37.794514 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:37.794514 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:37.794514 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:37.794514 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:37.794514 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:37.794514 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:37.794514 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:37.794514 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:37.794514 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:37.794514 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:37.794514 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:37.794514 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:27:37.794514 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:27:37.794514 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:27:37.794514 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:27:37.795691 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:27:37.795691 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:27:37.795691 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:27:37.795691 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:27:37.795691 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:37.795691 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:37.795691 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:37.795691 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:37.795691 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:37.795691 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:37.795691 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:37.795691 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:37.795691 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:37.795691 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:37.795691 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:37.795691 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:37.796666 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:37.796666 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:37.796666 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:37.796666 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:37.796666 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:27:37.796666 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:27:37.796666 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:27:37.796666 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:27:37.796666 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:27:37.796666 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:27:37.796666 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:27:37.796666 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Jul 11 14:27:37.799342 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 396/793] 10.222.0.70 () {56 vars in 1096 bytes} [Mon Jul 11 14:27:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:27:37.800479 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b9c220-a640-4944-8b04-52d6f2793c66 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:37.885914 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4311658-c968-4bd5-b7e5-6687f41061f8 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:37.903657 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:37.927504 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5bd816-c433-4168-a59e-38bc7dc827c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:37.928597 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5bd816-c433-4168-a59e-38bc7dc827c9 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:37.929023 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5bd816-c433-4168-a59e-38bc7dc827c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:37.929440 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5bd816-c433-4168-a59e-38bc7dc827c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:37.929579 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b9c220-a640-4944-8b04-52d6f2793c66 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:37.943269 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5bd816-c433-4168-a59e-38bc7dc827c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:37.945372 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5bd816-c433-4168-a59e-38bc7dc827c9 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:37.964664 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-4a5bd816-c433-4168-a59e-38bc7dc827c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:27:37.964664 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:37.964664 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:37.964664 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:37.964664 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:37.964664 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:37.964664 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:37.964664 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:37.964664 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:37.964664 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:37.964664 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:37.964664 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:37.964664 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:27:37.964664 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:27:37.964664 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:27:37.965736 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:27:37.965736 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:37.965736 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:37.965736 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:37.965736 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:37.965736 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:37.965736 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:37.965736 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:37.965736 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:37.965736 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:37.965736 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:37.965736 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:37.965736 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:37.965736 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:37.965736 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:37.965736 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:37.965736 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:37.966794 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:27:37.966794 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:27:37.966794 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:27:37.966794 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Jul 11 14:27:37.973333 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52e322e-9bca-4c6f-b972-40736f40d305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:37.973333 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52e322e-9bca-4c6f-b972-40736f40d305 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:37.973333 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52e322e-9bca-4c6f-b972-40736f40d305 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:37.973333 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52e322e-9bca-4c6f-b972-40736f40d305 None admin] PATH_INFO: `/v3/domains` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:37.973703 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52e322e-9bca-4c6f-b972-40736f40d305 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:37.973703 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52e322e-9bca-4c6f-b972-40736f40d305 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:37.974329 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 398/794] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 11 14:27:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:27:37.974825 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52e322e-9bca-4c6f-b972-40736f40d305 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:37.975289 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5bd816-c433-4168-a59e-38bc7dc827c9 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:37.988823 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 397/795] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jul 11 14:27:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:37.990031 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca233c65-1540-4ac2-ac5c-11ab56af7a3c None None] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:37.990320 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca233c65-1540-4ac2-ac5c-11ab56af7a3c None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:37.990596 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca233c65-1540-4ac2-ac5c-11ab56af7a3c None None] PATH_INFO: `/` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:37.995788 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 398/796] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:27:37 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:27:37.997285 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea029fe4-bf20-445f-a31f-362f88300064 None None] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:37.997583 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea029fe4-bf20-445f-a31f-362f88300064 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:37.997867 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea029fe4-bf20-445f-a31f-362f88300064 None None] PATH_INFO: `/` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:37.999197 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 399/797] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:27:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:27:37.999923 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea029fe4-bf20-445f-a31f-362f88300064 None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:38.000446 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:38.117294 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5bd816-c433-4168-a59e-38bc7dc827c9 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:38.144482 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea029fe4-bf20-445f-a31f-362f88300064 None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:38.169556 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20547e6-cb31-480b-a5b3-f5620100bc43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:38.170236 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20547e6-cb31-480b-a5b3-f5620100bc43 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:38.170520 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20547e6-cb31-480b-a5b3-f5620100bc43 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:38.170813 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20547e6-cb31-480b-a5b3-f5620100bc43 None admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:38.171571 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20547e6-cb31-480b-a5b3-f5620100bc43 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:38.171876 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20547e6-cb31-480b-a5b3-f5620100bc43 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:38.173879 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20547e6-cb31-480b-a5b3-f5620100bc43 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:38.183388 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 399/798] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Jul 11 14:27:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:38.184297 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20547e6-cb31-480b-a5b3-f5620100bc43 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:38.196954 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38649172-5551-41e3-840b-943f52f5901b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:38.197647 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38649172-5551-41e3-840b-943f52f5901b None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:38.197930 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38649172-5551-41e3-840b-943f52f5901b None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:38.198208 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38649172-5551-41e3-840b-943f52f5901b None admin] PATH_INFO: `/v3/domains` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:38.198973 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38649172-5551-41e3-840b-943f52f5901b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:38.199284 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38649172-5551-41e3-840b-943f52f5901b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:38.200763 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38649172-5551-41e3-840b-943f52f5901b None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:38.211785 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:38.217900 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 400/799] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jul 11 14:27:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:38.219862 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2172479e-b4c4-477f-b5ed-a5392c097216 None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:38.220298 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2172479e-b4c4-477f-b5ed-a5392c097216 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:38.220616 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2172479e-b4c4-477f-b5ed-a5392c097216 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:38.242319 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-2172479e-b4c4-477f-b5ed-a5392c097216 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:27:38.243557 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-2172479e-b4c4-477f-b5ed-a5392c097216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:27:38.283298 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:38.310138 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20547e6-cb31-480b-a5b3-f5620100bc43 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:38.319494 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 401/800] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:27:38 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:27:38.320939 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f9c070-fc71-4efb-8a17-74463f2cf796 None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:38.321234 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f9c070-fc71-4efb-8a17-74463f2cf796 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:38.321512 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f9c070-fc71-4efb-8a17-74463f2cf796 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:38.339457 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-24f9c070-fc71-4efb-8a17-74463f2cf796 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:27:38.340818 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-24f9c070-fc71-4efb-8a17-74463f2cf796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:27:38.368991 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98b2c11-6616-4e2f-908a-4da9208bec93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:38.370330 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98b2c11-6616-4e2f-908a-4da9208bec93 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:38.370838 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98b2c11-6616-4e2f-908a-4da9208bec93 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:38.371231 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98b2c11-6616-4e2f-908a-4da9208bec93 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:38.383987 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98b2c11-6616-4e2f-908a-4da9208bec93 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:38.386608 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98b2c11-6616-4e2f-908a-4da9208bec93 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:38.415146 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-c98b2c11-6616-4e2f-908a-4da9208bec93 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:27:38.415146 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:38.415146 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:38.415146 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:38.415146 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:38.415146 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:38.415146 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:38.415146 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:38.415146 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:38.415146 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:38.415146 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:38.415146 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:38.415146 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 14:27:38.415146 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 14:27:38.415146 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 14:27:38.416416 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 14:27:38.416416 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:38.416416 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:38.416416 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:38.416416 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:38.416416 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:38.416416 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:38.416416 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:38.416416 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:38.416416 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:38.416416 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:38.416416 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:38.416416 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:38.416416 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:38.416416 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:38.416416 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:38.416416 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:38.417531 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 14:27:38.417531 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 14:27:38.417531 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 14:27:38.417531 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 14:27:38.417531 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 14:27:38.417531 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 14:27:38.417531 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:27:38.417531 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Jul 11 14:27:38.417531 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 400/801] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Jul 11 14:27:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:27:38.418464 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98b2c11-6616-4e2f-908a-4da9208bec93 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:38.427566 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 402/802] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:27:38 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:27:38.428898 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f9c070-fc71-4efb-8a17-74463f2cf796 None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:38.514355 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:38.561540 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98b2c11-6616-4e2f-908a-4da9208bec93 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:38.582180 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f9c070-fc71-4efb-8a17-74463f2cf796 None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:38.615716 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0af288f-1657-4333-a0c7-9a3b7a4334ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:38.616931 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0af288f-1657-4333-a0c7-9a3b7a4334ba None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:38.617219 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0af288f-1657-4333-a0c7-9a3b7a4334ba None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:38.617503 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0af288f-1657-4333-a0c7-9a3b7a4334ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:38.621291 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829c4d1b-f536-472b-a0b3-9c9342984cb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:38.622012 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829c4d1b-f536-472b-a0b3-9c9342984cb1 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:38.622297 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829c4d1b-f536-472b-a0b3-9c9342984cb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:38.622578 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829c4d1b-f536-472b-a0b3-9c9342984cb1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:38.624997 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:38.630027 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0af288f-1657-4333-a0c7-9a3b7a4334ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:38.631881 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0af288f-1657-4333-a0c7-9a3b7a4334ba None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:38.633666 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829c4d1b-f536-472b-a0b3-9c9342984cb1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:38.635337 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829c4d1b-f536-472b-a0b3-9c9342984cb1 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:38.650712 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application [None req-829c4d1b-f536-472b-a0b3-9c9342984cb1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:27:38.650712 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:38.650712 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:38.650712 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:38.650712 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:38.650712 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:38.650712 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:38.650712 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:38.650712 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:38.650712 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:38.650712 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:38.650712 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:38.650712 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 14:27:38.650712 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 14:27:38.650712 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 14:27:38.651734 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 14:27:38.651734 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:38.651734 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:38.651734 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:38.651734 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:38.651734 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:38.651734 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:38.651734 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:38.651734 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:38.651734 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:38.651734 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:38.651734 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:38.651734 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:38.651734 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:38.651734 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:38.651734 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:38.651734 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:38.660749 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 14:27:38.660749 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 14:27:38.660749 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 14:27:38.660749 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 14:27:38.660749 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 14:27:38.660749 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 14:27:38.660749 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:27:38.660749 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Jul 11 14:27:38.661645 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-b0af288f-1657-4333-a0c7-9a3b7a4334ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:27:38.661645 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:38.661645 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:38.661645 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:38.661645 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:38.661645 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:38.661645 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:38.661645 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:38.661645 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:38.661645 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:38.661645 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:38.661645 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:38.661645 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:27:38.661645 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:27:38.661645 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:27:38.663146 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:27:38.663146 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:38.663146 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:38.663146 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:38.663146 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:38.663146 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:38.663146 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:38.663146 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:38.663146 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:38.663146 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:38.663146 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:38.663146 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:38.663146 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:38.663146 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:38.663146 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:38.663146 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:38.663146 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:38.664801 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:27:38.664801 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:27:38.664801 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:27:38.664801 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Jul 11 14:27:38.665212 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 403/803] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Jul 11 14:27:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:27:38.665212 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829c4d1b-f536-472b-a0b3-9c9342984cb1 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:38.665440 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 401/804] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 11 14:27:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:27:38.665440 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0af288f-1657-4333-a0c7-9a3b7a4334ba None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:38.777551 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829c4d1b-f536-472b-a0b3-9c9342984cb1 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:38.795274 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0af288f-1657-4333-a0c7-9a3b7a4334ba None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:38.804070 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:38.823315 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0915895e-bf55-4937-b84f-3150516965fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:38.824001 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0915895e-bf55-4937-b84f-3150516965fe None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:38.824332 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0915895e-bf55-4937-b84f-3150516965fe None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:38.824585 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0915895e-bf55-4937-b84f-3150516965fe None admin] PATH_INFO: `/v3/services/network` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:38.825263 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0915895e-bf55-4937-b84f-3150516965fe None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:38.826645 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0915895e-bf55-4937-b84f-3150516965fe None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:38.839261 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bc3950-273b-4554-a7dd-cdaefe7aa15f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:38.839919 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bc3950-273b-4554-a7dd-cdaefe7aa15f None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:38.840103 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application [None req-0915895e-bf55-4937-b84f-3150516965fe None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 11 14:27:38.840103 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:38.840103 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 14:27:38.840103 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 14:27:38.840103 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 14:27:38.840103 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 14:27:38.840103 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 14:27:38.840103 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:27:38.840103 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 11 14:27:38.840103 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Jul 11 14:27:38.840103 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 14:27:38.840103 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Jul 11 14:27:38.840103 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:38.840103 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:38.840103 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:38.840103 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:38.840103 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:38.841573 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:38.841573 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:38.841573 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:38.841573 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:38.841573 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:38.841573 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:38.841573 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 14:27:38.841573 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 14:27:38.841573 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 14:27:38.841573 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 14:27:38.841573 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:38.841573 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:38.841573 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:38.841573 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:38.841573 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:38.841573 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:38.842729 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:38.842729 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:38.842729 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:38.842729 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:38.842729 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:38.842729 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:38.842729 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:38.842729 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:38.842729 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:38.842729 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:38.842729 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 14:27:38.842729 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:27:38.842729 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 11 14:27:38.842729 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Jul 11 14:27:38.843593 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bc3950-273b-4554-a7dd-cdaefe7aa15f None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:38.843593 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bc3950-273b-4554-a7dd-cdaefe7aa15f None admin] PATH_INFO: `/v3/projects` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:38.843783 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 404/805] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Jul 11 14:27:38 2022] GET /identity/v3/services/network => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:27:38.843893 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bc3950-273b-4554-a7dd-cdaefe7aa15f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:38.843893 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bc3950-273b-4554-a7dd-cdaefe7aa15f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:38.844132 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0915895e-bf55-4937-b84f-3150516965fe None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:38.845154 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bc3950-273b-4554-a7dd-cdaefe7aa15f None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:38.864273 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 402/806] 10.222.0.70 () {56 vars in 1148 bytes} [Mon Jul 11 14:27:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:38.864273 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bc3950-273b-4554-a7dd-cdaefe7aa15f None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:38.928253 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:38.970819 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0915895e-bf55-4937-b84f-3150516965fe None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:38.988066 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bc3950-273b-4554-a7dd-cdaefe7aa15f None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:39.007896 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52115a14-1421-4323-9c19-296dbf5060a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:39.008718 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52115a14-1421-4323-9c19-296dbf5060a0 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:39.008995 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52115a14-1421-4323-9c19-296dbf5060a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:39.009266 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52115a14-1421-4323-9c19-296dbf5060a0 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:39.009916 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52115a14-1421-4323-9c19-296dbf5060a0 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:39.011286 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52115a14-1421-4323-9c19-296dbf5060a0 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:39.024217 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application [None req-52115a14-1421-4323-9c19-296dbf5060a0 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 11 14:27:39.024217 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:39.024217 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 14:27:39.024217 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 14:27:39.024217 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 14:27:39.024217 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 14:27:39.024217 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 14:27:39.024217 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:27:39.024217 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 11 14:27:39.024217 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Jul 11 14:27:39.024217 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 14:27:39.024217 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Jul 11 14:27:39.024217 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:39.024217 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:39.024217 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:39.024217 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:39.024217 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:39.025541 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:39.025541 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:39.025541 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:39.025541 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:39.025541 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:39.025541 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:39.025541 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 14:27:39.025541 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 14:27:39.025541 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 14:27:39.025541 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 14:27:39.025541 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:39.025541 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:39.025541 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:39.025541 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:39.025541 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:39.025541 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:39.027489 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:39.027489 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:39.027489 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:39.027489 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:39.027489 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:39.027489 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:39.027489 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:39.027489 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:39.027489 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:39.027489 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:39.027489 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 14:27:39.027489 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:27:39.027489 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 11 14:27:39.027489 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Jul 11 14:27:39.027489 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 405/807] 10.222.0.70 () {56 vars in 1114 bytes} [Mon Jul 11 14:27:38 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:27:39.029249 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52115a14-1421-4323-9c19-296dbf5060a0 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:39.031997 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12721d1-ec1c-47ef-af73-ab8dc37e19a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:39.032934 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12721d1-ec1c-47ef-af73-ab8dc37e19a8 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:39.033355 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12721d1-ec1c-47ef-af73-ab8dc37e19a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:39.033507 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12721d1-ec1c-47ef-af73-ab8dc37e19a8 None admin] PATH_INFO: `/v3/projects` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:39.034274 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12721d1-ec1c-47ef-af73-ab8dc37e19a8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:39.034586 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12721d1-ec1c-47ef-af73-ab8dc37e19a8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:39.036043 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12721d1-ec1c-47ef-af73-ab8dc37e19a8 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:39.049871 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 403/808] 10.222.0.70 () {56 vars in 1148 bytes} [Mon Jul 11 14:27:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:39.050719 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12721d1-ec1c-47ef-af73-ab8dc37e19a8 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:39.093289 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:39.152100 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52115a14-1421-4323-9c19-296dbf5060a0 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:39.165606 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12721d1-ec1c-47ef-af73-ab8dc37e19a8 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:39.177240 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:39.202992 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1af8d3-749f-4f5e-83ad-74f02238a347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:39.203452 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1af8d3-749f-4f5e-83ad-74f02238a347 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:39.203828 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1af8d3-749f-4f5e-83ad-74f02238a347 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:39.204165 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1af8d3-749f-4f5e-83ad-74f02238a347 None admin] PATH_INFO: `/v3/domains` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:39.204964 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1af8d3-749f-4f5e-83ad-74f02238a347 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:39.205321 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1af8d3-749f-4f5e-83ad-74f02238a347 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:39.206727 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1af8d3-749f-4f5e-83ad-74f02238a347 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:39.210106 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a12b3e-ff99-4e6c-b2ac-2e71ec725b23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:39.210801 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a12b3e-ff99-4e6c-b2ac-2e71ec725b23 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:39.211087 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a12b3e-ff99-4e6c-b2ac-2e71ec725b23 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:39.211390 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a12b3e-ff99-4e6c-b2ac-2e71ec725b23 None admin] PATH_INFO: `/v3/services` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:39.212103 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a12b3e-ff99-4e6c-b2ac-2e71ec725b23 None admin] RBAC: Adding query filter params (name=network) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:39.212452 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a12b3e-ff99-4e6c-b2ac-2e71ec725b23 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:39.213892 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a12b3e-ff99-4e6c-b2ac-2e71ec725b23 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:39.222465 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 406/809] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jul 11 14:27:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:39.228412 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 404/810] 10.222.0.70 () {56 vars in 1112 bytes} [Mon Jul 11 14:27:39 2022] GET /identity/v3/services?name=network => generated 124 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:39.228700 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1af8d3-749f-4f5e-83ad-74f02238a347 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:39.228808 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a12b3e-ff99-4e6c-b2ac-2e71ec725b23 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:39.361074 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a12b3e-ff99-4e6c-b2ac-2e71ec725b23 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:39.375519 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1af8d3-749f-4f5e-83ad-74f02238a347 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:39.388042 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:39.400604 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63caa3a-6e4e-4833-8b93-acc7b2962084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:39.401282 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63caa3a-6e4e-4833-8b93-acc7b2962084 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:39.401567 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63caa3a-6e4e-4833-8b93-acc7b2962084 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:39.401846 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63caa3a-6e4e-4833-8b93-acc7b2962084 None admin] PATH_INFO: `/v3/services` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:39.402560 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63caa3a-6e4e-4833-8b93-acc7b2962084 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:39.402870 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63caa3a-6e4e-4833-8b93-acc7b2962084 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:39.404302 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63caa3a-6e4e-4833-8b93-acc7b2962084 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:39.409979 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 405/811] 10.222.0.70 () {56 vars in 1114 bytes} [Mon Jul 11 14:27:39 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:39.410793 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63caa3a-6e4e-4833-8b93-acc7b2962084 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:39.425529 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0f088e-2b0d-4cec-9ecf-71734c612a9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:39.426430 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0f088e-2b0d-4cec-9ecf-71734c612a9c None admin] REQUEST_METHOD: `PUT` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:39.426713 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0f088e-2b0d-4cec-9ecf-71734c612a9c None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:39.426987 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0f088e-2b0d-4cec-9ecf-71734c612a9c None admin] PATH_INFO: `/v3/projects/ccd34295bf7b435a96b37487c8e89fc3/users/f4f8c0d696af4bd5a205ca8e9110b8cc/roles/b46df176b0fe479da63c318db225bed4` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:39.429065 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0f088e-2b0d-4cec-9ecf-71734c612a9c None admin] RBAC: Authorizing `identity:create_grant(project_id=ccd34295bf7b435a96b37487c8e89fc3, user_id=f4f8c0d696af4bd5a205ca8e9110b8cc, role_id=b46df176b0fe479da63c318db225bed4)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:39.430512 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0f088e-2b0d-4cec-9ecf-71734c612a9c None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:39.446816 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 407/812] 10.222.0.70 () {58 vars in 1439 bytes} [Mon Jul 11 14:27:39 2022] PUT /identity/v3/projects/ccd34295bf7b435a96b37487c8e89fc3/users/f4f8c0d696af4bd5a205ca8e9110b8cc/roles/b46df176b0fe479da63c318db225bed4 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:27:39.447389 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0f088e-2b0d-4cec-9ecf-71734c612a9c None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:39.465959 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:39.560520 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63caa3a-6e4e-4833-8b93-acc7b2962084 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:39.589264 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0f088e-2b0d-4cec-9ecf-71734c612a9c None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:39.636257 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd71fd5-8634-410c-80a7-104cf0d2db00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:39.637637 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f064050f-d690-4170-8ffa-973152df80f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:39.637789 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd71fd5-8634-410c-80a7-104cf0d2db00 None admin] REQUEST_METHOD: `PUT` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:39.638164 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd71fd5-8634-410c-80a7-104cf0d2db00 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:39.638493 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f064050f-d690-4170-8ffa-973152df80f2 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:39.638614 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd71fd5-8634-410c-80a7-104cf0d2db00 None admin] PATH_INFO: `/v3/projects/ccd34295bf7b435a96b37487c8e89fc3/users/2ef7b195b623456aa0b12dac0a4bf4d3/roles/c766eda9743248fa87df72ec905d271e` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:39.638776 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f064050f-d690-4170-8ffa-973152df80f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:39.639041 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f064050f-d690-4170-8ffa-973152df80f2 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:39.648704 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f064050f-d690-4170-8ffa-973152df80f2 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:39.650170 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f064050f-d690-4170-8ffa-973152df80f2 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:39.666333 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application [None req-f064050f-d690-4170-8ffa-973152df80f2 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 11 14:27:39.666333 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:39.666333 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:39.666333 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:39.666333 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:39.666333 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:39.666333 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:39.666333 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:39.666333 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:39.666333 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:39.666333 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:39.666333 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:39.666333 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 14:27:39.666333 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 14:27:39.666333 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 14:27:39.666333 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 14:27:39.667436 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:39.667436 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:39.667436 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 14:27:39.667436 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:27:39.667436 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 14:27:39.667436 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:27:39.667436 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:39.667436 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:39.667436 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:39.667436 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:39.667436 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:39.667436 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:39.667436 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:39.667436 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:39.667436 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:39.667436 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:39.667436 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:39.667436 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:39.668564 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:39.668564 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:39.668564 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 14:27:39.668564 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 14:27:39.668564 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 14:27:39.668564 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 14:27:39.668564 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 14:27:39.668564 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 14:27:39.668564 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 11 14:27:39.668564 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Jul 11 14:27:39.669104 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd71fd5-8634-410c-80a7-104cf0d2db00 None admin] RBAC: Authorizing `identity:create_grant(project_id=ccd34295bf7b435a96b37487c8e89fc3, user_id=2ef7b195b623456aa0b12dac0a4bf4d3, role_id=c766eda9743248fa87df72ec905d271e)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:39.669194 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 408/813] 10.222.0.70 () {56 vars in 1096 bytes} [Mon Jul 11 14:27:39 2022] GET /identity/v3/users/swift => generated 83 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:27:39.669798 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd71fd5-8634-410c-80a7-104cf0d2db00 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:39.673707 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f064050f-d690-4170-8ffa-973152df80f2 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:39.698431 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 406/814] 10.222.0.70 () {58 vars in 1439 bytes} [Mon Jul 11 14:27:39 2022] PUT /identity/v3/projects/ccd34295bf7b435a96b37487c8e89fc3/users/2ef7b195b623456aa0b12dac0a4bf4d3/roles/c766eda9743248fa87df72ec905d271e => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:27:39.699748 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd71fd5-8634-410c-80a7-104cf0d2db00 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:39.728263 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:39.844132 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:39.859294 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd71fd5-8634-410c-80a7-104cf0d2db00 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:39.893841 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f064050f-d690-4170-8ffa-973152df80f2 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:39.902215 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8184581-8601-4dd9-b370-22ea9a1ec7be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:39.902894 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8184581-8601-4dd9-b370-22ea9a1ec7be None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:39.903176 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8184581-8601-4dd9-b370-22ea9a1ec7be None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:39.903450 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8184581-8601-4dd9-b370-22ea9a1ec7be None admin] PATH_INFO: `/v3/services` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:39.904167 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8184581-8601-4dd9-b370-22ea9a1ec7be None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:39.904503 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8184581-8601-4dd9-b370-22ea9a1ec7be None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:39.905940 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8184581-8601-4dd9-b370-22ea9a1ec7be None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:39.911914 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 407/815] 10.222.0.70 () {56 vars in 1114 bytes} [Mon Jul 11 14:27:39 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:39.912577 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8184581-8601-4dd9-b370-22ea9a1ec7be None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:39.976788 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b791300d-5065-4ea6-ab3a-af93beb0a531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:39.977924 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b791300d-5065-4ea6-ab3a-af93beb0a531 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:39.978491 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b791300d-5065-4ea6-ab3a-af93beb0a531 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:39.979090 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b791300d-5065-4ea6-ab3a-af93beb0a531 None admin] PATH_INFO: `/v3/services` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:39.980528 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b791300d-5065-4ea6-ab3a-af93beb0a531 None admin] RBAC: Adding query filter params (type=network) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:39.981084 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b791300d-5065-4ea6-ab3a-af93beb0a531 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:39.984092 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b791300d-5065-4ea6-ab3a-af93beb0a531 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:39.997807 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 409/816] 10.222.0.70 () {56 vars in 1112 bytes} [Mon Jul 11 14:27:39 2022] GET /identity/v3/services?type=network => generated 350 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:40.007433 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b791300d-5065-4ea6-ab3a-af93beb0a531 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:40.037790 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8184581-8601-4dd9-b370-22ea9a1ec7be None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:40.078444 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5efbfd-68ee-487a-bb6a-9c3ac3df9df8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:40.079722 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5efbfd-68ee-487a-bb6a-9c3ac3df9df8 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:40.080503 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5efbfd-68ee-487a-bb6a-9c3ac3df9df8 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:40.080793 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5efbfd-68ee-487a-bb6a-9c3ac3df9df8 None admin] PATH_INFO: `/v3/users` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:40.081739 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5efbfd-68ee-487a-bb6a-9c3ac3df9df8 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:40.082052 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5efbfd-68ee-487a-bb6a-9c3ac3df9df8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:40.083672 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5efbfd-68ee-487a-bb6a-9c3ac3df9df8 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:40.104800 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 408/817] 10.222.0.70 () {56 vars in 1135 bytes} [Mon Jul 11 14:27:39 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:40.110701 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5efbfd-68ee-487a-bb6a-9c3ac3df9df8 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:40.184769 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:40.184970 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:40.199716 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b791300d-5065-4ea6-ab3a-af93beb0a531 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:40.222377 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5efbfd-68ee-487a-bb6a-9c3ac3df9df8 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:40.245650 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8520a5f5-6431-404c-9934-c3e4f5ab45d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:40.246991 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8520a5f5-6431-404c-9934-c3e4f5ab45d0 None admin] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:40.248234 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8520a5f5-6431-404c-9934-c3e4f5ab45d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:40.248936 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8520a5f5-6431-404c-9934-c3e4f5ab45d0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:40.249920 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8520a5f5-6431-404c-9934-c3e4f5ab45d0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:40.252062 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8520a5f5-6431-404c-9934-c3e4f5ab45d0 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:40.268317 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aca5e48-6778-4249-bc68-7dbb29c1d2eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:40.269180 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aca5e48-6778-4249-bc68-7dbb29c1d2eb None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:40.269459 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aca5e48-6778-4249-bc68-7dbb29c1d2eb None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:40.269732 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aca5e48-6778-4249-bc68-7dbb29c1d2eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:40.292836 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 410/818] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Jul 11 14:27:40 2022] POST /identity/v3/endpoints => generated 327 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:27:40.294806 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aca5e48-6778-4249-bc68-7dbb29c1d2eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:40.298395 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aca5e48-6778-4249-bc68-7dbb29c1d2eb None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:40.335079 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-3aca5e48-6778-4249-bc68-7dbb29c1d2eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:27:40.335079 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:40.335079 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:40.335079 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:40.335079 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:40.335079 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:40.335079 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:40.335079 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:40.335079 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:40.335079 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:40.335079 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:40.335079 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:40.335079 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:27:40.335079 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:27:40.335079 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:27:40.336057 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:27:40.336057 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:40.336057 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:40.336057 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:40.336057 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:40.336057 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:40.336057 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:40.336057 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:40.336057 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:40.336057 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:40.336057 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:40.336057 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:40.336057 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:40.336057 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:40.336057 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:40.336057 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:40.336057 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:40.336983 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:27:40.336983 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:27:40.336983 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:27:40.336983 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Jul 11 14:27:40.337732 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 409/819] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 11 14:27:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:27:40.347530 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8520a5f5-6431-404c-9934-c3e4f5ab45d0 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:40.545605 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8520a5f5-6431-404c-9934-c3e4f5ab45d0 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:40.601705 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acae793-e515-4076-8dc1-1f96199ef42b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:40.602365 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acae793-e515-4076-8dc1-1f96199ef42b None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:40.602651 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acae793-e515-4076-8dc1-1f96199ef42b None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:40.602923 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acae793-e515-4076-8dc1-1f96199ef42b None admin] PATH_INFO: `/v3/domains` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:40.603666 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acae793-e515-4076-8dc1-1f96199ef42b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:40.603968 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acae793-e515-4076-8dc1-1f96199ef42b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:40.605437 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acae793-e515-4076-8dc1-1f96199ef42b None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:40.620611 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 411/820] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jul 11 14:27:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:40.627102 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aca5e48-6778-4249-bc68-7dbb29c1d2eb None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:40.708619 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:40.746970 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aca5e48-6778-4249-bc68-7dbb29c1d2eb None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:40.786398 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbf82cd-bc81-4433-87df-7c1df49aea11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:40.787207 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbf82cd-bc81-4433-87df-7c1df49aea11 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:40.787485 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbf82cd-bc81-4433-87df-7c1df49aea11 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:40.787755 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbf82cd-bc81-4433-87df-7c1df49aea11 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:40.795837 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbf82cd-bc81-4433-87df-7c1df49aea11 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:40.797334 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbf82cd-bc81-4433-87df-7c1df49aea11 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:40.812929 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-5cbf82cd-bc81-4433-87df-7c1df49aea11 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:27:40.812929 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:40.812929 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:40.812929 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:40.812929 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:40.812929 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:40.812929 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:40.812929 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:40.812929 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:40.812929 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:40.812929 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:40.812929 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:40.812929 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 14:27:40.812929 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 14:27:40.812929 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 14:27:40.814648 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 14:27:40.814648 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:40.814648 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:40.814648 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:40.814648 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:40.814648 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:40.814648 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:40.814648 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:40.814648 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:40.814648 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:40.814648 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:40.814648 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:40.814648 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:40.814648 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:40.814648 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:40.814648 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:40.814648 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:40.815788 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 14:27:40.815788 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 14:27:40.815788 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 14:27:40.815788 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 14:27:40.815788 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 14:27:40.815788 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 14:27:40.815788 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:27:40.815788 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Jul 11 14:27:40.820597 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 410/821] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Jul 11 14:27:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:27:40.826287 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acae793-e515-4076-8dc1-1f96199ef42b None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:40.836593 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:41.035958 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acae793-e515-4076-8dc1-1f96199ef42b None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:41.077825 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45b847d-492a-427c-9d65-d18c83394bc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:41.078435 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45b847d-492a-427c-9d65-d18c83394bc6 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:41.078725 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45b847d-492a-427c-9d65-d18c83394bc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:41.079687 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45b847d-492a-427c-9d65-d18c83394bc6 None admin] PATH_INFO: `/v3/projects` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:41.080812 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45b847d-492a-427c-9d65-d18c83394bc6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:41.081240 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45b847d-492a-427c-9d65-d18c83394bc6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:41.083174 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45b847d-492a-427c-9d65-d18c83394bc6 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:41.101391 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 412/822] 10.222.0.70 () {56 vars in 1148 bytes} [Mon Jul 11 14:27:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:41.109934 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbf82cd-bc81-4433-87df-7c1df49aea11 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:41.291533 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbf82cd-bc81-4433-87df-7c1df49aea11 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:41.336844 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:41.355783 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0e682e-7e5f-4d4c-b9f4-ef6ac003c1a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:41.357192 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0e682e-7e5f-4d4c-b9f4-ef6ac003c1a9 None admin] REQUEST_METHOD: `PUT` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:41.357629 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0e682e-7e5f-4d4c-b9f4-ef6ac003c1a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:41.358065 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0e682e-7e5f-4d4c-b9f4-ef6ac003c1a9 None admin] PATH_INFO: `/v3/projects/ccd34295bf7b435a96b37487c8e89fc3/users/0217add2f5e74a80a1a33b160cc57a2b/roles/b46df176b0fe479da63c318db225bed4` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:41.361440 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0e682e-7e5f-4d4c-b9f4-ef6ac003c1a9 None admin] RBAC: Authorizing `identity:create_grant(project_id=ccd34295bf7b435a96b37487c8e89fc3, user_id=0217add2f5e74a80a1a33b160cc57a2b, role_id=b46df176b0fe479da63c318db225bed4)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:41.364029 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0e682e-7e5f-4d4c-b9f4-ef6ac003c1a9 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:41.386561 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 411/823] 10.222.0.70 () {58 vars in 1439 bytes} [Mon Jul 11 14:27:41 2022] PUT /identity/v3/projects/ccd34295bf7b435a96b37487c8e89fc3/users/0217add2f5e74a80a1a33b160cc57a2b/roles/b46df176b0fe479da63c318db225bed4 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:27:42.215928 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee40b25-0a1a-41c9-97d4-574bb17d6c7e None None] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:42.216485 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee40b25-0a1a-41c9-97d4-574bb17d6c7e None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:42.216594 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee40b25-0a1a-41c9-97d4-574bb17d6c7e None None] PATH_INFO: `/` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:42.218534 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 413/824] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:27:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:27:42.224436 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2887974-63e9-4b3a-993c-f6714a24f888 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:42.224924 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2887974-63e9-4b3a-993c-f6714a24f888 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:42.225001 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2887974-63e9-4b3a-993c-f6714a24f888 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:42.243354 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-b2887974-63e9-4b3a-993c-f6714a24f888 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:27:42.244614 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-b2887974-63e9-4b3a-993c-f6714a24f888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:27:42.322801 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 412/825] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:27:42 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:27:42.347194 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee40b25-0a1a-41c9-97d4-574bb17d6c7e None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:42.440231 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:42.446260 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221ae957-3b9c-4d79-900b-7c53b77a3a2d None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:42.446547 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221ae957-3b9c-4d79-900b-7c53b77a3a2d None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:42.446872 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221ae957-3b9c-4d79-900b-7c53b77a3a2d None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:42.448488 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 413/826] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:27:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 14:27:42.454891 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1837a574-fc66-453d-976f-8024fdbac332 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:42.455272 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1837a574-fc66-453d-976f-8024fdbac332 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:42.455462 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1837a574-fc66-453d-976f-8024fdbac332 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:42.473494 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-1837a574-fc66-453d-976f-8024fdbac332 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:27:42.474609 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-1837a574-fc66-453d-976f-8024fdbac332 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:27:42.523538 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee40b25-0a1a-41c9-97d4-574bb17d6c7e None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:42.569019 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 414/827] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:27:42 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 14:27:42.581872 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8c2cdb-350d-479b-9947-48e2e04b859a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:42.583041 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8c2cdb-350d-479b-9947-48e2e04b859a None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:42.583533 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8c2cdb-350d-479b-9947-48e2e04b859a None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:42.584012 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8c2cdb-350d-479b-9947-48e2e04b859a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:42.592571 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1837a574-fc66-453d-976f-8024fdbac332 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:42.602239 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8c2cdb-350d-479b-9947-48e2e04b859a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:27:42.611179 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application [None req-2e8c2cdb-350d-479b-9947-48e2e04b859a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:27:42.611179 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:42.611179 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:42.611179 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:42.611179 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:42.611179 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:42.611179 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:42.611179 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:42.611179 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:42.611179 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:42.611179 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:42.611179 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:42.611179 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:27:42.611179 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:27:42.611179 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:27:42.611179 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:27:42.613167 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:27:42.613167 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:27:42.613167 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:27:42.613167 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:27:42.613167 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:42.613167 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:42.613167 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:42.613167 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:42.613167 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:42.613167 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:42.613167 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:42.613167 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:42.613167 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:42.613167 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:42.613167 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:42.613167 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:42.614840 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:42.614840 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:42.614840 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:42.614840 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:42.614840 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:27:42.614840 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:27:42.614840 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:27:42.614840 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:27:42.614840 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:27:42.614840 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:27:42.614840 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:27:42.614840 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Jul 11 14:27:42.614840 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 414/828] 10.222.0.70 () {56 vars in 1096 bytes} [Mon Jul 11 14:27:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:27:42.617101 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5934bc94-ac96-435c-be27-3e38e811d14a None None] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:42.617101 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5934bc94-ac96-435c-be27-3e38e811d14a None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:42.617101 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5934bc94-ac96-435c-be27-3e38e811d14a None None] PATH_INFO: `/` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:42.619389 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 415/829] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:27:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:27:42.620808 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5934bc94-ac96-435c-be27-3e38e811d14a None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:42.670837 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:42.769841 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1837a574-fc66-453d-976f-8024fdbac332 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:42.770982 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5934bc94-ac96-435c-be27-3e38e811d14a None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:42.799987 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:42.812422 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64870f8-a473-47ff-816e-a3b6e93e4c8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:42.813103 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64870f8-a473-47ff-816e-a3b6e93e4c8d None admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:42.814080 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64870f8-a473-47ff-816e-a3b6e93e4c8d None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:42.814233 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64870f8-a473-47ff-816e-a3b6e93e4c8d None admin] PATH_INFO: `/v3/services` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:42.814972 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64870f8-a473-47ff-816e-a3b6e93e4c8d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:42.815359 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffaabf0-cdef-4b95-b219-c75ce0b2b1e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:42.816041 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffaabf0-cdef-4b95-b219-c75ce0b2b1e9 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:42.816355 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffaabf0-cdef-4b95-b219-c75ce0b2b1e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:42.816492 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64870f8-a473-47ff-816e-a3b6e93e4c8d None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:42.816827 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffaabf0-cdef-4b95-b219-c75ce0b2b1e9 None admin] PATH_INFO: `/v3/roles` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:42.817583 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffaabf0-cdef-4b95-b219-c75ce0b2b1e9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:42.817891 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffaabf0-cdef-4b95-b219-c75ce0b2b1e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:42.819249 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffaabf0-cdef-4b95-b219-c75ce0b2b1e9 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:42.832026 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 416/830] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Jul 11 14:27:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:42.840417 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 415/831] 10.222.0.70 () {60 vars in 1141 bytes} [Mon Jul 11 14:27:42 2022] POST /identity/v3/services => generated 251 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:27:42.840417 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64870f8-a473-47ff-816e-a3b6e93e4c8d None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:42.840683 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824530dc-5aea-42d7-b27d-a7c9de879fed None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:42.840683 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824530dc-5aea-42d7-b27d-a7c9de879fed None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:42.840683 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824530dc-5aea-42d7-b27d-a7c9de879fed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:42.857315 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-824530dc-5aea-42d7-b27d-a7c9de879fed None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:27:42.858590 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-824530dc-5aea-42d7-b27d-a7c9de879fed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:27:43.005571 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 417/832] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:27:42 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:27:43.030413 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824530dc-5aea-42d7-b27d-a7c9de879fed None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:43.044443 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64870f8-a473-47ff-816e-a3b6e93e4c8d None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:43.046738 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:43.109644 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b40e30-0f15-4565-aa9a-f5dfeb16f618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:43.111111 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b40e30-0f15-4565-aa9a-f5dfeb16f618 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:43.111401 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b40e30-0f15-4565-aa9a-f5dfeb16f618 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:43.111682 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b40e30-0f15-4565-aa9a-f5dfeb16f618 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:43.124618 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b40e30-0f15-4565-aa9a-f5dfeb16f618 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:43.126522 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b40e30-0f15-4565-aa9a-f5dfeb16f618 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:43.150435 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-e5b40e30-0f15-4565-aa9a-f5dfeb16f618 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:27:43.150435 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:43.150435 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:43.150435 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:43.150435 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:43.150435 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:43.150435 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:43.150435 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:43.150435 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:43.150435 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:43.150435 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:43.150435 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:43.150435 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:27:43.150435 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:27:43.150435 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:27:43.151888 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:27:43.151888 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:43.151888 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:43.151888 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:43.151888 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:43.151888 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:43.151888 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:43.151888 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:43.151888 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:43.151888 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:43.151888 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:43.151888 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:43.151888 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:43.151888 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:43.151888 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:43.151888 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:43.151888 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:43.152805 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:27:43.152805 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:27:43.152805 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:27:43.152805 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Jul 11 14:27:43.152805 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 416/833] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 11 14:27:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:27:43.158325 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b40e30-0f15-4565-aa9a-f5dfeb16f618 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:43.217674 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824530dc-5aea-42d7-b27d-a7c9de879fed None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:43.236403 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:43.262621 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a28cfd0-ef9b-4b59-a9bc-86dd86af6c9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:43.263451 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a28cfd0-ef9b-4b59-a9bc-86dd86af6c9e None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:43.263731 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a28cfd0-ef9b-4b59-a9bc-86dd86af6c9e None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:43.264003 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a28cfd0-ef9b-4b59-a9bc-86dd86af6c9e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:43.278461 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a28cfd0-ef9b-4b59-a9bc-86dd86af6c9e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:27:43.287795 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application [None req-7a28cfd0-ef9b-4b59-a9bc-86dd86af6c9e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:27:43.287795 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:43.287795 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:43.287795 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:43.287795 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:43.287795 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:43.287795 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:43.287795 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:43.287795 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:43.287795 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:43.287795 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:43.287795 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:43.287795 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:27:43.287795 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:27:43.287795 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:27:43.287795 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:27:43.289005 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:27:43.289005 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:27:43.289005 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:27:43.289005 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:27:43.289005 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:43.289005 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:43.289005 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:43.289005 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:43.289005 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:43.289005 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:43.289005 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:43.289005 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:43.289005 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:43.289005 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:43.289005 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:43.289005 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:43.289998 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:43.289998 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:43.289998 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:43.289998 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:43.289998 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:27:43.289998 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:27:43.289998 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:27:43.289998 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:27:43.289998 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:27:43.289998 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:27:43.289998 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:27:43.289998 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Jul 11 14:27:43.289998 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 418/834] 10.222.0.70 () {56 vars in 1102 bytes} [Mon Jul 11 14:27:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:27:43.299689 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a28cfd0-ef9b-4b59-a9bc-86dd86af6c9e None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:43.321820 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b40e30-0f15-4565-aa9a-f5dfeb16f618 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:43.429087 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a28cfd0-ef9b-4b59-a9bc-86dd86af6c9e None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:43.488477 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee15280-c555-4be4-83e4-561715a9992f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:43.490330 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee15280-c555-4be4-83e4-561715a9992f None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:43.490850 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee15280-c555-4be4-83e4-561715a9992f None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:43.491338 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee15280-c555-4be4-83e4-561715a9992f None admin] PATH_INFO: `/v3/roles` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:43.493223 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee15280-c555-4be4-83e4-561715a9992f None admin] RBAC: Adding query filter params (name=service) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:43.494445 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee15280-c555-4be4-83e4-561715a9992f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:43.499021 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee15280-c555-4be4-83e4-561715a9992f None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:43.502975 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c50e1f-6753-4907-a9a2-57ce19780d29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:43.503933 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c50e1f-6753-4907-a9a2-57ce19780d29 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:43.504251 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c50e1f-6753-4907-a9a2-57ce19780d29 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:43.504586 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c50e1f-6753-4907-a9a2-57ce19780d29 None admin] PATH_INFO: `/v3/domains` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:43.506160 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c50e1f-6753-4907-a9a2-57ce19780d29 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:43.507035 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c50e1f-6753-4907-a9a2-57ce19780d29 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:43.509978 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c50e1f-6753-4907-a9a2-57ce19780d29 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:43.525275 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 419/835] 10.222.0.70 () {56 vars in 1103 bytes} [Mon Jul 11 14:27:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:27:43.530427 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee15280-c555-4be4-83e4-561715a9992f None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:43.532972 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 417/836] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jul 11 14:27:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 376 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:27:43.543941 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c50e1f-6753-4907-a9a2-57ce19780d29 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:43.584664 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:43.593107 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:43.680270 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee15280-c555-4be4-83e4-561715a9992f None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:43.698225 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c50e1f-6753-4907-a9a2-57ce19780d29 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:43.730621 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143c6cc8-1598-4fb4-9fd1-d0bf0c6f0cd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:43.731889 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143c6cc8-1598-4fb4-9fd1-d0bf0c6f0cd3 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:43.732500 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143c6cc8-1598-4fb4-9fd1-d0bf0c6f0cd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:43.733011 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143c6cc8-1598-4fb4-9fd1-d0bf0c6f0cd3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:43.747270 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afce77d0-049f-4a72-b5be-d6088dca0108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:43.748578 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afce77d0-049f-4a72-b5be-d6088dca0108 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:43.748889 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afce77d0-049f-4a72-b5be-d6088dca0108 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:43.749146 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afce77d0-049f-4a72-b5be-d6088dca0108 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:43.752492 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143c6cc8-1598-4fb4-9fd1-d0bf0c6f0cd3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:43.754941 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143c6cc8-1598-4fb4-9fd1-d0bf0c6f0cd3 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:43.759708 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afce77d0-049f-4a72-b5be-d6088dca0108 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:43.761291 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afce77d0-049f-4a72-b5be-d6088dca0108 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:43.776972 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application [None req-143c6cc8-1598-4fb4-9fd1-d0bf0c6f0cd3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:27:43.776972 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:43.776972 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:43.776972 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:43.776972 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:43.776972 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:43.776972 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:43.776972 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:43.776972 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:43.776972 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:43.776972 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:43.776972 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:43.776972 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:27:43.776972 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:27:43.776972 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:27:43.778006 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:27:43.778006 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:43.778006 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:43.778006 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:43.778006 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:43.778006 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:43.778006 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:43.778006 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:43.778006 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:43.778006 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:43.778006 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:43.778006 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:43.778006 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:43.778006 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:43.778006 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:43.778006 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:43.778006 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:43.778898 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:27:43.778898 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:27:43.778898 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:27:43.778898 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Jul 11 14:27:43.779118 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-afce77d0-049f-4a72-b5be-d6088dca0108 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 11 14:27:43.779118 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:43.779118 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:43.779118 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:43.779118 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:43.779118 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:43.779118 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:43.779118 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:43.779118 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:43.779118 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:43.779118 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:43.779118 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:43.779118 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 14:27:43.779118 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 14:27:43.779118 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 14:27:43.779118 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 14:27:43.779966 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:43.779966 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:43.779966 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 14:27:43.779966 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:27:43.779966 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 14:27:43.779966 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:27:43.779966 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:43.779966 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:43.779966 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:43.779966 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:43.779966 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:43.779966 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:43.779966 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:43.779966 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:43.779966 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:43.779966 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:43.779966 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:43.779966 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:43.780953 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:43.780953 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:43.780953 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 14:27:43.780953 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 14:27:43.780953 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 14:27:43.780953 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 14:27:43.780953 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 14:27:43.780953 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 14:27:43.780953 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 11 14:27:43.780953 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Jul 11 14:27:43.784829 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 420/837] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 11 14:27:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:27:43.785701 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 418/838] 10.222.0.70 () {56 vars in 1093 bytes} [Mon Jul 11 14:27:43 2022] GET /identity/v3/users/nova => generated 82 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:27:43.791367 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143c6cc8-1598-4fb4-9fd1-d0bf0c6f0cd3 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:43.792183 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afce77d0-049f-4a72-b5be-d6088dca0108 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:43.900814 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:43.930705 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:43.934074 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afce77d0-049f-4a72-b5be-d6088dca0108 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:43.954766 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143c6cc8-1598-4fb4-9fd1-d0bf0c6f0cd3 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:43.972611 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d58cde7-9ef6-4507-9bb1-39c3fc35759b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:43.973296 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d58cde7-9ef6-4507-9bb1-39c3fc35759b None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:43.973572 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d58cde7-9ef6-4507-9bb1-39c3fc35759b None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:43.973870 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d58cde7-9ef6-4507-9bb1-39c3fc35759b None admin] PATH_INFO: `/v3/users` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:43.974796 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d58cde7-9ef6-4507-9bb1-39c3fc35759b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:43.975215 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d58cde7-9ef6-4507-9bb1-39c3fc35759b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:43.976692 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d58cde7-9ef6-4507-9bb1-39c3fc35759b None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:43.997520 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657e1ccd-20b9-423a-92a7-20637e3807cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:43.998197 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657e1ccd-20b9-423a-92a7-20637e3807cc None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:43.998484 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657e1ccd-20b9-423a-92a7-20637e3807cc None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:43.998762 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657e1ccd-20b9-423a-92a7-20637e3807cc None admin] PATH_INFO: `/v3/domains` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:43.999505 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657e1ccd-20b9-423a-92a7-20637e3807cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:43.999814 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657e1ccd-20b9-423a-92a7-20637e3807cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:44.001620 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 419/839] 10.222.0.70 () {56 vars in 1133 bytes} [Mon Jul 11 14:27:43 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:44.001793 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657e1ccd-20b9-423a-92a7-20637e3807cc None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:44.003632 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd2c5c9-e51a-467d-8756-cbf3e4d4f200 None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:44.003913 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd2c5c9-e51a-467d-8756-cbf3e4d4f200 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:44.004188 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd2c5c9-e51a-467d-8756-cbf3e4d4f200 None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:44.005705 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 420/840] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:27:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:27:44.010326 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd2c5c9-e51a-467d-8756-cbf3e4d4f200 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:44.020256 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 421/841] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jul 11 14:27:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:44.021615 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32e4d43-681b-46a1-8e18-1e073ca5ee53 None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:44.021943 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32e4d43-681b-46a1-8e18-1e073ca5ee53 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:44.022208 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32e4d43-681b-46a1-8e18-1e073ca5ee53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:44.048345 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-e32e4d43-681b-46a1-8e18-1e073ca5ee53 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:27:44.049581 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-e32e4d43-681b-46a1-8e18-1e073ca5ee53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:27:44.148258 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 422/842] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:27:44 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:27:44.148258 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32e4d43-681b-46a1-8e18-1e073ca5ee53 None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:44.161422 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd2c5c9-e51a-467d-8756-cbf3e4d4f200 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:44.212499 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:44.219544 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505986da-237b-4800-a65c-0a36f3337dc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:44.220315 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505986da-237b-4800-a65c-0a36f3337dc8 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:44.220918 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505986da-237b-4800-a65c-0a36f3337dc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:44.221617 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505986da-237b-4800-a65c-0a36f3337dc8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:44.284430 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:44.316973 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505986da-237b-4800-a65c-0a36f3337dc8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:44.318463 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505986da-237b-4800-a65c-0a36f3337dc8 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:44.322088 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32e4d43-681b-46a1-8e18-1e073ca5ee53 None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:44.371967 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4011e96-8d06-4167-9472-caface70bc6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:44.373325 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4011e96-8d06-4167-9472-caface70bc6e None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:44.373779 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4011e96-8d06-4167-9472-caface70bc6e None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:44.374226 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4011e96-8d06-4167-9472-caface70bc6e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:44.386977 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4011e96-8d06-4167-9472-caface70bc6e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:44.388820 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4011e96-8d06-4167-9472-caface70bc6e None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:44.412177 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application [None req-f4011e96-8d06-4167-9472-caface70bc6e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 11 14:27:44.412177 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:44.412177 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:44.412177 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:44.412177 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:44.412177 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:44.412177 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:44.412177 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:44.412177 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:44.412177 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:44.412177 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:44.412177 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:44.412177 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 14:27:44.412177 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 14:27:44.412177 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 14:27:44.412177 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 14:27:44.413709 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:44.413709 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:44.413709 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 14:27:44.413709 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:27:44.413709 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 14:27:44.413709 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:27:44.413709 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:44.413709 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:44.413709 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:44.413709 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:44.413709 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:44.413709 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:44.413709 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:44.413709 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:44.413709 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:44.413709 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:44.413709 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:44.413709 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:44.415069 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:44.415069 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:44.415069 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 14:27:44.415069 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 14:27:44.415069 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 14:27:44.415069 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 14:27:44.415069 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 14:27:44.415069 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 14:27:44.415069 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 11 14:27:44.415069 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Jul 11 14:27:44.415069 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 423/843] 10.222.0.70 () {56 vars in 1117 bytes} [Mon Jul 11 14:27:44 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:27:44.415069 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4011e96-8d06-4167-9472-caface70bc6e None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:44.468505 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 421/844] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Jul 11 14:27:44 2022] GET /identity/v3/auth/tokens => generated 1252 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 11 14:27:44.468505 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505986da-237b-4800-a65c-0a36f3337dc8 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:44.513900 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:44.598230 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4011e96-8d06-4167-9472-caface70bc6e None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:44.619256 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505986da-237b-4800-a65c-0a36f3337dc8 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:44.645701 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd620568-71bf-48d4-a7f1-5a4a98ddffbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:44.646973 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd620568-71bf-48d4-a7f1-5a4a98ddffbe None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:44.647440 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd620568-71bf-48d4-a7f1-5a4a98ddffbe None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:44.647894 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd620568-71bf-48d4-a7f1-5a4a98ddffbe None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:44.651500 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:44.661944 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d835a326-ffbd-40bb-a0d3-867f8ba3ddd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:44.662683 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d835a326-ffbd-40bb-a0d3-867f8ba3ddd6 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:44.662874 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd620568-71bf-48d4-a7f1-5a4a98ddffbe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:27:44.662978 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d835a326-ffbd-40bb-a0d3-867f8ba3ddd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:44.663203 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d835a326-ffbd-40bb-a0d3-867f8ba3ddd6 None admin] PATH_INFO: `/v3/users` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:44.664269 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d835a326-ffbd-40bb-a0d3-867f8ba3ddd6 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:44.664393 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d835a326-ffbd-40bb-a0d3-867f8ba3ddd6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:44.665758 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d835a326-ffbd-40bb-a0d3-867f8ba3ddd6 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:44.670896 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application [None req-dd620568-71bf-48d4-a7f1-5a4a98ddffbe None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:27:44.670896 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:44.670896 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:44.670896 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:44.670896 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:44.670896 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:44.670896 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:44.670896 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:44.670896 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:44.670896 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:44.670896 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:44.670896 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:44.670896 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:27:44.670896 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:27:44.670896 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:27:44.670896 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:27:44.672458 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:27:44.672458 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:27:44.672458 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:27:44.672458 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:27:44.672458 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:44.672458 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:44.672458 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:44.672458 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:44.672458 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:44.672458 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:44.672458 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:44.672458 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:44.672458 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:44.672458 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:44.672458 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:44.672458 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:44.675197 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:44.675197 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:44.675197 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:44.675197 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:44.675197 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:27:44.675197 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:27:44.675197 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:27:44.675197 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:27:44.675197 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:27:44.675197 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:27:44.675197 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:27:44.675197 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Jul 11 14:27:44.675197 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 424/845] 10.222.0.70 () {56 vars in 1096 bytes} [Mon Jul 11 14:27:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:27:44.675197 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd620568-71bf-48d4-a7f1-5a4a98ddffbe None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:44.697257 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 422/846] 10.222.0.70 () {56 vars in 1149 bytes} [Mon Jul 11 14:27:44 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:44.697257 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d835a326-ffbd-40bb-a0d3-867f8ba3ddd6 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:44.802118 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd620568-71bf-48d4-a7f1-5a4a98ddffbe None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:44.818458 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:44.835350 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d835a326-ffbd-40bb-a0d3-867f8ba3ddd6 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:44.844134 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fc16f4-ea5f-44e3-9391-a34928ed04d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:44.846417 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fc16f4-ea5f-44e3-9391-a34928ed04d0 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:44.846589 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fc16f4-ea5f-44e3-9391-a34928ed04d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:44.853856 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fc16f4-ea5f-44e3-9391-a34928ed04d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:44.874011 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fc16f4-ea5f-44e3-9391-a34928ed04d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:44.876657 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fc16f4-ea5f-44e3-9391-a34928ed04d0 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:44.893959 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128cd99e-ff6d-443b-ab50-e0e64ba4c1f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:44.894744 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128cd99e-ff6d-443b-ab50-e0e64ba4c1f0 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:44.895025 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128cd99e-ff6d-443b-ab50-e0e64ba4c1f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:44.895439 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128cd99e-ff6d-443b-ab50-e0e64ba4c1f0 None admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:44.896118 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128cd99e-ff6d-443b-ab50-e0e64ba4c1f0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:44.896455 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128cd99e-ff6d-443b-ab50-e0e64ba4c1f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:44.897879 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128cd99e-ff6d-443b-ab50-e0e64ba4c1f0 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:44.912436 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 423/847] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Jul 11 14:27:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:44.912436 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128cd99e-ff6d-443b-ab50-e0e64ba4c1f0 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:44.912806 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application [None req-24fc16f4-ea5f-44e3-9391-a34928ed04d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:27:44.912806 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:44.912806 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:44.912806 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:44.912806 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:44.912806 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:44.912806 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:44.912806 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:44.912806 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:44.912806 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:44.912806 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:44.912806 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:44.912806 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:27:44.912806 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:27:44.912806 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:27:44.913662 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:27:44.913662 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:44.913662 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:44.913662 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:44.913662 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:44.913662 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:44.913662 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:44.913662 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:44.913662 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:44.913662 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:44.913662 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:44.913662 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:44.913662 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:44.913662 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:44.913662 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:44.913662 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:44.913662 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:44.914571 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:27:44.914571 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:27:44.914571 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:27:44.914571 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Jul 11 14:27:44.914571 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 425/848] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 11 14:27:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:27:44.921465 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fc16f4-ea5f-44e3-9391-a34928ed04d0 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:45.007603 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:45.092567 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128cd99e-ff6d-443b-ab50-e0e64ba4c1f0 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:45.097838 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fc16f4-ea5f-44e3-9391-a34928ed04d0 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:45.144872 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489c3936-87d6-4351-ade5-4daae689ae1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:45.146029 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489c3936-87d6-4351-ade5-4daae689ae1a None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:45.146665 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489c3936-87d6-4351-ade5-4daae689ae1a None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:45.147117 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489c3936-87d6-4351-ade5-4daae689ae1a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:45.150401 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7d5332-aac5-49fd-8241-5678b13b036f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:45.151217 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7d5332-aac5-49fd-8241-5678b13b036f None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:45.151507 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7d5332-aac5-49fd-8241-5678b13b036f None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:45.151780 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7d5332-aac5-49fd-8241-5678b13b036f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:45.166333 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7d5332-aac5-49fd-8241-5678b13b036f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:45.168482 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7d5332-aac5-49fd-8241-5678b13b036f None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:45.177941 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:45.192678 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application [None req-6a7d5332-aac5-49fd-8241-5678b13b036f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:27:45.192678 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:45.192678 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:45.192678 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:45.192678 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:45.192678 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:45.192678 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:45.192678 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:45.192678 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:45.192678 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:45.192678 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:45.192678 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:45.192678 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:27:45.192678 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:27:45.192678 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:27:45.193727 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:27:45.193727 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:45.193727 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:45.193727 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:45.193727 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:45.193727 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:45.193727 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:45.193727 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:45.193727 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:45.193727 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:45.193727 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:45.193727 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:45.193727 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:45.193727 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:45.193727 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:45.193727 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:45.193727 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:45.194713 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:27:45.194713 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:27:45.194713 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:27:45.194713 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Jul 11 14:27:45.200153 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 426/849] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 11 14:27:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:27:45.200784 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7d5332-aac5-49fd-8241-5678b13b036f None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:45.240692 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489c3936-87d6-4351-ade5-4daae689ae1a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:45.242492 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489c3936-87d6-4351-ade5-4daae689ae1a None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:45.339893 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:45.343869 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7d5332-aac5-49fd-8241-5678b13b036f None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:45.377906 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 424/850] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Jul 11 14:27:44 2022] GET /identity/v3/auth/tokens => generated 1252 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 11 14:27:45.379022 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489c3936-87d6-4351-ade5-4daae689ae1a None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:45.387821 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ea727f-3120-44b4-964f-2c0047b59056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:45.388592 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ea727f-3120-44b4-964f-2c0047b59056 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:45.388875 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ea727f-3120-44b4-964f-2c0047b59056 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:45.389155 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ea727f-3120-44b4-964f-2c0047b59056 None admin] PATH_INFO: `/v3/domains` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:45.389898 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ea727f-3120-44b4-964f-2c0047b59056 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:45.390215 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ea727f-3120-44b4-964f-2c0047b59056 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:45.391772 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ea727f-3120-44b4-964f-2c0047b59056 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:45.404673 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 427/851] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jul 11 14:27:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:45.405809 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d295d5-d981-416e-8706-ed98dd765369 None None] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:45.406111 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d295d5-d981-416e-8706-ed98dd765369 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:45.406363 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d295d5-d981-416e-8706-ed98dd765369 None None] PATH_INFO: `/` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:45.408633 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 428/852] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:27:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:27:45.409146 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d295d5-d981-416e-8706-ed98dd765369 None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:45.441804 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:45.496870 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489c3936-87d6-4351-ade5-4daae689ae1a None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:45.528092 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d295d5-d981-416e-8706-ed98dd765369 None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:45.540885 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a006b3db-52c7-4168-bfec-bb4d63040a4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:45.541560 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a006b3db-52c7-4168-bfec-bb4d63040a4a None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:45.541838 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a006b3db-52c7-4168-bfec-bb4d63040a4a None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:45.542113 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a006b3db-52c7-4168-bfec-bb4d63040a4a None admin] PATH_INFO: `/v3/domains` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:45.542839 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a006b3db-52c7-4168-bfec-bb4d63040a4a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:45.543140 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a006b3db-52c7-4168-bfec-bb4d63040a4a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:45.544534 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a006b3db-52c7-4168-bfec-bb4d63040a4a None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:45.557879 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 425/853] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jul 11 14:27:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:45.559251 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a006b3db-52c7-4168-bfec-bb4d63040a4a None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:45.579086 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbecfeaa-aa9d-4720-a79f-2e2a88a03dd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:45.580617 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbecfeaa-aa9d-4720-a79f-2e2a88a03dd9 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:45.580901 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbecfeaa-aa9d-4720-a79f-2e2a88a03dd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:45.581178 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbecfeaa-aa9d-4720-a79f-2e2a88a03dd9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:45.592144 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbecfeaa-aa9d-4720-a79f-2e2a88a03dd9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:45.593625 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbecfeaa-aa9d-4720-a79f-2e2a88a03dd9 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:45.613598 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application [None req-fbecfeaa-aa9d-4720-a79f-2e2a88a03dd9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:27:45.613598 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:45.613598 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:45.613598 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:45.613598 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:45.613598 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:45.613598 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:45.613598 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:45.613598 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:45.613598 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:45.613598 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:45.613598 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:45.613598 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:27:45.613598 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:27:45.613598 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:27:45.614791 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:27:45.614791 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:45.614791 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:45.614791 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:45.614791 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:45.614791 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:45.614791 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:45.614791 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:45.614791 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:45.614791 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:45.614791 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:45.614791 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:45.614791 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:45.614791 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:45.614791 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:45.614791 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:45.614791 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:45.616513 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:27:45.616513 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:27:45.616513 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:27:45.616513 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Jul 11 14:27:45.616513 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 429/854] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 11 14:27:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:27:45.616513 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706ff02c-5f34-45d4-9d52-43135b090674 None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:45.616513 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706ff02c-5f34-45d4-9d52-43135b090674 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:45.617349 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706ff02c-5f34-45d4-9d52-43135b090674 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:45.635833 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-706ff02c-5f34-45d4-9d52-43135b090674 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:27:45.637236 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-706ff02c-5f34-45d4-9d52-43135b090674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:27:45.647022 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:45.687987 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a006b3db-52c7-4168-bfec-bb4d63040a4a None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:45.702086 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:45.723932 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 430/855] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:27:45 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:27:45.724838 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706ff02c-5f34-45d4-9d52-43135b090674 None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:45.740985 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bb119c-bda7-455d-93a4-df700026c980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:45.741937 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bb119c-bda7-455d-93a4-df700026c980 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:45.742412 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bb119c-bda7-455d-93a4-df700026c980 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:45.742821 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bb119c-bda7-455d-93a4-df700026c980 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:45.751508 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bb119c-bda7-455d-93a4-df700026c980 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:45.753062 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bb119c-bda7-455d-93a4-df700026c980 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:45.769610 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-79bb119c-bda7-455d-93a4-df700026c980 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:27:45.769610 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:45.769610 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:45.769610 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:45.769610 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:45.769610 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:45.769610 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:45.769610 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:45.769610 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:45.769610 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:45.769610 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:45.769610 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:45.769610 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 14:27:45.769610 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 14:27:45.769610 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 14:27:45.771281 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 14:27:45.771281 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:45.771281 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:45.771281 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:45.771281 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:45.771281 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:45.771281 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:45.771281 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:45.771281 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:45.771281 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:45.771281 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:45.771281 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:45.771281 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:45.771281 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:45.771281 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:45.771281 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:45.771281 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:45.773093 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 14:27:45.773093 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 14:27:45.773093 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 14:27:45.773093 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 14:27:45.773093 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 14:27:45.773093 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 14:27:45.773093 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:27:45.773093 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Jul 11 14:27:45.773093 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 426/856] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Jul 11 14:27:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:27:45.773093 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bb119c-bda7-455d-93a4-df700026c980 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:45.853844 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706ff02c-5f34-45d4-9d52-43135b090674 None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:45.889970 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9867d912-a7cd-43b6-96c0-b51c5547b34b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:45.890202 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bb119c-bda7-455d-93a4-df700026c980 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:45.890910 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9867d912-a7cd-43b6-96c0-b51c5547b34b None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:45.892438 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9867d912-a7cd-43b6-96c0-b51c5547b34b None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:45.892710 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9867d912-a7cd-43b6-96c0-b51c5547b34b None admin] PATH_INFO: `/v3/users/swift` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:45.901357 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9867d912-a7cd-43b6-96c0-b51c5547b34b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:45.902809 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9867d912-a7cd-43b6-96c0-b51c5547b34b None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:45.918332 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application [None req-9867d912-a7cd-43b6-96c0-b51c5547b34b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 11 14:27:45.918332 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:45.918332 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:45.918332 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:45.918332 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:45.918332 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:45.918332 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:45.918332 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:45.918332 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:45.918332 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:45.918332 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:45.918332 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:45.918332 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 14:27:45.918332 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 14:27:45.918332 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 14:27:45.918332 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 14:27:45.920424 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:45.920424 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:45.920424 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 14:27:45.920424 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:27:45.920424 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 14:27:45.920424 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:27:45.920424 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:45.920424 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:45.920424 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:45.920424 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:45.920424 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:45.920424 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:45.920424 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:45.920424 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:45.920424 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:45.920424 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:45.920424 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:45.920424 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:45.923538 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:45.923538 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:45.923538 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 14:27:45.923538 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 14:27:45.923538 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 14:27:45.923538 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 14:27:45.923538 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 14:27:45.923538 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 14:27:45.923538 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 11 14:27:45.923538 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Jul 11 14:27:45.923538 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 431/857] 10.222.0.70 () {56 vars in 1096 bytes} [Mon Jul 11 14:27:45 2022] GET /identity/v3/users/swift => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:27:45.923538 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9867d912-a7cd-43b6-96c0-b51c5547b34b None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:45.929232 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:45.935391 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c9c447-5b92-43a6-a96a-90a4982f8dbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:45.936407 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c9c447-5b92-43a6-a96a-90a4982f8dbe None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:45.936693 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c9c447-5b92-43a6-a96a-90a4982f8dbe None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:45.936969 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c9c447-5b92-43a6-a96a-90a4982f8dbe None admin] PATH_INFO: `/v3/domains` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:45.937711 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c9c447-5b92-43a6-a96a-90a4982f8dbe None admin] RBAC: Adding query filter params (name=Default) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:45.938544 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c9c447-5b92-43a6-a96a-90a4982f8dbe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:45.939954 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c9c447-5b92-43a6-a96a-90a4982f8dbe None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:45.952581 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 427/858] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jul 11 14:27:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:45.953336 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c9c447-5b92-43a6-a96a-90a4982f8dbe None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:45.993288 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:46.040019 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9867d912-a7cd-43b6-96c0-b51c5547b34b None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:46.066122 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c9c447-5b92-43a6-a96a-90a4982f8dbe None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:46.078684 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d676db-4844-4dbe-b835-f90235ec95b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:46.080439 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d676db-4844-4dbe-b835-f90235ec95b1 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:46.080748 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d676db-4844-4dbe-b835-f90235ec95b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:46.081029 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d676db-4844-4dbe-b835-f90235ec95b1 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:46.081730 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d676db-4844-4dbe-b835-f90235ec95b1 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:46.083177 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d676db-4844-4dbe-b835-f90235ec95b1 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:46.096507 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application [None req-c8d676db-4844-4dbe-b835-f90235ec95b1 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 11 14:27:46.096507 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:46.096507 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 14:27:46.096507 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 14:27:46.096507 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 14:27:46.096507 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 14:27:46.096507 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 14:27:46.096507 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:27:46.096507 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 11 14:27:46.096507 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Jul 11 14:27:46.096507 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 14:27:46.096507 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Jul 11 14:27:46.096507 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:46.096507 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:46.096507 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:46.096507 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:46.096507 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:46.097941 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:46.097941 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:46.097941 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:46.097941 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:46.097941 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:46.097941 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:46.097941 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 14:27:46.097941 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 14:27:46.097941 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 14:27:46.097941 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 14:27:46.097941 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:46.097941 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:46.097941 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:46.097941 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:46.097941 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:46.097941 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:46.099525 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:46.099525 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:46.099525 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:46.099525 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:46.099525 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:46.099525 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:46.099525 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:46.099525 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:46.099525 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:46.099525 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:46.099525 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 14:27:46.099525 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:27:46.099525 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 11 14:27:46.099525 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Jul 11 14:27:46.099525 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 432/859] 10.222.0.70 () {56 vars in 1114 bytes} [Mon Jul 11 14:27:45 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:27:46.101095 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d676db-4844-4dbe-b835-f90235ec95b1 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:46.110486 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ebb1a3-669d-46cd-ab99-2d8023723960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:46.111312 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ebb1a3-669d-46cd-ab99-2d8023723960 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:46.111605 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ebb1a3-669d-46cd-ab99-2d8023723960 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:46.111887 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ebb1a3-669d-46cd-ab99-2d8023723960 None admin] PATH_INFO: `/v3/projects` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:46.112715 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ebb1a3-669d-46cd-ab99-2d8023723960 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:46.113030 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ebb1a3-669d-46cd-ab99-2d8023723960 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:46.114479 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ebb1a3-669d-46cd-ab99-2d8023723960 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:46.127682 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 428/860] 10.222.0.70 () {56 vars in 1148 bytes} [Mon Jul 11 14:27:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:46.128556 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ebb1a3-669d-46cd-ab99-2d8023723960 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:46.177442 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:46.220312 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d676db-4844-4dbe-b835-f90235ec95b1 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:46.237689 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:46.247058 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ebb1a3-669d-46cd-ab99-2d8023723960 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:46.261703 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef99f12c-2899-45ea-91dc-1d2c2a1486cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:46.262470 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef99f12c-2899-45ea-91dc-1d2c2a1486cf None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:46.262766 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef99f12c-2899-45ea-91dc-1d2c2a1486cf None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:46.263040 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef99f12c-2899-45ea-91dc-1d2c2a1486cf None admin] PATH_INFO: `/v3/users` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:46.263880 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef99f12c-2899-45ea-91dc-1d2c2a1486cf None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:46.264220 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef99f12c-2899-45ea-91dc-1d2c2a1486cf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:46.265647 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef99f12c-2899-45ea-91dc-1d2c2a1486cf None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:46.284087 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299dcb8a-6d5b-4caf-bb13-c4ba5052191c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:46.284921 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299dcb8a-6d5b-4caf-bb13-c4ba5052191c None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:46.285205 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299dcb8a-6d5b-4caf-bb13-c4ba5052191c None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:46.285577 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299dcb8a-6d5b-4caf-bb13-c4ba5052191c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:46.286063 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 433/861] 10.222.0.70 () {56 vars in 1135 bytes} [Mon Jul 11 14:27:46 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:46.286891 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef99f12c-2899-45ea-91dc-1d2c2a1486cf None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:46.293972 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299dcb8a-6d5b-4caf-bb13-c4ba5052191c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:46.295446 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299dcb8a-6d5b-4caf-bb13-c4ba5052191c None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:46.310337 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-299dcb8a-6d5b-4caf-bb13-c4ba5052191c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:27:46.310337 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:46.310337 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:46.310337 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:46.310337 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:46.310337 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:46.310337 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:46.310337 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:46.310337 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:46.310337 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:46.310337 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:46.310337 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:46.310337 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 14:27:46.310337 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 14:27:46.310337 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 14:27:46.311383 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 14:27:46.311383 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:46.311383 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:46.311383 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:46.311383 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:46.311383 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:46.311383 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:46.311383 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:46.311383 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:46.311383 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:46.311383 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:46.311383 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:46.311383 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:46.311383 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:46.311383 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:46.311383 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:46.311383 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:46.312386 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 14:27:46.312386 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 14:27:46.312386 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 14:27:46.312386 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 14:27:46.312386 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 14:27:46.312386 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 14:27:46.312386 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:27:46.312386 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Jul 11 14:27:46.312386 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 429/862] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Jul 11 14:27:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:27:46.312386 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299dcb8a-6d5b-4caf-bb13-c4ba5052191c None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:46.402756 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef99f12c-2899-45ea-91dc-1d2c2a1486cf None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:46.426811 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299dcb8a-6d5b-4caf-bb13-c4ba5052191c None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:46.435614 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:46.454214 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb6e8b1-32b6-4065-aed3-9a5010a97981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:46.455101 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb6e8b1-32b6-4065-aed3-9a5010a97981 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:46.455318 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb6e8b1-32b6-4065-aed3-9a5010a97981 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:46.455586 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb6e8b1-32b6-4065-aed3-9a5010a97981 None admin] PATH_INFO: `/v3/services` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:46.457014 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb6e8b1-32b6-4065-aed3-9a5010a97981 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:46.457556 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb6e8b1-32b6-4065-aed3-9a5010a97981 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:46.459953 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb6e8b1-32b6-4065-aed3-9a5010a97981 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:46.464717 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55eedb29-ae4e-4f34-8730-7899d218c4a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:46.465558 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eedb29-ae4e-4f34-8730-7899d218c4a2 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:46.465841 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eedb29-ae4e-4f34-8730-7899d218c4a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:46.466115 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eedb29-ae4e-4f34-8730-7899d218c4a2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:46.466956 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55eedb29-ae4e-4f34-8730-7899d218c4a2 None admin] RBAC: Adding query filter params (role.id=b46df176b0fe479da63c318db225bed4, scope.project.id=ccd34295bf7b435a96b37487c8e89fc3, user.id=f4f8c0d696af4bd5a205ca8e9110b8cc) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:46.467271 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55eedb29-ae4e-4f34-8730-7899d218c4a2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:46.468443 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 434/863] 10.222.0.70 () {56 vars in 1114 bytes} [Mon Jul 11 14:27:46 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:46.468773 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55eedb29-ae4e-4f34-8730-7899d218c4a2 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:46.470260 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb6e8b1-32b6-4065-aed3-9a5010a97981 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:46.482403 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 430/864] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Jul 11 14:27:46 2022] GET /identity/v3/role_assignments?user.id=f4f8c0d696af4bd5a205ca8e9110b8cc&scope.project.id=ccd34295bf7b435a96b37487c8e89fc3&role.id=b46df176b0fe479da63c318db225bed4 => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:46.483786 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55eedb29-ae4e-4f34-8730-7899d218c4a2 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:46.536014 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:46.623536 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb6e8b1-32b6-4065-aed3-9a5010a97981 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:46.683648 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55eedb29-ae4e-4f34-8730-7899d218c4a2 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:46.691681 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06eb4e6-a941-47b4-810a-c32748cc2e95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:46.693157 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06eb4e6-a941-47b4-810a-c32748cc2e95 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:46.693629 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06eb4e6-a941-47b4-810a-c32748cc2e95 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:46.694083 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06eb4e6-a941-47b4-810a-c32748cc2e95 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:46.736156 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf13571-bf04-4c99-ba90-d1bc663c515d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:46.736991 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf13571-bf04-4c99-ba90-d1bc663c515d None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:46.737431 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf13571-bf04-4c99-ba90-d1bc663c515d None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:46.737712 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf13571-bf04-4c99-ba90-d1bc663c515d None admin] PATH_INFO: `/v3/projects` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:46.738816 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf13571-bf04-4c99-ba90-d1bc663c515d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:46.739153 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf13571-bf04-4c99-ba90-d1bc663c515d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:46.740887 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf13571-bf04-4c99-ba90-d1bc663c515d None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:46.757131 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 431/865] 10.222.0.70 () {56 vars in 1148 bytes} [Mon Jul 11 14:27:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:46.757992 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf13571-bf04-4c99-ba90-d1bc663c515d None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:46.789478 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:46.805690 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06eb4e6-a941-47b4-810a-c32748cc2e95 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:46.807411 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06eb4e6-a941-47b4-810a-c32748cc2e95 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:46.892361 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:46.944080 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 435/866] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Jul 11 14:27:46 2022] GET /identity/v3/auth/tokens => generated 1252 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 11 14:27:46.945237 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf13571-bf04-4c99-ba90-d1bc663c515d None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:46.945846 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06eb4e6-a941-47b4-810a-c32748cc2e95 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:46.999267 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6706da28-cde1-450b-8ba2-f3c3cf4ca93f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:46.999972 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6706da28-cde1-450b-8ba2-f3c3cf4ca93f None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:47.000290 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6706da28-cde1-450b-8ba2-f3c3cf4ca93f None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:47.001130 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6706da28-cde1-450b-8ba2-f3c3cf4ca93f None admin] PATH_INFO: `/v3/services` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:47.002349 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6706da28-cde1-450b-8ba2-f3c3cf4ca93f None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:47.002655 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6706da28-cde1-450b-8ba2-f3c3cf4ca93f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:47.004052 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6706da28-cde1-450b-8ba2-f3c3cf4ca93f None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:47.009964 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 432/867] 10.222.0.70 () {56 vars in 1114 bytes} [Mon Jul 11 14:27:46 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:47.011006 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6706da28-cde1-450b-8ba2-f3c3cf4ca93f None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:47.087562 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:47.105070 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06eb4e6-a941-47b4-810a-c32748cc2e95 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:47.147622 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6706da28-cde1-450b-8ba2-f3c3cf4ca93f None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:47.149681 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c858d1fa-c34b-41d6-bde7-b95968fb7080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:47.150585 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c858d1fa-c34b-41d6-bde7-b95968fb7080 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:47.150750 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c858d1fa-c34b-41d6-bde7-b95968fb7080 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:47.151018 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c858d1fa-c34b-41d6-bde7-b95968fb7080 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:47.151827 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c858d1fa-c34b-41d6-bde7-b95968fb7080 None admin] RBAC: Adding query filter params (role.id=c766eda9743248fa87df72ec905d271e, scope.project.id=ccd34295bf7b435a96b37487c8e89fc3, user.id=2ef7b195b623456aa0b12dac0a4bf4d3) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:47.152197 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c858d1fa-c34b-41d6-bde7-b95968fb7080 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:47.153721 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c858d1fa-c34b-41d6-bde7-b95968fb7080 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:47.168255 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 436/868] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Jul 11 14:27:46 2022] GET /identity/v3/role_assignments?user.id=2ef7b195b623456aa0b12dac0a4bf4d3&scope.project.id=ccd34295bf7b435a96b37487c8e89fc3&role.id=c766eda9743248fa87df72ec905d271e => generated 608 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:47.168255 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c858d1fa-c34b-41d6-bde7-b95968fb7080 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:47.217101 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb97f647-897f-401a-ab72-afb15ca6edd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:47.218030 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb97f647-897f-401a-ab72-afb15ca6edd9 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:47.218422 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb97f647-897f-401a-ab72-afb15ca6edd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:47.219201 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb97f647-897f-401a-ab72-afb15ca6edd9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:47.234621 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:47.240988 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb97f647-897f-401a-ab72-afb15ca6edd9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:47.242506 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb97f647-897f-401a-ab72-afb15ca6edd9 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:47.268594 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-bb97f647-897f-401a-ab72-afb15ca6edd9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:27:47.268594 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:47.268594 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:47.268594 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:47.268594 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:47.268594 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:47.268594 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:47.268594 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:47.268594 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:47.268594 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:47.268594 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:47.268594 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:47.268594 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:27:47.268594 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:27:47.268594 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:27:47.269634 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:27:47.269634 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:47.269634 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:47.269634 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:47.269634 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:47.269634 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:47.269634 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:47.269634 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:47.269634 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:47.269634 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:47.269634 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:47.269634 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:47.269634 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:47.269634 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:47.269634 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:47.269634 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:47.269634 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:47.270628 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:27:47.270628 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:27:47.270628 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:27:47.270628 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Jul 11 14:27:47.271119 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 433/869] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 11 14:27:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:27:47.278824 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb97f647-897f-401a-ab72-afb15ca6edd9 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:47.321232 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c858d1fa-c34b-41d6-bde7-b95968fb7080 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:47.378379 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c134087d-42d3-472d-8cf5-88a6fa0396fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:47.378764 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c134087d-42d3-472d-8cf5-88a6fa0396fb None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:47.379243 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c134087d-42d3-472d-8cf5-88a6fa0396fb None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:47.379751 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c134087d-42d3-472d-8cf5-88a6fa0396fb None admin] PATH_INFO: `/v3/endpoints` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:47.381334 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c134087d-42d3-472d-8cf5-88a6fa0396fb None admin] RBAC: Adding query filter params (interface=public, service_id=55fe221f19034113b9b2a85de7a62715, region_id=RegionOne) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:47.381888 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c134087d-42d3-472d-8cf5-88a6fa0396fb None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:47.384555 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c134087d-42d3-472d-8cf5-88a6fa0396fb None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:47.400310 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 437/870] 10.222.0.70 () {56 vars in 1251 bytes} [Mon Jul 11 14:27:47 2022] GET /identity/v3/endpoints?service_id=55fe221f19034113b9b2a85de7a62715&interface=public®ion_id=RegionOne => generated 194 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:47.403793 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c134087d-42d3-472d-8cf5-88a6fa0396fb None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:47.425192 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb97f647-897f-401a-ab72-afb15ca6edd9 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:47.430912 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:47.475595 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb3fd76-b90c-46f4-bfc2-29518649c71a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:47.476944 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb3fd76-b90c-46f4-bfc2-29518649c71a None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:47.476944 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb3fd76-b90c-46f4-bfc2-29518649c71a None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:47.476944 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb3fd76-b90c-46f4-bfc2-29518649c71a None admin] PATH_INFO: `/v3/domains` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:47.477568 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb3fd76-b90c-46f4-bfc2-29518649c71a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:47.477871 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb3fd76-b90c-46f4-bfc2-29518649c71a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:47.479266 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb3fd76-b90c-46f4-bfc2-29518649c71a None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:47.494852 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 434/871] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jul 11 14:27:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:47.501351 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb3fd76-b90c-46f4-bfc2-29518649c71a None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:47.572160 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c134087d-42d3-472d-8cf5-88a6fa0396fb None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:47.578967 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:47.628054 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1441264e-fdce-459e-8f74-bc3d16f3a111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:47.629671 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1441264e-fdce-459e-8f74-bc3d16f3a111 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:47.630151 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1441264e-fdce-459e-8f74-bc3d16f3a111 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:47.630754 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1441264e-fdce-459e-8f74-bc3d16f3a111 None admin] PATH_INFO: `/v3/services` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:47.631762 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1441264e-fdce-459e-8f74-bc3d16f3a111 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:47.633335 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1441264e-fdce-459e-8f74-bc3d16f3a111 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:47.643068 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 438/872] 10.222.0.70 () {56 vars in 1087 bytes} [Mon Jul 11 14:27:47 2022] GET /identity/v3/services => generated 1011 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:27:47.667444 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb3fd76-b90c-46f4-bfc2-29518649c71a None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:47.713050 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff3f098-69a6-47dc-990e-28a696770f98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:47.713881 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff3f098-69a6-47dc-990e-28a696770f98 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:47.714163 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff3f098-69a6-47dc-990e-28a696770f98 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:47.714440 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff3f098-69a6-47dc-990e-28a696770f98 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:47.723583 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff3f098-69a6-47dc-990e-28a696770f98 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:47.725158 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff3f098-69a6-47dc-990e-28a696770f98 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:47.741762 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-aff3f098-69a6-47dc-990e-28a696770f98 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:27:47.741762 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:47.741762 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:47.741762 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:47.741762 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:47.741762 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:47.741762 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:47.741762 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:47.741762 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:47.741762 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:47.741762 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:47.741762 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:47.741762 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 14:27:47.741762 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 14:27:47.741762 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 14:27:47.744097 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 14:27:47.744097 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:47.744097 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:47.744097 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:47.744097 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:47.744097 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:47.744097 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:47.744097 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:47.744097 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:47.744097 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:47.744097 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:47.744097 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:47.744097 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:47.744097 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:47.744097 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:47.744097 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:47.744097 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:47.746386 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 14:27:47.746386 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 14:27:47.746386 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 14:27:47.746386 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 14:27:47.746386 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 14:27:47.746386 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 14:27:47.746386 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:27:47.746386 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Jul 11 14:27:47.746386 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 435/873] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Jul 11 14:27:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:27:47.753678 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1441264e-fdce-459e-8f74-bc3d16f3a111 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:47.927073 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:47.964735 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1441264e-fdce-459e-8f74-bc3d16f3a111 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:48.026150 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c979687-b9e4-4f33-a1e7-3b6499173b3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:48.027382 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c979687-b9e4-4f33-a1e7-3b6499173b3d None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:48.027753 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c979687-b9e4-4f33-a1e7-3b6499173b3d None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:48.028072 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c979687-b9e4-4f33-a1e7-3b6499173b3d None admin] PATH_INFO: `/v3/projects` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:48.029599 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c979687-b9e4-4f33-a1e7-3b6499173b3d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:48.029931 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c979687-b9e4-4f33-a1e7-3b6499173b3d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:48.032017 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c979687-b9e4-4f33-a1e7-3b6499173b3d None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:48.055012 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 439/874] 10.222.0.70 () {56 vars in 1148 bytes} [Mon Jul 11 14:27:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:48.060996 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff3f098-69a6-47dc-990e-28a696770f98 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:48.180925 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff3f098-69a6-47dc-990e-28a696770f98 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:48.196164 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:48.230372 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1b9d53-a636-4a1a-afca-1348ea33575c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:48.231376 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1b9d53-a636-4a1a-afca-1348ea33575c None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:48.231882 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1b9d53-a636-4a1a-afca-1348ea33575c None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:48.232661 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1b9d53-a636-4a1a-afca-1348ea33575c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:48.233881 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1b9d53-a636-4a1a-afca-1348ea33575c None admin] RBAC: Adding query filter params (role.id=b46df176b0fe479da63c318db225bed4, scope.project.id=ccd34295bf7b435a96b37487c8e89fc3, user.id=0217add2f5e74a80a1a33b160cc57a2b) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:48.234431 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1b9d53-a636-4a1a-afca-1348ea33575c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:48.236399 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1b9d53-a636-4a1a-afca-1348ea33575c None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:48.244254 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 436/875] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Jul 11 14:27:48 2022] GET /identity/v3/role_assignments?user.id=0217add2f5e74a80a1a33b160cc57a2b&scope.project.id=ccd34295bf7b435a96b37487c8e89fc3&role.id=b46df176b0fe479da63c318db225bed4 => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:48.782182 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b340307-e72f-4532-b30f-d600d30dc13a None None] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:48.782973 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b340307-e72f-4532-b30f-d600d30dc13a None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:48.783182 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b340307-e72f-4532-b30f-d600d30dc13a None None] PATH_INFO: `/` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:48.786332 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 440/876] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:27:48 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:27:48.791760 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badf93d7-4e03-43ce-9852-2b61b9e1b7f8 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:48.792728 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badf93d7-4e03-43ce-9852-2b61b9e1b7f8 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:48.793241 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badf93d7-4e03-43ce-9852-2b61b9e1b7f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:48.812413 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-badf93d7-4e03-43ce-9852-2b61b9e1b7f8 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:27:48.814561 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-badf93d7-4e03-43ce-9852-2b61b9e1b7f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:27:48.888757 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 437/877] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:27:48 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 14:27:48.912014 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b340307-e72f-4532-b30f-d600d30dc13a None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:49.087236 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b340307-e72f-4532-b30f-d600d30dc13a None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:49.129699 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dbbf90-c2d0-43e5-94a8-5b83088c9720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:49.130941 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dbbf90-c2d0-43e5-94a8-5b83088c9720 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:49.131427 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dbbf90-c2d0-43e5-94a8-5b83088c9720 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:49.131898 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dbbf90-c2d0-43e5-94a8-5b83088c9720 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:49.132800 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dbbf90-c2d0-43e5-94a8-5b83088c9720 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:49.134392 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dbbf90-c2d0-43e5-94a8-5b83088c9720 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:49.148536 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application [None req-c7dbbf90-c2d0-43e5-94a8-5b83088c9720 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 11 14:27:49.148536 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:49.148536 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 14:27:49.148536 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 14:27:49.148536 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 14:27:49.148536 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 14:27:49.148536 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 14:27:49.148536 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:27:49.148536 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 11 14:27:49.148536 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Jul 11 14:27:49.148536 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 14:27:49.148536 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Jul 11 14:27:49.148536 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:49.148536 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:49.148536 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:49.148536 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:49.149588 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:49.149588 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:49.149588 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:49.149588 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:49.149588 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:49.149588 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:49.149588 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:49.149588 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 14:27:49.149588 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 14:27:49.149588 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 14:27:49.149588 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 14:27:49.149588 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:49.149588 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:49.149588 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:49.149588 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:49.149588 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:49.150431 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:49.150431 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:49.150431 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:49.150431 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:49.150431 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:49.150431 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:49.150431 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:49.150431 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:49.150431 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:49.150431 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:49.150431 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:49.150431 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 14:27:49.150431 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:27:49.150431 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 11 14:27:49.150431 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Jul 11 14:27:49.153561 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 441/878] 10.222.0.70 () {56 vars in 1132 bytes} [Mon Jul 11 14:27:48 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:27:49.160474 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badf93d7-4e03-43ce-9852-2b61b9e1b7f8 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:49.271474 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badf93d7-4e03-43ce-9852-2b61b9e1b7f8 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:49.279502 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:49.310618 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86248b7-999b-4c1f-8678-e4d1457e2436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:49.311293 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86248b7-999b-4c1f-8678-e4d1457e2436 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:49.311576 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86248b7-999b-4c1f-8678-e4d1457e2436 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:49.311852 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86248b7-999b-4c1f-8678-e4d1457e2436 None admin] PATH_INFO: `/v3/services` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:49.312623 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86248b7-999b-4c1f-8678-e4d1457e2436 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:49.313192 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86248b7-999b-4c1f-8678-e4d1457e2436 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:49.314499 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86248b7-999b-4c1f-8678-e4d1457e2436 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:49.319942 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 438/879] 10.222.0.70 () {56 vars in 1126 bytes} [Mon Jul 11 14:27:49 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:49.325966 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dbbf90-c2d0-43e5-94a8-5b83088c9720 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:49.331966 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:49.442208 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dbbf90-c2d0-43e5-94a8-5b83088c9720 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:49.481409 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6a7adb-7df1-499d-a974-b486ace26256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:49.482432 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6a7adb-7df1-499d-a974-b486ace26256 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:49.482942 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6a7adb-7df1-499d-a974-b486ace26256 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:49.483419 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6a7adb-7df1-499d-a974-b486ace26256 None admin] PATH_INFO: `/v3/services` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:49.484404 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6a7adb-7df1-499d-a974-b486ace26256 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:49.485059 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6a7adb-7df1-499d-a974-b486ace26256 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:49.486827 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6a7adb-7df1-499d-a974-b486ace26256 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:49.492438 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 442/880] 10.222.0.70 () {56 vars in 1126 bytes} [Mon Jul 11 14:27:49 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:49.550324 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb5cc67-1ea7-4147-8f31-95a01e3bfe08 None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:49.550664 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb5cc67-1ea7-4147-8f31-95a01e3bfe08 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:49.550881 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb5cc67-1ea7-4147-8f31-95a01e3bfe08 None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:49.552653 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 439/881] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:27:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 14:27:49.560520 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45627d0c-7917-409e-bd2d-dca46b54f2e4 None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:49.560848 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45627d0c-7917-409e-bd2d-dca46b54f2e4 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:49.561084 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45627d0c-7917-409e-bd2d-dca46b54f2e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:49.581575 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-45627d0c-7917-409e-bd2d-dca46b54f2e4 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:27:49.582917 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-45627d0c-7917-409e-bd2d-dca46b54f2e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:27:49.661134 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:49.668782 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 443/882] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:27:49 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 14:27:49.693457 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb5cc67-1ea7-4147-8f31-95a01e3bfe08 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:49.804951 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb5cc67-1ea7-4147-8f31-95a01e3bfe08 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:49.841064 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bcf2a8-a9b4-457b-9656-3ec9b4f19ef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:49.841887 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bcf2a8-a9b4-457b-9656-3ec9b4f19ef2 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:49.842168 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bcf2a8-a9b4-457b-9656-3ec9b4f19ef2 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:49.842444 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bcf2a8-a9b4-457b-9656-3ec9b4f19ef2 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:49.854748 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bcf2a8-a9b4-457b-9656-3ec9b4f19ef2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:27:49.863876 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-a2bcf2a8-a9b4-457b-9656-3ec9b4f19ef2 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 11 14:27:49.863876 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:49.863876 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:49.863876 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:49.863876 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:49.863876 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:49.863876 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:49.863876 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:49.863876 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:49.863876 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:49.863876 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:49.863876 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:49.863876 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:27:49.863876 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:27:49.863876 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:27:49.863876 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:27:49.864947 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:27:49.864947 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:27:49.864947 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:27:49.864947 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:27:49.864947 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:49.864947 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:49.864947 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:49.864947 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:49.864947 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:49.864947 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:49.864947 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:49.864947 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:49.864947 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:49.864947 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:49.864947 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:49.864947 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:49.865793 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:49.865793 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:49.865793 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:49.865793 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:49.865793 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:27:49.865793 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:27:49.865793 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:27:49.865793 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:27:49.865793 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:27:49.865793 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:27:49.865793 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 11 14:27:49.865793 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Jul 11 14:27:49.865793 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 440/883] 10.222.0.70 () {56 vars in 1120 bytes} [Mon Jul 11 14:27:49 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:27:49.871464 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45627d0c-7917-409e-bd2d-dca46b54f2e4 None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:49.984110 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45627d0c-7917-409e-bd2d-dca46b54f2e4 None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:50.033472 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da731d7-4755-430d-a8ed-a8e1d7cf2343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:50.034443 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da731d7-4755-430d-a8ed-a8e1d7cf2343 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:50.034870 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da731d7-4755-430d-a8ed-a8e1d7cf2343 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:50.035283 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da731d7-4755-430d-a8ed-a8e1d7cf2343 None admin] PATH_INFO: `/v3/roles` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:50.036185 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da731d7-4755-430d-a8ed-a8e1d7cf2343 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:50.036655 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da731d7-4755-430d-a8ed-a8e1d7cf2343 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:50.038193 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da731d7-4755-430d-a8ed-a8e1d7cf2343 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:50.054470 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 444/884] 10.222.0.70 () {56 vars in 1115 bytes} [Mon Jul 11 14:27:49 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:50.060192 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bcf2a8-a9b4-457b-9656-3ec9b4f19ef2 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:50.095051 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:50.174391 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bcf2a8-a9b4-457b-9656-3ec9b4f19ef2 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:50.212052 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb23624-a0c7-4e55-9d36-4d1467d0cc33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:50.212894 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb23624-a0c7-4e55-9d36-4d1467d0cc33 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:50.213189 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb23624-a0c7-4e55-9d36-4d1467d0cc33 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:50.213456 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb23624-a0c7-4e55-9d36-4d1467d0cc33 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:50.226208 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb23624-a0c7-4e55-9d36-4d1467d0cc33 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:50.227697 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb23624-a0c7-4e55-9d36-4d1467d0cc33 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:50.246362 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-0fb23624-a0c7-4e55-9d36-4d1467d0cc33 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:27:50.246362 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:50.246362 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:50.246362 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:50.246362 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:50.246362 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:50.246362 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:50.246362 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:50.246362 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:50.246362 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:50.246362 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:50.246362 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:50.246362 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:27:50.246362 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:27:50.246362 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:27:50.247371 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:27:50.247371 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:50.247371 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:50.247371 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:50.247371 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:50.247371 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:50.247371 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:50.247371 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:50.247371 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:50.247371 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:50.247371 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:50.247371 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:50.247371 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:50.247371 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:50.247371 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:50.247371 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:50.247371 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:50.248300 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:27:50.248300 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:27:50.248300 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:27:50.248300 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Jul 11 14:27:50.248300 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 441/885] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 11 14:27:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:27:50.257409 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da731d7-4755-430d-a8ed-a8e1d7cf2343 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:50.394662 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:50.445018 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da731d7-4755-430d-a8ed-a8e1d7cf2343 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:50.494505 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5efb363-8c45-4c30-924d-af875ce238d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:50.495374 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5efb363-8c45-4c30-924d-af875ce238d1 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:50.495702 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5efb363-8c45-4c30-924d-af875ce238d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:50.495954 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5efb363-8c45-4c30-924d-af875ce238d1 None admin] PATH_INFO: `/v3/domains` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:50.496859 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5efb363-8c45-4c30-924d-af875ce238d1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:50.497022 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce83d653-ef92-4fa0-8dcd-08b3ab213e72 None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:50.497174 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5efb363-8c45-4c30-924d-af875ce238d1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:50.497311 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce83d653-ef92-4fa0-8dcd-08b3ab213e72 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:50.497456 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce83d653-ef92-4fa0-8dcd-08b3ab213e72 None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:50.498458 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5efb363-8c45-4c30-924d-af875ce238d1 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:50.499118 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 442/886] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:27:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 14:27:50.505431 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99853fa-8db8-4d59-a085-f0fd0a8fb860 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:50.505818 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99853fa-8db8-4d59-a085-f0fd0a8fb860 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:50.506008 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99853fa-8db8-4d59-a085-f0fd0a8fb860 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:50.513087 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 445/887] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jul 11 14:27:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:50.521929 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5efb363-8c45-4c30-924d-af875ce238d1 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:50.524435 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-f99853fa-8db8-4d59-a085-f0fd0a8fb860 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:27:50.525887 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-f99853fa-8db8-4d59-a085-f0fd0a8fb860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:27:50.634958 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5efb363-8c45-4c30-924d-af875ce238d1 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:50.636595 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 443/888] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:27:50 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 14:27:50.658309 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:50.665941 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99853fa-8db8-4d59-a085-f0fd0a8fb860 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:50.674201 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b4c3ad-0b1c-4165-9cb9-a6fbd0850798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:50.675033 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b4c3ad-0b1c-4165-9cb9-a6fbd0850798 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:50.675313 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b4c3ad-0b1c-4165-9cb9-a6fbd0850798 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:50.675586 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b4c3ad-0b1c-4165-9cb9-a6fbd0850798 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:50.684106 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b4c3ad-0b1c-4165-9cb9-a6fbd0850798 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:50.685666 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b4c3ad-0b1c-4165-9cb9-a6fbd0850798 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:50.689786 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:50.704220 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application [None req-e9b4c3ad-0b1c-4165-9cb9-a6fbd0850798 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 11 14:27:50.704220 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:50.704220 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:50.704220 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:50.704220 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:50.704220 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:50.704220 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:50.704220 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:50.704220 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:50.704220 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:50.704220 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:50.704220 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:50.704220 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 14:27:50.704220 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 14:27:50.704220 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 14:27:50.704220 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 14:27:50.706269 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:50.706269 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:50.706269 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 14:27:50.706269 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:27:50.706269 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 14:27:50.706269 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:27:50.706269 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:50.706269 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:50.706269 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:50.706269 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:50.706269 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:50.706269 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:50.706269 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:50.706269 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:50.706269 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:50.706269 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:50.706269 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:50.706269 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:50.707674 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:50.707674 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:50.707674 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 14:27:50.707674 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 14:27:50.707674 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 14:27:50.707674 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 14:27:50.707674 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 14:27:50.707674 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 14:27:50.707674 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 11 14:27:50.707674 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Jul 11 14:27:50.707674 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 446/889] 10.222.0.70 () {56 vars in 1117 bytes} [Mon Jul 11 14:27:50 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:27:50.711835 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b4c3ad-0b1c-4165-9cb9-a6fbd0850798 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:50.806685 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99853fa-8db8-4d59-a085-f0fd0a8fb860 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:50.851558 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b4c3ad-0b1c-4165-9cb9-a6fbd0850798 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:50.854124 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4016b3bc-a6c7-4d8c-9c7b-85ee2744b565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:50.855202 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4016b3bc-a6c7-4d8c-9c7b-85ee2744b565 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:50.855644 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4016b3bc-a6c7-4d8c-9c7b-85ee2744b565 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:50.856088 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4016b3bc-a6c7-4d8c-9c7b-85ee2744b565 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:50.856947 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4016b3bc-a6c7-4d8c-9c7b-85ee2744b565 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:50.858528 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4016b3bc-a6c7-4d8c-9c7b-85ee2744b565 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:50.873137 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-4016b3bc-a6c7-4d8c-9c7b-85ee2744b565 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 11 14:27:50.873137 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:50.873137 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 14:27:50.873137 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 14:27:50.873137 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 14:27:50.873137 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 14:27:50.873137 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 14:27:50.873137 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:27:50.873137 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 11 14:27:50.873137 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Jul 11 14:27:50.873137 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 14:27:50.873137 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Jul 11 14:27:50.873137 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:50.873137 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:50.873137 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:50.873137 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:50.873137 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:50.874322 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:50.874322 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:50.874322 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:50.874322 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:50.874322 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:50.874322 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:50.874322 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 14:27:50.874322 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 14:27:50.874322 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 14:27:50.874322 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 14:27:50.874322 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:50.874322 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:50.874322 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:50.874322 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:50.874322 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:50.874322 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:50.875797 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:50.875797 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:50.875797 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:50.875797 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:50.875797 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:50.875797 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:50.875797 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:50.875797 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:50.875797 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:50.875797 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:50.875797 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 14:27:50.875797 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:27:50.875797 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 11 14:27:50.875797 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Jul 11 14:27:50.883083 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 444/890] 10.222.0.70 () {56 vars in 1126 bytes} [Mon Jul 11 14:27:50 2022] GET /identity/v3/services/object-store => generated 93 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:27:50.884385 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4016b3bc-a6c7-4d8c-9c7b-85ee2744b565 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:50.890856 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fde8d93-2932-470f-b273-9baa0a1ad726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:50.891608 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fde8d93-2932-470f-b273-9baa0a1ad726 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:50.891893 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fde8d93-2932-470f-b273-9baa0a1ad726 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:50.892240 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fde8d93-2932-470f-b273-9baa0a1ad726 None admin] PATH_INFO: `/v3/users` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:50.893100 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fde8d93-2932-470f-b273-9baa0a1ad726 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:50.893413 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fde8d93-2932-470f-b273-9baa0a1ad726 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:50.894859 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fde8d93-2932-470f-b273-9baa0a1ad726 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:50.919256 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 447/891] 10.222.0.70 () {56 vars in 1149 bytes} [Mon Jul 11 14:27:50 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:27:50.920519 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fde8d93-2932-470f-b273-9baa0a1ad726 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:50.967423 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:50.980468 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:51.010612 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4016b3bc-a6c7-4d8c-9c7b-85ee2744b565 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:51.045740 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fde8d93-2932-470f-b273-9baa0a1ad726 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:51.052351 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf2f6be-3cc8-4bc1-a7b8-5fa2d4bd7d97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:51.053031 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf2f6be-3cc8-4bc1-a7b8-5fa2d4bd7d97 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:51.053317 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf2f6be-3cc8-4bc1-a7b8-5fa2d4bd7d97 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:51.053590 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf2f6be-3cc8-4bc1-a7b8-5fa2d4bd7d97 None admin] PATH_INFO: `/v3/services` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:51.054306 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf2f6be-3cc8-4bc1-a7b8-5fa2d4bd7d97 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:51.054612 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf2f6be-3cc8-4bc1-a7b8-5fa2d4bd7d97 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:51.056284 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf2f6be-3cc8-4bc1-a7b8-5fa2d4bd7d97 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:51.068335 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 445/892] 10.222.0.70 () {56 vars in 1122 bytes} [Mon Jul 11 14:27:50 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:51.068335 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d481450-9d04-4e1a-a82e-7531203119a8 None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:51.068335 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d481450-9d04-4e1a-a82e-7531203119a8 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:51.068335 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d481450-9d04-4e1a-a82e-7531203119a8 None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:51.070117 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 446/893] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:27:51 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:27:51.071650 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9c5131-ec1b-4fdd-bb78-fbdec46d40ba None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:51.071946 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9c5131-ec1b-4fdd-bb78-fbdec46d40ba None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:51.072256 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9c5131-ec1b-4fdd-bb78-fbdec46d40ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:51.090735 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b6aa7b-df7c-4039-81d2-aa403aa4f69b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:51.092131 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-7d9c5131-ec1b-4fdd-bb78-fbdec46d40ba None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:27:51.092415 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b6aa7b-df7c-4039-81d2-aa403aa4f69b None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:51.093132 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b6aa7b-df7c-4039-81d2-aa403aa4f69b None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:51.093424 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-7d9c5131-ec1b-4fdd-bb78-fbdec46d40ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:27:51.095321 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b6aa7b-df7c-4039-81d2-aa403aa4f69b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:51.192244 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 447/894] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:27:51 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:27:51.192244 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9c5131-ec1b-4fdd-bb78-fbdec46d40ba None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:51.226394 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b6aa7b-df7c-4039-81d2-aa403aa4f69b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:51.229377 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b6aa7b-df7c-4039-81d2-aa403aa4f69b None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:51.288125 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:51.303455 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:51.331702 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9c5131-ec1b-4fdd-bb78-fbdec46d40ba None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:51.384588 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6b2df8-f513-4591-bf6d-ac124aecec81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:51.385891 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6b2df8-f513-4591-bf6d-ac124aecec81 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:51.386372 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6b2df8-f513-4591-bf6d-ac124aecec81 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:51.386808 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6b2df8-f513-4591-bf6d-ac124aecec81 None admin] PATH_INFO: `/v3/services` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:51.387716 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6b2df8-f513-4591-bf6d-ac124aecec81 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:51.388329 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6b2df8-f513-4591-bf6d-ac124aecec81 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:51.389796 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6b2df8-f513-4591-bf6d-ac124aecec81 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:51.404263 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 448/895] 10.222.0.70 () {56 vars in 1122 bytes} [Mon Jul 11 14:27:51 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:51.404263 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6b2df8-f513-4591-bf6d-ac124aecec81 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:51.416120 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 448/896] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Jul 11 14:27:50 2022] GET /identity/v3/auth/tokens => generated 1252 bytes in 496 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 11 14:27:51.421950 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b6aa7b-df7c-4039-81d2-aa403aa4f69b None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:51.538670 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6b2df8-f513-4591-bf6d-ac124aecec81 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:51.590306 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b67b967-42ca-4645-b32d-55ee2b3560d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:51.591072 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b67b967-42ca-4645-b32d-55ee2b3560d0 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:51.591381 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b67b967-42ca-4645-b32d-55ee2b3560d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:51.591684 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b67b967-42ca-4645-b32d-55ee2b3560d0 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:51.592452 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b67b967-42ca-4645-b32d-55ee2b3560d0 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:51.594875 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b67b967-42ca-4645-b32d-55ee2b3560d0 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:51.608420 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-0b67b967-42ca-4645-b32d-55ee2b3560d0 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 11 14:27:51.608420 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:51.608420 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 14:27:51.608420 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 14:27:51.608420 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 14:27:51.608420 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 14:27:51.608420 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 14:27:51.608420 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:27:51.608420 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 11 14:27:51.608420 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Jul 11 14:27:51.608420 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 14:27:51.608420 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Jul 11 14:27:51.608420 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:51.608420 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:51.608420 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:51.608420 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:51.608420 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:51.611079 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:51.611079 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:51.611079 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:51.611079 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:51.611079 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:51.611079 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:51.611079 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 14:27:51.611079 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 14:27:51.611079 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 14:27:51.611079 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 14:27:51.611079 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:51.611079 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:51.611079 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:51.611079 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:51.611079 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:51.611079 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:51.612688 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:51.612688 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:51.612688 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:51.612688 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:51.612688 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:51.612688 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:51.612688 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:51.612688 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:51.612688 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:51.612688 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:51.612688 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 14:27:51.612688 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:27:51.612688 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 11 14:27:51.612688 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Jul 11 14:27:51.612688 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 449/897] 10.222.0.70 () {56 vars in 1114 bytes} [Mon Jul 11 14:27:51 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:27:51.612688 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:51.621725 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b67b967-42ca-4645-b32d-55ee2b3560d0 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:51.662513 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b6aa7b-df7c-4039-81d2-aa403aa4f69b None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:51.720581 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83f2202-0e9a-4811-8eef-683c7a66b258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:51.721590 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83f2202-0e9a-4811-8eef-683c7a66b258 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:51.721980 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83f2202-0e9a-4811-8eef-683c7a66b258 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:51.722360 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83f2202-0e9a-4811-8eef-683c7a66b258 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:51.734228 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:51.739856 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83f2202-0e9a-4811-8eef-683c7a66b258 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:51.742626 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83f2202-0e9a-4811-8eef-683c7a66b258 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:51.773874 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application [None req-a83f2202-0e9a-4811-8eef-683c7a66b258 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:27:51.773874 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:51.773874 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:51.773874 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:51.773874 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:51.773874 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:51.773874 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:51.773874 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:51.773874 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:51.773874 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:51.773874 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:51.773874 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:51.773874 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:27:51.773874 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:27:51.773874 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:27:51.775916 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:27:51.775916 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:51.775916 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:51.775916 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:51.775916 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:51.775916 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:51.775916 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:51.775916 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:51.775916 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:51.775916 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:51.775916 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:51.775916 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:51.775916 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:51.775916 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:51.775916 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:51.775916 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:51.775916 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:51.777941 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:27:51.777941 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:27:51.777941 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:27:51.777941 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Jul 11 14:27:51.780281 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 449/898] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 11 14:27:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 357 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:27:51.784999 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83f2202-0e9a-4811-8eef-683c7a66b258 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:51.812354 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b67b967-42ca-4645-b32d-55ee2b3560d0 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:51.863544 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1cb722-9c1c-4646-a2dd-ba296a90b74c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:51.864481 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1cb722-9c1c-4646-a2dd-ba296a90b74c None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:51.865113 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1cb722-9c1c-4646-a2dd-ba296a90b74c None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:51.865394 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1cb722-9c1c-4646-a2dd-ba296a90b74c None admin] PATH_INFO: `/v3/services` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:51.866129 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1cb722-9c1c-4646-a2dd-ba296a90b74c None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:51.866437 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1cb722-9c1c-4646-a2dd-ba296a90b74c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:51.868664 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1cb722-9c1c-4646-a2dd-ba296a90b74c None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:51.887092 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 450/899] 10.222.0.70 () {56 vars in 1114 bytes} [Mon Jul 11 14:27:51 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:51.888385 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1cb722-9c1c-4646-a2dd-ba296a90b74c None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:51.942926 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83f2202-0e9a-4811-8eef-683c7a66b258 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:51.973462 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:51.981763 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c73b86-e697-4016-808a-761c1021595a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:51.982447 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c73b86-e697-4016-808a-761c1021595a None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:51.982731 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c73b86-e697-4016-808a-761c1021595a None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:51.983007 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c73b86-e697-4016-808a-761c1021595a None admin] PATH_INFO: `/v3/domains` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:51.983798 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c73b86-e697-4016-808a-761c1021595a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:51.984057 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c73b86-e697-4016-808a-761c1021595a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:51.985870 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c73b86-e697-4016-808a-761c1021595a None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:52.004882 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 450/900] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jul 11 14:27:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:52.006194 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c73b86-e697-4016-808a-761c1021595a None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:52.030080 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1cb722-9c1c-4646-a2dd-ba296a90b74c None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:52.064110 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:52.071408 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae495cb-fe50-4b57-8da5-1d59dd41ff80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:52.072543 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae495cb-fe50-4b57-8da5-1d59dd41ff80 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:52.073126 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae495cb-fe50-4b57-8da5-1d59dd41ff80 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:52.073628 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae495cb-fe50-4b57-8da5-1d59dd41ff80 None admin] PATH_INFO: `/v3/services` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:52.074535 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae495cb-fe50-4b57-8da5-1d59dd41ff80 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:52.075033 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae495cb-fe50-4b57-8da5-1d59dd41ff80 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:52.077013 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae495cb-fe50-4b57-8da5-1d59dd41ff80 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:52.083228 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 451/901] 10.222.0.70 () {56 vars in 1114 bytes} [Mon Jul 11 14:27:51 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:52.088052 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c640c57c-89dd-4de4-9060-29465eda2080 None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:52.088052 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c640c57c-89dd-4de4-9060-29465eda2080 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:52.088052 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c640c57c-89dd-4de4-9060-29465eda2080 None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:52.088052 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 452/902] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:27:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:27:52.090206 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c640c57c-89dd-4de4-9060-29465eda2080 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:52.121688 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c73b86-e697-4016-808a-761c1021595a None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:52.162212 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deecd7bd-3798-45e3-8532-57aa9446c192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:52.163014 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deecd7bd-3798-45e3-8532-57aa9446c192 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:52.163294 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deecd7bd-3798-45e3-8532-57aa9446c192 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:52.163574 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deecd7bd-3798-45e3-8532-57aa9446c192 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:52.170941 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deecd7bd-3798-45e3-8532-57aa9446c192 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:52.173633 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deecd7bd-3798-45e3-8532-57aa9446c192 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:52.190530 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application [None req-deecd7bd-3798-45e3-8532-57aa9446c192 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:27:52.190530 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:52.190530 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:52.190530 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:52.190530 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:52.190530 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:52.190530 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:52.190530 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:52.190530 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:52.190530 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:52.190530 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:52.190530 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:52.190530 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 14:27:52.190530 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 14:27:52.190530 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 14:27:52.191532 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 14:27:52.191532 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:52.191532 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:52.191532 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:52.191532 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:52.191532 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:52.191532 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:52.191532 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:52.191532 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:52.191532 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:52.191532 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:52.191532 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:52.191532 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:52.191532 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:52.191532 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:52.191532 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:52.191532 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:52.192451 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 14:27:52.192451 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 14:27:52.192451 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 14:27:52.192451 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 14:27:52.192451 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 14:27:52.192451 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 14:27:52.192451 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:27:52.192451 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Jul 11 14:27:52.192451 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 451/903] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Jul 11 14:27:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:27:52.193490 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f643f0-4d93-449b-ada2-a9fe13e70a02 None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:52.193490 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f643f0-4d93-449b-ada2-a9fe13e70a02 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:52.193655 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f643f0-4d93-449b-ada2-a9fe13e70a02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:52.213212 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-d4f643f0-4d93-449b-ada2-a9fe13e70a02 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:27:52.214479 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-d4f643f0-4d93-449b-ada2-a9fe13e70a02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:27:52.216686 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c640c57c-89dd-4de4-9060-29465eda2080 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:52.246659 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:52.257184 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03da6e07-becc-40dd-8f11-61a6b595de2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:52.257914 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03da6e07-becc-40dd-8f11-61a6b595de2e None admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:52.258203 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03da6e07-becc-40dd-8f11-61a6b595de2e None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:52.258484 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03da6e07-becc-40dd-8f11-61a6b595de2e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:52.259239 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03da6e07-becc-40dd-8f11-61a6b595de2e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:52.260900 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03da6e07-becc-40dd-8f11-61a6b595de2e None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:52.284241 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 453/904] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Jul 11 14:27:52 2022] POST /identity/v3/endpoints => generated 346 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:27:52.285219 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03da6e07-becc-40dd-8f11-61a6b595de2e None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:52.316416 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 452/905] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:27:52 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:27:52.340094 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f643f0-4d93-449b-ada2-a9fe13e70a02 None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:52.387952 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:52.439670 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03da6e07-becc-40dd-8f11-61a6b595de2e None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:52.485952 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f643f0-4d93-449b-ada2-a9fe13e70a02 None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:52.493111 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fe6707-9bc6-4734-8d2b-7bf1979f9172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:52.493793 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fe6707-9bc6-4734-8d2b-7bf1979f9172 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:52.494079 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fe6707-9bc6-4734-8d2b-7bf1979f9172 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:52.494362 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fe6707-9bc6-4734-8d2b-7bf1979f9172 None admin] PATH_INFO: `/v3/projects` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:52.495151 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fe6707-9bc6-4734-8d2b-7bf1979f9172 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:52.495463 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fe6707-9bc6-4734-8d2b-7bf1979f9172 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:52.497797 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fe6707-9bc6-4734-8d2b-7bf1979f9172 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:52.514310 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 454/906] 10.222.0.70 () {56 vars in 1148 bytes} [Mon Jul 11 14:27:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:52.520690 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fe6707-9bc6-4734-8d2b-7bf1979f9172 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:52.525333 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615dee10-b439-427a-9c2e-a03f5b5100cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:52.526070 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615dee10-b439-427a-9c2e-a03f5b5100cc None admin] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:52.526366 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615dee10-b439-427a-9c2e-a03f5b5100cc None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:52.526648 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615dee10-b439-427a-9c2e-a03f5b5100cc None admin] PATH_INFO: `/v3/services` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:52.527399 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615dee10-b439-427a-9c2e-a03f5b5100cc None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:52.528845 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615dee10-b439-427a-9c2e-a03f5b5100cc None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:52.548448 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 453/907] 10.222.0.70 () {60 vars in 1141 bytes} [Mon Jul 11 14:27:52 2022] POST /identity/v3/services => generated 269 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:27:52.592899 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:52.712891 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fe6707-9bc6-4734-8d2b-7bf1979f9172 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:52.791020 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48990e36-0288-421d-a998-98c507808567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:52.792162 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48990e36-0288-421d-a998-98c507808567 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:52.792704 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48990e36-0288-421d-a998-98c507808567 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:52.793171 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48990e36-0288-421d-a998-98c507808567 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:52.794741 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48990e36-0288-421d-a998-98c507808567 None admin] RBAC: Adding query filter params (role.id=c6848bb77ffc4294ab0b88315a5dc1e1, scope.project.id=ccd34295bf7b435a96b37487c8e89fc3, user.id=2ef7b195b623456aa0b12dac0a4bf4d3) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:52.795274 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48990e36-0288-421d-a998-98c507808567 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:52.799631 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48990e36-0288-421d-a998-98c507808567 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:52.810896 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 455/908] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Jul 11 14:27:52 2022] GET /identity/v3/role_assignments?user.id=2ef7b195b623456aa0b12dac0a4bf4d3&scope.project.id=ccd34295bf7b435a96b37487c8e89fc3&role.id=c6848bb77ffc4294ab0b88315a5dc1e1 => generated 259 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:54.121906 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1f2d94-cada-41a2-962e-f7d13f78f1bd None None] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:54.122434 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1f2d94-cada-41a2-962e-f7d13f78f1bd None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:54.122511 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1f2d94-cada-41a2-962e-f7d13f78f1bd None None] PATH_INFO: `/` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:54.124137 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 454/909] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:27:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 14:27:54.131341 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af26fa1-2b74-4094-b509-67f5946f53cc None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:54.131858 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af26fa1-2b74-4094-b509-67f5946f53cc None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:54.132362 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af26fa1-2b74-4094-b509-67f5946f53cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:54.164618 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-1af26fa1-2b74-4094-b509-67f5946f53cc None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:27:54.166177 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-1af26fa1-2b74-4094-b509-67f5946f53cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:27:54.267990 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 456/910] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:27:54 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:27:54.292186 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1f2d94-cada-41a2-962e-f7d13f78f1bd None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:54.433069 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:54.442001 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1f2d94-cada-41a2-962e-f7d13f78f1bd None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:54.481872 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e25eaf-2009-4793-a8eb-500103651054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:54.482555 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e25eaf-2009-4793-a8eb-500103651054 None admin] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:54.482839 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e25eaf-2009-4793-a8eb-500103651054 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:54.483116 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e25eaf-2009-4793-a8eb-500103651054 None admin] PATH_INFO: `/v3/services` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:54.483846 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e25eaf-2009-4793-a8eb-500103651054 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:54.485946 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e25eaf-2009-4793-a8eb-500103651054 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:54.508394 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 455/911] 10.222.0.70 () {60 vars in 1141 bytes} [Mon Jul 11 14:27:54 2022] POST /identity/v3/services => generated 241 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:27:54.611566 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0282bb3b-efa1-4d4d-8db8-8eb215552b4a None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:54.612250 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0282bb3b-efa1-4d4d-8db8-8eb215552b4a None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:54.612763 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0282bb3b-efa1-4d4d-8db8-8eb215552b4a None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:54.614440 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 457/912] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:27:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:27:54.620235 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f421596-fa5d-4ab2-8b12-7a873b5b9044 None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:54.620531 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f421596-fa5d-4ab2-8b12-7a873b5b9044 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:54.620792 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f421596-fa5d-4ab2-8b12-7a873b5b9044 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:54.640846 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-8f421596-fa5d-4ab2-8b12-7a873b5b9044 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:27:54.642097 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-8f421596-fa5d-4ab2-8b12-7a873b5b9044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:27:54.736083 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 456/913] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:27:54 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 14:27:54.759613 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0282bb3b-efa1-4d4d-8db8-8eb215552b4a None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:54.798205 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:54.893247 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0282bb3b-efa1-4d4d-8db8-8eb215552b4a None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:54.954984 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae26bd1-2e80-4e1a-aaab-e0aa73dcae4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:54.955955 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae26bd1-2e80-4e1a-aaab-e0aa73dcae4d None admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:54.956480 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae26bd1-2e80-4e1a-aaab-e0aa73dcae4d None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:54.956868 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae26bd1-2e80-4e1a-aaab-e0aa73dcae4d None admin] PATH_INFO: `/v3/projects` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:54.958120 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae26bd1-2e80-4e1a-aaab-e0aa73dcae4d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:54.961016 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae26bd1-2e80-4e1a-aaab-e0aa73dcae4d None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:54.963641 dv-cinder-master-3-smb devstack@keystone.service[80535]: WARNING keystone.server.flask.common [None req-eae26bd1-2e80-4e1a-aaab-e0aa73dcae4d None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 11 14:27:54.995479 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.sql.core [None req-eae26bd1-2e80-4e1a-aaab-e0aa73dcae4d None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 11 14:27:54.995479 dv-cinder-master-3-smb devstack@keystone.service[80535]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 11 14:27:54.995479 dv-cinder-master-3-smb devstack@keystone.service[80535]: [parameters: {'id': '9af50aedb5494d3088075e32f1228b7c', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 11 14:27:54.995479 dv-cinder-master-3-smb devstack@keystone.service[80535]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80535) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 11 14:27:55.029946 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-eae26bd1-2e80-4e1a-aaab-e0aa73dcae4d None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 9af50aedb5494d3088075e32f1228b7c.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 9af50aedb5494d3088075e32f1228b7c. Jul 11 14:27:55.029946 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:55.029946 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 11 14:27:55.029946 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 11 14:27:55.029946 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 11 14:27:55.029946 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 11 14:27:55.029946 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 11 14:27:55.029946 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application result = self._query(query) Jul 11 14:27:55.029946 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 11 14:27:55.029946 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application conn.query(q) Jul 11 14:27:55.029946 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 11 14:27:55.029946 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 11 14:27:55.029946 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 11 14:27:55.030861 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application result.read() Jul 11 14:27:55.030861 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 11 14:27:55.030861 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 11 14:27:55.030861 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 11 14:27:55.030861 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 11 14:27:55.030861 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 11 14:27:55.030861 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 11 14:27:55.030861 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 11 14:27:55.030861 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 11 14:27:55.030861 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 11 14:27:55.030861 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Jul 11 14:27:55.030861 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 11 14:27:55.030861 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Jul 11 14:27:55.030861 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:55.030861 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 11 14:27:55.030861 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 11 14:27:55.030861 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 11 14:27:55.030861 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 11 14:27:55.032416 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 11 14:27:55.032416 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application next(self.gen) Jul 11 14:27:55.032416 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 11 14:27:55.032416 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application yield resource Jul 11 14:27:55.032416 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 11 14:27:55.032416 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application next(self.gen) Jul 11 14:27:55.032416 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 11 14:27:55.032416 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application self.session.rollback() Jul 11 14:27:55.032416 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 11 14:27:55.032416 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application self.force_reraise() Jul 11 14:27:55.032416 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 11 14:27:55.032416 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise self.value Jul 11 14:27:55.032416 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 11 14:27:55.032416 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 11 14:27:55.032416 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 11 14:27:55.032416 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application session.commit() Jul 11 14:27:55.032416 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 11 14:27:55.033317 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 11 14:27:55.033317 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 11 14:27:55.033317 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application self._prepare_impl() Jul 11 14:27:55.033317 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 11 14:27:55.033317 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application self.session.flush() Jul 11 14:27:55.033317 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 11 14:27:55.033317 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application self._flush(objects) Jul 11 14:27:55.033317 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 11 14:27:55.033317 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 11 14:27:55.033317 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 11 14:27:55.033317 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application compat.raise_( Jul 11 14:27:55.033317 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 11 14:27:55.033317 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception Jul 11 14:27:55.033317 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 11 14:27:55.033317 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application flush_context.execute() Jul 11 14:27:55.033317 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 11 14:27:55.033317 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rec.execute(self) Jul 11 14:27:55.034200 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 11 14:27:55.034200 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 11 14:27:55.034200 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 11 14:27:55.034200 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 11 14:27:55.034200 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 11 14:27:55.034200 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 11 14:27:55.034200 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 11 14:27:55.034200 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 11 14:27:55.034200 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 11 14:27:55.034200 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 11 14:27:55.034200 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 11 14:27:55.034200 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 11 14:27:55.034200 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 11 14:27:55.034200 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 11 14:27:55.034200 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 11 14:27:55.034991 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 11 14:27:55.034991 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 11 14:27:55.034991 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception Jul 11 14:27:55.034991 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 11 14:27:55.034991 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 11 14:27:55.034991 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 11 14:27:55.034991 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 11 14:27:55.034991 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 11 14:27:55.034991 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application result = self._query(query) Jul 11 14:27:55.034991 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 11 14:27:55.034991 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application conn.query(q) Jul 11 14:27:55.034991 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 11 14:27:55.034991 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 11 14:27:55.034991 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 11 14:27:55.034991 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application result.read() Jul 11 14:27:55.034991 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 11 14:27:55.034991 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 11 14:27:55.035845 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 11 14:27:55.035845 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 11 14:27:55.035845 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 11 14:27:55.035845 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 11 14:27:55.035845 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 11 14:27:55.035845 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 11 14:27:55.035845 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 11 14:27:55.035845 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 11 14:27:55.035845 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [parameters: {'id': '9af50aedb5494d3088075e32f1228b7c', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 11 14:27:55.035845 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 11 14:27:55.035845 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Jul 11 14:27:55.035845 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 14:27:55.035845 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Jul 11 14:27:55.035845 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:55.035845 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 11 14:27:55.036904 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 11 14:27:55.036904 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 11 14:27:55.036904 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 11 14:27:55.036904 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 11 14:27:55.036904 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Jul 11 14:27:55.036904 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 14:27:55.036904 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Jul 11 14:27:55.036904 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:55.036904 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:55.036904 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:55.036904 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:55.036904 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:55.036904 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:55.036904 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:55.036904 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:55.036904 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:55.036904 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:55.038026 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:55.038026 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 11 14:27:55.038026 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 11 14:27:55.038026 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:55.038026 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:55.038026 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 11 14:27:55.038026 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 11 14:27:55.038026 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 9af50aedb5494d3088075e32f1228b7c. Jul 11 14:27:55.038026 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Jul 11 14:27:55.038026 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 458/914] 10.222.0.70 () {60 vars in 1140 bytes} [Mon Jul 11 14:27:54 2022] POST /identity/v3/projects => generated 262 bytes in 274 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:27:55.044253 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f421596-fa5d-4ab2-8b12-7a873b5b9044 None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:55.133166 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:55.147606 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef2838d-901b-4ac6-9a8d-2abf22036acf None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:55.148276 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef2838d-901b-4ac6-9a8d-2abf22036acf None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:55.148276 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef2838d-901b-4ac6-9a8d-2abf22036acf None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:55.155976 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f421596-fa5d-4ab2-8b12-7a873b5b9044 None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:55.159096 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 459/915] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:27:55 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 14:27:55.160750 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e820f5-1061-4290-9c92-ee6cdeb39338 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:55.161042 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e820f5-1061-4290-9c92-ee6cdeb39338 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:55.161318 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e820f5-1061-4290-9c92-ee6cdeb39338 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:55.181097 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-83e820f5-1061-4290-9c92-ee6cdeb39338 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:27:55.182718 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-83e820f5-1061-4290-9c92-ee6cdeb39338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:27:55.194955 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdbd68f-14a7-4cda-a724-97588f1cbec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:55.196112 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdbd68f-14a7-4cda-a724-97588f1cbec6 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:55.196558 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdbd68f-14a7-4cda-a724-97588f1cbec6 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:55.196903 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdbd68f-14a7-4cda-a724-97588f1cbec6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:55.209698 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdbd68f-14a7-4cda-a724-97588f1cbec6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:55.211389 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdbd68f-14a7-4cda-a724-97588f1cbec6 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:55.238754 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application [None req-dcdbd68f-14a7-4cda-a724-97588f1cbec6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:27:55.238754 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:55.238754 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:55.238754 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:55.238754 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:55.238754 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:55.238754 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:55.238754 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:55.238754 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:55.238754 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:55.238754 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:55.238754 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:55.238754 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 14:27:55.238754 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 14:27:55.238754 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 14:27:55.240915 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 14:27:55.240915 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:55.240915 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:55.240915 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:55.240915 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:55.240915 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:55.240915 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:55.240915 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:55.240915 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:55.240915 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:55.240915 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:55.240915 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:55.240915 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:55.240915 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:55.240915 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:55.240915 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:55.240915 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:55.243038 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 14:27:55.243038 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 14:27:55.243038 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 14:27:55.243038 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 14:27:55.243038 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 14:27:55.243038 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 14:27:55.243038 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:27:55.243038 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Jul 11 14:27:55.243038 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 457/916] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Jul 11 14:27:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:27:55.248089 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdbd68f-14a7-4cda-a724-97588f1cbec6 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:55.268426 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 460/917] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:27:55 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 14:27:55.287210 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e820f5-1061-4290-9c92-ee6cdeb39338 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:55.315136 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:55.458523 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdbd68f-14a7-4cda-a724-97588f1cbec6 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:55.466492 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e820f5-1061-4290-9c92-ee6cdeb39338 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:55.509171 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6195f153-6426-4111-872a-0d8cd308a8d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:55.510255 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6195f153-6426-4111-872a-0d8cd308a8d6 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:55.510761 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6195f153-6426-4111-872a-0d8cd308a8d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:55.511420 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6195f153-6426-4111-872a-0d8cd308a8d6 None admin] PATH_INFO: `/v3/projects` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:55.513051 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6195f153-6426-4111-872a-0d8cd308a8d6 None admin] RBAC: Adding query filter params (name=service) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:55.513617 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6195f153-6426-4111-872a-0d8cd308a8d6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:55.517710 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6195f153-6426-4111-872a-0d8cd308a8d6 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:55.521490 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057e9d88-4419-479e-a675-6184b792700b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:55.522351 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057e9d88-4419-479e-a675-6184b792700b None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:55.522633 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057e9d88-4419-479e-a675-6184b792700b None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:55.522907 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057e9d88-4419-479e-a675-6184b792700b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:55.538420 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057e9d88-4419-479e-a675-6184b792700b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:27:55.550597 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 458/918] 10.222.0.70 () {56 vars in 1112 bytes} [Mon Jul 11 14:27:55 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:27:55.550597 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1490b4ec-bb4c-4a41-9f35-bb372161547f None None] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:55.550597 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1490b4ec-bb4c-4a41-9f35-bb372161547f None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:55.550597 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1490b4ec-bb4c-4a41-9f35-bb372161547f None None] PATH_INFO: `/` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:55.550597 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 459/919] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:27:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:27:55.559180 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-057e9d88-4419-479e-a675-6184b792700b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 11 14:27:55.559180 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:55.559180 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:55.559180 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:55.559180 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:55.559180 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:55.559180 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:55.559180 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:55.559180 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:55.559180 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:55.559180 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:55.559180 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:55.559180 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:27:55.559180 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:27:55.559180 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:27:55.559180 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:27:55.560373 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:27:55.560373 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:27:55.560373 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:27:55.560373 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:27:55.560373 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:55.560373 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:55.560373 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:55.560373 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:55.560373 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:55.560373 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:55.560373 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:55.560373 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:55.560373 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:55.560373 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:55.560373 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:55.560373 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:55.561255 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:55.561255 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:55.561255 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:55.561255 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:55.561255 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:27:55.561255 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:27:55.561255 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:27:55.561255 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:27:55.561255 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:27:55.561255 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:27:55.561255 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 11 14:27:55.561255 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Jul 11 14:27:55.561918 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84ff67c-f195-4e4a-a390-c4c80f00d319 None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:55.561918 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84ff67c-f195-4e4a-a390-c4c80f00d319 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:55.561918 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84ff67c-f195-4e4a-a390-c4c80f00d319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:55.569551 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 461/920] 10.222.0.70 () {56 vars in 1120 bytes} [Mon Jul 11 14:27:55 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:27:55.575152 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:55.577471 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057e9d88-4419-479e-a675-6184b792700b None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:55.603862 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-e84ff67c-f195-4e4a-a390-c4c80f00d319 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:27:55.606595 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-e84ff67c-f195-4e4a-a390-c4c80f00d319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:27:55.722686 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:55.730721 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 460/921] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:27:55 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:27:55.754434 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84ff67c-f195-4e4a-a390-c4c80f00d319 None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:55.756449 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057e9d88-4419-479e-a675-6184b792700b None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:55.809234 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a29562-6ca3-4a32-8925-1c771c7d21c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:55.809983 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a29562-6ca3-4a32-8925-1c771c7d21c4 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:55.810348 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a29562-6ca3-4a32-8925-1c771c7d21c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:55.810643 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a29562-6ca3-4a32-8925-1c771c7d21c4 None admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:55.811423 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a29562-6ca3-4a32-8925-1c771c7d21c4 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:55.811989 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a29562-6ca3-4a32-8925-1c771c7d21c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:55.814485 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a29562-6ca3-4a32-8925-1c771c7d21c4 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:55.828638 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 462/922] 10.222.0.70 () {56 vars in 1115 bytes} [Mon Jul 11 14:27:55 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:55.833058 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a29562-6ca3-4a32-8925-1c771c7d21c4 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:55.912864 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84ff67c-f195-4e4a-a390-c4c80f00d319 None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:55.964472 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc2cecd-9b80-4960-bf6d-b762206e4eaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:55.965578 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc2cecd-9b80-4960-bf6d-b762206e4eaa None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:55.965869 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc2cecd-9b80-4960-bf6d-b762206e4eaa None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:55.966150 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc2cecd-9b80-4960-bf6d-b762206e4eaa None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:55.967315 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc2cecd-9b80-4960-bf6d-b762206e4eaa None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:55.969693 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc2cecd-9b80-4960-bf6d-b762206e4eaa None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:55.971650 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a29562-6ca3-4a32-8925-1c771c7d21c4 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:55.981694 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:55.988514 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application [None req-adc2cecd-9b80-4960-bf6d-b762206e4eaa None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 11 14:27:55.988514 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:55.988514 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 14:27:55.988514 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 14:27:55.988514 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 14:27:55.988514 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 14:27:55.988514 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 14:27:55.988514 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:27:55.988514 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 11 14:27:55.988514 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Jul 11 14:27:55.988514 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 14:27:55.988514 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Jul 11 14:27:55.988514 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:55.988514 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:55.988514 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:55.988514 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:55.989644 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:55.989644 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:55.989644 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:55.989644 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:55.989644 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:55.989644 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:55.989644 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:55.989644 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 14:27:55.989644 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 14:27:55.989644 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 14:27:55.989644 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 14:27:55.989644 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:55.989644 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:55.989644 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:55.989644 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:55.989644 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:55.990472 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:55.990472 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:55.990472 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:55.990472 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:55.990472 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:55.990472 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:55.990472 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:55.990472 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:55.990472 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:55.990472 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:55.990472 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:55.990472 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 14:27:55.990472 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:27:55.990472 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 11 14:27:55.990472 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Jul 11 14:27:55.994230 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 461/923] 10.222.0.70 () {56 vars in 1132 bytes} [Mon Jul 11 14:27:55 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:27:56.003950 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc2cecd-9b80-4960-bf6d-b762206e4eaa None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:56.022442 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28834c2-2689-4986-85bc-96bd6747c541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:56.023253 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28834c2-2689-4986-85bc-96bd6747c541 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:56.023542 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28834c2-2689-4986-85bc-96bd6747c541 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:56.023821 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28834c2-2689-4986-85bc-96bd6747c541 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:56.036610 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:56.039062 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28834c2-2689-4986-85bc-96bd6747c541 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:56.040991 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28834c2-2689-4986-85bc-96bd6747c541 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:56.061880 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-d28834c2-2689-4986-85bc-96bd6747c541 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:27:56.061880 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:56.061880 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:56.061880 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:56.061880 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:56.061880 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:56.061880 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:56.061880 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:56.061880 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:56.061880 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:56.061880 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:56.061880 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:56.061880 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:27:56.061880 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:27:56.061880 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:27:56.063452 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:27:56.063452 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:56.063452 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:56.063452 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:56.063452 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:56.063452 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:56.063452 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:56.063452 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:56.063452 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:56.063452 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:56.063452 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:56.063452 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:56.063452 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:56.063452 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:56.063452 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:56.063452 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:56.063452 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:56.064424 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:27:56.064424 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:27:56.064424 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:27:56.064424 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Jul 11 14:27:56.064424 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 463/924] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 11 14:27:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:27:56.069579 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28834c2-2689-4986-85bc-96bd6747c541 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:56.160144 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc2cecd-9b80-4960-bf6d-b762206e4eaa None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:56.215519 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953369ca-8635-4743-8036-6dfd1820bbf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:56.216696 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953369ca-8635-4743-8036-6dfd1820bbf7 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:56.217199 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953369ca-8635-4743-8036-6dfd1820bbf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:56.217701 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953369ca-8635-4743-8036-6dfd1820bbf7 None admin] PATH_INFO: `/v3/services` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:56.219334 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28834c2-2689-4986-85bc-96bd6747c541 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:56.219830 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953369ca-8635-4743-8036-6dfd1820bbf7 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:56.220231 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953369ca-8635-4743-8036-6dfd1820bbf7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:56.222600 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953369ca-8635-4743-8036-6dfd1820bbf7 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:56.232411 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 462/925] 10.222.0.70 () {56 vars in 1126 bytes} [Mon Jul 11 14:27:55 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:27:56.242250 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953369ca-8635-4743-8036-6dfd1820bbf7 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:56.285849 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0f0d1b-1fba-4441-8c3b-f8e392bd1fd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:56.287040 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0f0d1b-1fba-4441-8c3b-f8e392bd1fd6 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:56.287551 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0f0d1b-1fba-4441-8c3b-f8e392bd1fd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:56.288050 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0f0d1b-1fba-4441-8c3b-f8e392bd1fd6 None admin] PATH_INFO: `/v3/domains` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:56.289547 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0f0d1b-1fba-4441-8c3b-f8e392bd1fd6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:56.289985 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0f0d1b-1fba-4441-8c3b-f8e392bd1fd6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:56.292602 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0f0d1b-1fba-4441-8c3b-f8e392bd1fd6 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:56.322731 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 464/926] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jul 11 14:27:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:27:56.324691 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0f0d1b-1fba-4441-8c3b-f8e392bd1fd6 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:56.347687 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:56.411432 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953369ca-8635-4743-8036-6dfd1820bbf7 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:56.440847 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:56.464121 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad1daa8-c7cd-4c19-abf7-37eabf93d9ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:56.465275 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad1daa8-c7cd-4c19-abf7-37eabf93d9ec None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:56.465759 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad1daa8-c7cd-4c19-abf7-37eabf93d9ec None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:56.466182 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad1daa8-c7cd-4c19-abf7-37eabf93d9ec None admin] PATH_INFO: `/v3/services` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:56.467313 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad1daa8-c7cd-4c19-abf7-37eabf93d9ec None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:56.467843 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad1daa8-c7cd-4c19-abf7-37eabf93d9ec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:56.470042 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad1daa8-c7cd-4c19-abf7-37eabf93d9ec None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:56.484794 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 463/927] 10.222.0.70 () {56 vars in 1126 bytes} [Mon Jul 11 14:27:56 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:56.489271 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad1daa8-c7cd-4c19-abf7-37eabf93d9ec None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:56.535842 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0f0d1b-1fba-4441-8c3b-f8e392bd1fd6 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:56.591913 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82713c6e-4491-4e9f-ab84-ad315b95257e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:56.593124 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82713c6e-4491-4e9f-ab84-ad315b95257e None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:56.593738 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82713c6e-4491-4e9f-ab84-ad315b95257e None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:56.594216 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82713c6e-4491-4e9f-ab84-ad315b95257e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:56.604111 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82713c6e-4491-4e9f-ab84-ad315b95257e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:56.606211 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82713c6e-4491-4e9f-ab84-ad315b95257e None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:56.626223 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-82713c6e-4491-4e9f-ab84-ad315b95257e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 11 14:27:56.626223 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:56.626223 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:56.626223 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:56.626223 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:56.626223 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:56.626223 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:56.626223 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:56.626223 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:56.626223 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:56.626223 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:56.626223 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:56.626223 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 14:27:56.626223 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 14:27:56.626223 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 14:27:56.626223 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 14:27:56.627305 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:56.627305 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:56.627305 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 14:27:56.627305 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:27:56.627305 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 14:27:56.627305 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:27:56.627305 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:56.627305 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:56.627305 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:56.627305 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:56.627305 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:56.627305 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:56.627305 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:56.627305 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:56.627305 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:56.627305 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:56.627305 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:56.627305 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:56.628255 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:56.628255 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:56.628255 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 14:27:56.628255 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 14:27:56.628255 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 14:27:56.628255 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 14:27:56.628255 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 14:27:56.628255 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 14:27:56.628255 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 11 14:27:56.628255 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Jul 11 14:27:56.630660 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 465/928] 10.222.0.70 () {56 vars in 1117 bytes} [Mon Jul 11 14:27:56 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:27:56.638322 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82713c6e-4491-4e9f-ab84-ad315b95257e None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:56.687136 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad1daa8-c7cd-4c19-abf7-37eabf93d9ec None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:56.725468 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:56.742966 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e923933-9fb5-4418-84b6-c867de8c08c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:56.744283 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e923933-9fb5-4418-84b6-c867de8c08c8 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:56.744903 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e923933-9fb5-4418-84b6-c867de8c08c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:56.746189 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e923933-9fb5-4418-84b6-c867de8c08c8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:56.747327 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e923933-9fb5-4418-84b6-c867de8c08c8 None admin] RBAC: Adding query filter params (interface=public, service_id=9ed1d606b68742be827291c978488c24, region_id=RegionOne) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:56.748294 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e923933-9fb5-4418-84b6-c867de8c08c8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:56.751211 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e923933-9fb5-4418-84b6-c867de8c08c8 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:56.764261 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 464/929] 10.222.0.70 () {56 vars in 1251 bytes} [Mon Jul 11 14:27:56 2022] GET /identity/v3/endpoints?service_id=9ed1d606b68742be827291c978488c24&interface=public®ion_id=RegionOne => generated 194 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:56.773849 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e923933-9fb5-4418-84b6-c867de8c08c8 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:56.826713 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82713c6e-4491-4e9f-ab84-ad315b95257e None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:56.842758 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:56.870780 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f23dd0-3b68-4db7-8d42-97187d04e666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:56.871501 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f23dd0-3b68-4db7-8d42-97187d04e666 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:56.871784 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f23dd0-3b68-4db7-8d42-97187d04e666 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:56.872093 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f23dd0-3b68-4db7-8d42-97187d04e666 None admin] PATH_INFO: `/v3/users` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:56.873014 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f23dd0-3b68-4db7-8d42-97187d04e666 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:56.873323 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f23dd0-3b68-4db7-8d42-97187d04e666 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:56.874953 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f23dd0-3b68-4db7-8d42-97187d04e666 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:56.900273 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 466/930] 10.222.0.70 () {56 vars in 1149 bytes} [Mon Jul 11 14:27:56 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:56.900273 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bac24e-b39a-417e-a5d3-47b99777fd8c None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:56.900273 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bac24e-b39a-417e-a5d3-47b99777fd8c None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:56.900782 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bac24e-b39a-417e-a5d3-47b99777fd8c None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:56.907020 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 467/931] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:27:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:27:56.907020 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bac24e-b39a-417e-a5d3-47b99777fd8c None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:56.941294 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e923933-9fb5-4418-84b6-c867de8c08c8 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:56.990020 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9afe58d-ad61-4be9-a990-aa45d22803e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:56.990749 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9afe58d-ad61-4be9-a990-aa45d22803e0 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:56.991033 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9afe58d-ad61-4be9-a990-aa45d22803e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:56.991308 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9afe58d-ad61-4be9-a990-aa45d22803e0 None admin] PATH_INFO: `/v3/services` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:56.992050 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9afe58d-ad61-4be9-a990-aa45d22803e0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:56.993493 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9afe58d-ad61-4be9-a990-aa45d22803e0 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:57.008249 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 465/932] 10.222.0.70 () {56 vars in 1087 bytes} [Mon Jul 11 14:27:56 2022] GET /identity/v3/services => generated 1497 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:27:57.008249 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce32516-b306-4cb8-ac96-84053144c014 None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:57.008249 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce32516-b306-4cb8-ac96-84053144c014 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:57.008249 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce32516-b306-4cb8-ac96-84053144c014 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:57.026913 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-bce32516-b306-4cb8-ac96-84053144c014 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:27:57.028231 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-bce32516-b306-4cb8-ac96-84053144c014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:27:57.083835 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bac24e-b39a-417e-a5d3-47b99777fd8c None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:57.096801 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:57.136055 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf38025-3312-4b18-bf4b-74946eebae97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:57.137153 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf38025-3312-4b18-bf4b-74946eebae97 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:57.137647 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf38025-3312-4b18-bf4b-74946eebae97 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:57.138116 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf38025-3312-4b18-bf4b-74946eebae97 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:57.148748 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 466/933] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:27:57 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:27:57.154645 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf38025-3312-4b18-bf4b-74946eebae97 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:57.157796 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf38025-3312-4b18-bf4b-74946eebae97 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:57.180560 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-ccf38025-3312-4b18-bf4b-74946eebae97 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:27:57.180560 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:57.180560 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:57.180560 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:57.180560 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:57.180560 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:57.180560 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:57.180560 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:57.180560 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:57.180560 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:57.180560 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:57.180560 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:57.180560 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:27:57.180560 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:27:57.180560 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:27:57.181776 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:27:57.181776 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:57.181776 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:57.181776 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:57.181776 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:57.181776 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:57.181776 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:57.181776 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:57.181776 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:57.181776 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:57.181776 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:57.181776 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:57.181776 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:57.181776 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:57.181776 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:57.181776 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:57.181776 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:57.182642 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:27:57.182642 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:27:57.182642 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:27:57.182642 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Jul 11 14:27:57.182881 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce32516-b306-4cb8-ac96-84053144c014 None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:57.187079 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 468/934] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 11 14:27:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:27:57.189833 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf38025-3312-4b18-bf4b-74946eebae97 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:57.220590 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:57.338611 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf38025-3312-4b18-bf4b-74946eebae97 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:57.362562 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce32516-b306-4cb8-ac96-84053144c014 None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:57.386701 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d912d71-9ee5-4f0d-96bc-7efe2823c393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:57.387683 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d912d71-9ee5-4f0d-96bc-7efe2823c393 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:57.387971 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d912d71-9ee5-4f0d-96bc-7efe2823c393 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:57.388272 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d912d71-9ee5-4f0d-96bc-7efe2823c393 None admin] PATH_INFO: `/v3/domains` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:57.389574 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d912d71-9ee5-4f0d-96bc-7efe2823c393 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:57.389892 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d912d71-9ee5-4f0d-96bc-7efe2823c393 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:57.391964 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d912d71-9ee5-4f0d-96bc-7efe2823c393 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:57.411621 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 469/935] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jul 11 14:27:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:57.414976 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d912d71-9ee5-4f0d-96bc-7efe2823c393 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:57.431754 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b78bbe-1dbb-4594-9294-c05b0e58eb38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:57.432663 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b78bbe-1dbb-4594-9294-c05b0e58eb38 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:57.432947 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b78bbe-1dbb-4594-9294-c05b0e58eb38 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:57.433224 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b78bbe-1dbb-4594-9294-c05b0e58eb38 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:57.434464 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b78bbe-1dbb-4594-9294-c05b0e58eb38 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:57.435878 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b78bbe-1dbb-4594-9294-c05b0e58eb38 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:57.452088 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application [None req-91b78bbe-1dbb-4594-9294-c05b0e58eb38 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 11 14:27:57.452088 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:57.452088 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 14:27:57.452088 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 14:27:57.452088 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 14:27:57.452088 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 14:27:57.452088 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 14:27:57.452088 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:27:57.452088 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 11 14:27:57.452088 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Jul 11 14:27:57.452088 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 14:27:57.452088 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Jul 11 14:27:57.452088 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:57.452088 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:57.452088 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:57.452088 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:57.452088 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:57.453231 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:57.453231 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:57.453231 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:57.453231 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:57.453231 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:57.453231 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:57.453231 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 14:27:57.453231 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 14:27:57.453231 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 14:27:57.453231 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 14:27:57.453231 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:57.453231 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:57.453231 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:57.453231 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:57.453231 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:57.453231 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:57.454069 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:57.454069 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:57.454069 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:57.454069 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:57.454069 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:57.454069 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:57.454069 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:57.454069 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:57.454069 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:57.454069 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:57.454069 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 14:27:57.454069 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:27:57.454069 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 11 14:27:57.454069 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Jul 11 14:27:57.455351 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 467/936] 10.222.0.70 () {56 vars in 1126 bytes} [Mon Jul 11 14:27:57 2022] GET /identity/v3/services/object-store => generated 93 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:27:57.464992 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b78bbe-1dbb-4594-9294-c05b0e58eb38 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:57.562907 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:57.566750 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:57.592362 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d912d71-9ee5-4f0d-96bc-7efe2823c393 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:57.632530 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8e65b5-cdf4-4f95-802c-a1cb23612eb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:57.633519 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8e65b5-cdf4-4f95-802c-a1cb23612eb9 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:57.633908 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8e65b5-cdf4-4f95-802c-a1cb23612eb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:57.634287 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8e65b5-cdf4-4f95-802c-a1cb23612eb9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:57.635143 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b78bbe-1dbb-4594-9294-c05b0e58eb38 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:57.643715 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8e65b5-cdf4-4f95-802c-a1cb23612eb9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:57.645613 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8e65b5-cdf4-4f95-802c-a1cb23612eb9 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:57.664181 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-6b8e65b5-cdf4-4f95-802c-a1cb23612eb9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:27:57.664181 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:57.664181 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:57.664181 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:57.664181 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:57.664181 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:57.664181 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:57.664181 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:57.664181 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:57.664181 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:57.664181 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:57.664181 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:57.664181 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 14:27:57.664181 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 14:27:57.664181 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 14:27:57.666269 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 14:27:57.666269 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:57.666269 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:57.666269 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:57.666269 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:57.666269 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:57.666269 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:57.666269 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:57.666269 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:57.666269 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:57.666269 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:57.666269 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:57.666269 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:57.666269 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:57.666269 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:57.666269 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:57.666269 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:57.667755 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 14:27:57.667755 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 14:27:57.667755 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 14:27:57.667755 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 14:27:57.667755 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 14:27:57.667755 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 14:27:57.667755 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:27:57.667755 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Jul 11 14:27:57.672437 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 470/937] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Jul 11 14:27:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:27:57.675377 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8e65b5-cdf4-4f95-802c-a1cb23612eb9 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:57.679251 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bac1fed-ec2e-4492-98af-5118a168dee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:57.680073 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bac1fed-ec2e-4492-98af-5118a168dee2 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:57.680308 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bac1fed-ec2e-4492-98af-5118a168dee2 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:57.680530 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bac1fed-ec2e-4492-98af-5118a168dee2 None admin] PATH_INFO: `/v3/services` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:57.681538 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bac1fed-ec2e-4492-98af-5118a168dee2 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:57.681842 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bac1fed-ec2e-4492-98af-5118a168dee2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:57.683973 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bac1fed-ec2e-4492-98af-5118a168dee2 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:57.690509 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 468/938] 10.222.0.70 () {56 vars in 1122 bytes} [Mon Jul 11 14:27:57 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:57.699867 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bac1fed-ec2e-4492-98af-5118a168dee2 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:57.835270 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8e65b5-cdf4-4f95-802c-a1cb23612eb9 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:57.861191 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bac1fed-ec2e-4492-98af-5118a168dee2 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:57.874211 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:57.878337 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf73d4f-76b0-4c0b-8082-181827dd6ff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:57.879075 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf73d4f-76b0-4c0b-8082-181827dd6ff8 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:57.879357 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf73d4f-76b0-4c0b-8082-181827dd6ff8 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:57.879634 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf73d4f-76b0-4c0b-8082-181827dd6ff8 None admin] PATH_INFO: `/v3/projects` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:57.880468 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf73d4f-76b0-4c0b-8082-181827dd6ff8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:57.880785 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf73d4f-76b0-4c0b-8082-181827dd6ff8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:57.882248 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf73d4f-76b0-4c0b-8082-181827dd6ff8 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:57.896160 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 471/939] 10.222.0.70 () {56 vars in 1148 bytes} [Mon Jul 11 14:27:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:57.897714 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defb2de7-3be5-4f82-9704-cd30e2eb5b92 None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:57.898000 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defb2de7-3be5-4f82-9704-cd30e2eb5b92 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:57.898281 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defb2de7-3be5-4f82-9704-cd30e2eb5b92 None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:57.899805 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 472/940] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:27:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:27:57.904465 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defb2de7-3be5-4f82-9704-cd30e2eb5b92 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:57.909400 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:57.923937 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c979ec-7567-418e-8d16-882329a15cd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:57.925182 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c979ec-7567-418e-8d16-882329a15cd3 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:57.925671 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c979ec-7567-418e-8d16-882329a15cd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:57.926176 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c979ec-7567-418e-8d16-882329a15cd3 None admin] PATH_INFO: `/v3/services` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:57.927607 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c979ec-7567-418e-8d16-882329a15cd3 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:57.928135 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c979ec-7567-418e-8d16-882329a15cd3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:57.930657 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c979ec-7567-418e-8d16-882329a15cd3 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:57.945463 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 469/941] 10.222.0.70 () {56 vars in 1122 bytes} [Mon Jul 11 14:27:57 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:57.945463 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca653bfc-a62a-4de5-bde3-aaed3028d50c None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:57.945463 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca653bfc-a62a-4de5-bde3-aaed3028d50c None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:57.945463 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca653bfc-a62a-4de5-bde3-aaed3028d50c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:57.971545 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-ca653bfc-a62a-4de5-bde3-aaed3028d50c None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:27:57.973530 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-ca653bfc-a62a-4de5-bde3-aaed3028d50c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:27:58.072995 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defb2de7-3be5-4f82-9704-cd30e2eb5b92 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:58.104268 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 470/942] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:27:57 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:27:58.104268 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca653bfc-a62a-4de5-bde3-aaed3028d50c None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:58.127905 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d34cc05-1717-4c66-8a31-7b92a308b902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:58.129470 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d34cc05-1717-4c66-8a31-7b92a308b902 None admin] REQUEST_METHOD: `PUT` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:58.129995 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d34cc05-1717-4c66-8a31-7b92a308b902 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:58.130482 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d34cc05-1717-4c66-8a31-7b92a308b902 None admin] PATH_INFO: `/v3/projects/ccd34295bf7b435a96b37487c8e89fc3/users/2ef7b195b623456aa0b12dac0a4bf4d3/roles/c6848bb77ffc4294ab0b88315a5dc1e1` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:58.134597 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d34cc05-1717-4c66-8a31-7b92a308b902 None admin] RBAC: Authorizing `identity:create_grant(project_id=ccd34295bf7b435a96b37487c8e89fc3, user_id=2ef7b195b623456aa0b12dac0a4bf4d3, role_id=c6848bb77ffc4294ab0b88315a5dc1e1)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:58.137185 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d34cc05-1717-4c66-8a31-7b92a308b902 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:58.163440 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 473/943] 10.222.0.70 () {58 vars in 1439 bytes} [Mon Jul 11 14:27:57 2022] PUT /identity/v3/projects/ccd34295bf7b435a96b37487c8e89fc3/users/2ef7b195b623456aa0b12dac0a4bf4d3/roles/c6848bb77ffc4294ab0b88315a5dc1e1 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:27:58.164882 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d34cc05-1717-4c66-8a31-7b92a308b902 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:58.254227 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:58.283959 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca653bfc-a62a-4de5-bde3-aaed3028d50c None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:58.287848 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:58.309618 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d34cc05-1717-4c66-8a31-7b92a308b902 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:58.330602 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ccd796-c571-46be-9dd5-de63ca7fd5d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:58.331458 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ccd796-c571-46be-9dd5-de63ca7fd5d9 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:58.331847 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ccd796-c571-46be-9dd5-de63ca7fd5d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:58.332233 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ccd796-c571-46be-9dd5-de63ca7fd5d9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:58.333127 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ccd796-c571-46be-9dd5-de63ca7fd5d9 None admin] RBAC: Adding query filter params (interface=public, service_id=18d3001dbca94232810e962459c76f7b, region_id=RegionOne) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:58.333515 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ccd796-c571-46be-9dd5-de63ca7fd5d9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:58.335061 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ccd796-c571-46be-9dd5-de63ca7fd5d9 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:58.341535 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 471/944] 10.222.0.70 () {56 vars in 1251 bytes} [Mon Jul 11 14:27:58 2022] GET /identity/v3/endpoints?service_id=18d3001dbca94232810e962459c76f7b&interface=public®ion_id=RegionOne => generated 194 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:58.348868 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ccd796-c571-46be-9dd5-de63ca7fd5d9 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:58.359962 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcda30f-9e8d-4de2-ae02-c33477cdc572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:58.360732 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcda30f-9e8d-4de2-ae02-c33477cdc572 None admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:58.361018 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcda30f-9e8d-4de2-ae02-c33477cdc572 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:58.361300 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcda30f-9e8d-4de2-ae02-c33477cdc572 None admin] PATH_INFO: `/v3/users` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:58.362114 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcda30f-9e8d-4de2-ae02-c33477cdc572 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:58.364491 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcda30f-9e8d-4de2-ae02-c33477cdc572 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:58.387240 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.sql.core [None req-efcda30f-9e8d-4de2-ae02-c33477cdc572 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 11 14:27:58.387240 dv-cinder-master-3-smb devstack@keystone.service[80535]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 11 14:27:58.387240 dv-cinder-master-3-smb devstack@keystone.service[80535]: [parameters: {'user_id': 'e5699c08896f4fb0872f8f527444204c', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 11 14:27:58.387240 dv-cinder-master-3-smb devstack@keystone.service[80535]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80535) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 11 14:27:58.394929 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-efcda30f-9e8d-4de2-ae02-c33477cdc572 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 11 14:27:58.394929 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:58.394929 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 11 14:27:58.394929 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 11 14:27:58.394929 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 11 14:27:58.394929 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 11 14:27:58.394929 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 11 14:27:58.394929 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application result = self._query(query) Jul 11 14:27:58.394929 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 11 14:27:58.394929 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application conn.query(q) Jul 11 14:27:58.394929 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 11 14:27:58.394929 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 11 14:27:58.394929 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 11 14:27:58.394929 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application result.read() Jul 11 14:27:58.394929 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 11 14:27:58.395967 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 11 14:27:58.395967 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 11 14:27:58.395967 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 11 14:27:58.395967 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 11 14:27:58.395967 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 11 14:27:58.395967 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 11 14:27:58.395967 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 11 14:27:58.395967 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 11 14:27:58.395967 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Jul 11 14:27:58.395967 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 11 14:27:58.395967 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Jul 11 14:27:58.395967 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:58.395967 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 11 14:27:58.395967 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 11 14:27:58.395967 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 11 14:27:58.395967 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 11 14:27:58.395967 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 11 14:27:58.395967 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application next(self.gen) Jul 11 14:27:58.397341 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 11 14:27:58.397341 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application yield resource Jul 11 14:27:58.397341 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 11 14:27:58.397341 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application next(self.gen) Jul 11 14:27:58.397341 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 11 14:27:58.397341 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application self.session.rollback() Jul 11 14:27:58.397341 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 11 14:27:58.397341 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application self.force_reraise() Jul 11 14:27:58.397341 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 11 14:27:58.397341 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise self.value Jul 11 14:27:58.397341 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 11 14:27:58.397341 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 11 14:27:58.397341 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 11 14:27:58.397341 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application session.commit() Jul 11 14:27:58.397341 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 11 14:27:58.397341 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 11 14:27:58.397341 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 11 14:27:58.398537 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application self._prepare_impl() Jul 11 14:27:58.398537 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 11 14:27:58.398537 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application self.session.flush() Jul 11 14:27:58.398537 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 11 14:27:58.398537 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application self._flush(objects) Jul 11 14:27:58.398537 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 11 14:27:58.398537 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 11 14:27:58.398537 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 11 14:27:58.398537 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application compat.raise_( Jul 11 14:27:58.398537 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 11 14:27:58.398537 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception Jul 11 14:27:58.398537 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 11 14:27:58.398537 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application flush_context.execute() Jul 11 14:27:58.398537 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 11 14:27:58.398537 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rec.execute(self) Jul 11 14:27:58.398537 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 11 14:27:58.398537 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 11 14:27:58.399400 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 11 14:27:58.399400 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 11 14:27:58.399400 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 11 14:27:58.399400 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 11 14:27:58.399400 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 11 14:27:58.399400 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 11 14:27:58.399400 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 11 14:27:58.399400 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 11 14:27:58.399400 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 11 14:27:58.399400 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 11 14:27:58.399400 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 11 14:27:58.399400 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 11 14:27:58.399400 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 11 14:27:58.399400 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 11 14:27:58.399400 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 11 14:27:58.399400 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception Jul 11 14:27:58.402167 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 11 14:27:58.402167 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 11 14:27:58.402167 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 11 14:27:58.402167 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 11 14:27:58.402167 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 11 14:27:58.402167 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application result = self._query(query) Jul 11 14:27:58.402167 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 11 14:27:58.402167 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application conn.query(q) Jul 11 14:27:58.402167 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 11 14:27:58.402167 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 11 14:27:58.402167 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 11 14:27:58.402167 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application result.read() Jul 11 14:27:58.402167 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 11 14:27:58.402167 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 11 14:27:58.402167 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 11 14:27:58.402167 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 11 14:27:58.404245 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 11 14:27:58.404245 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 11 14:27:58.404245 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 11 14:27:58.404245 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 11 14:27:58.404245 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 11 14:27:58.404245 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 11 14:27:58.404245 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [parameters: {'user_id': 'e5699c08896f4fb0872f8f527444204c', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 11 14:27:58.404245 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 11 14:27:58.404245 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Jul 11 14:27:58.404245 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 14:27:58.404245 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Jul 11 14:27:58.404245 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:58.404245 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:58.404245 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:58.404245 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:58.406310 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:58.406310 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:58.406310 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:58.406310 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:58.406310 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:58.406310 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:58.406310 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:58.406310 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 11 14:27:58.406310 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 11 14:27:58.406310 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:58.406310 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:58.406310 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 14:27:58.406310 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:27:58.406310 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 14:27:58.406310 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:27:58.406310 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 11 14:27:58.406310 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 11 14:27:58.410226 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 11 14:27:58.410226 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 11 14:27:58.410226 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 11 14:27:58.410226 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 11 14:27:58.410226 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 11 14:27:58.410226 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Jul 11 14:27:58.410226 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 474/945] 10.222.0.70 () {60 vars in 1131 bytes} [Mon Jul 11 14:27:58 2022] POST /identity/v3/users => generated 160 bytes in 233 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:27:58.410226 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcda30f-9e8d-4de2-ae02-c33477cdc572 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:58.516357 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ccd796-c571-46be-9dd5-de63ca7fd5d9 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:58.567965 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcda30f-9e8d-4de2-ae02-c33477cdc572 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:58.568399 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdb5198-26d9-47c3-8c98-bffb475b02d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:58.569382 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdb5198-26d9-47c3-8c98-bffb475b02d2 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:58.569800 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdb5198-26d9-47c3-8c98-bffb475b02d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:58.570214 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdb5198-26d9-47c3-8c98-bffb475b02d2 None admin] PATH_INFO: `/v3/services` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:58.571279 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdb5198-26d9-47c3-8c98-bffb475b02d2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:58.573460 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdb5198-26d9-47c3-8c98-bffb475b02d2 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:58.590534 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 472/946] 10.222.0.70 () {56 vars in 1087 bytes} [Mon Jul 11 14:27:58 2022] GET /identity/v3/services => generated 1497 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:27:58.609349 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:58.614103 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b867ce-29a4-472b-af44-ccb8b29ad7da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:58.614992 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b867ce-29a4-472b-af44-ccb8b29ad7da None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:58.615239 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b867ce-29a4-472b-af44-ccb8b29ad7da None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:58.616087 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b867ce-29a4-472b-af44-ccb8b29ad7da None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:58.626129 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b867ce-29a4-472b-af44-ccb8b29ad7da None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:58.627888 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b867ce-29a4-472b-af44-ccb8b29ad7da None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:58.645396 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-45b867ce-29a4-472b-af44-ccb8b29ad7da None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 11 14:27:58.645396 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:58.645396 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:58.645396 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:58.645396 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:58.645396 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:58.645396 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:58.645396 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:58.645396 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:58.645396 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:58.645396 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:58.645396 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:58.645396 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 14:27:58.645396 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 14:27:58.645396 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 14:27:58.645396 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 14:27:58.646428 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:58.646428 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:58.646428 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 14:27:58.646428 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:27:58.646428 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 14:27:58.646428 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:27:58.646428 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:58.646428 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:58.646428 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:58.646428 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:58.646428 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:58.646428 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:58.646428 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:58.646428 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:58.646428 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:58.646428 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:58.646428 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:58.646428 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:58.648093 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:58.648093 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:58.648093 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 14:27:58.648093 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 14:27:58.648093 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 14:27:58.648093 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 14:27:58.648093 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 14:27:58.648093 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 14:27:58.648093 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 11 14:27:58.648093 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Jul 11 14:27:58.648093 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 475/947] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Jul 11 14:27:58 2022] GET /identity/v3/users/cinder => generated 84 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:27:58.653061 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdb5198-26d9-47c3-8c98-bffb475b02d2 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:58.735348 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:58.860450 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdb5198-26d9-47c3-8c98-bffb475b02d2 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:58.908819 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a232a0-dbf8-41c4-b296-743e7604695d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:58.909904 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a232a0-dbf8-41c4-b296-743e7604695d None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:58.910391 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a232a0-dbf8-41c4-b296-743e7604695d None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:58.910867 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a232a0-dbf8-41c4-b296-743e7604695d None admin] PATH_INFO: `/v3/users` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:58.911905 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a232a0-dbf8-41c4-b296-743e7604695d None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:58.912453 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a232a0-dbf8-41c4-b296-743e7604695d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:58.914122 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a232a0-dbf8-41c4-b296-743e7604695d None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:58.964263 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 473/948] 10.222.0.70 () {56 vars in 1101 bytes} [Mon Jul 11 14:27:58 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:59.547687 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab3f4e1-81bb-4388-b54a-35938446e11f None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:59.548520 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab3f4e1-81bb-4388-b54a-35938446e11f None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:59.548520 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab3f4e1-81bb-4388-b54a-35938446e11f None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:59.555073 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 476/949] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:27:59 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:27:59.564084 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad34e36-59f1-4328-a84b-c21fe3a38093 None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:59.564704 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad34e36-59f1-4328-a84b-c21fe3a38093 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:59.565131 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad34e36-59f1-4328-a84b-c21fe3a38093 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:59.591932 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-1ad34e36-59f1-4328-a84b-c21fe3a38093 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:27:59.594233 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-1ad34e36-59f1-4328-a84b-c21fe3a38093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:27:59.680266 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 474/950] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:27:59 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:27:59.702488 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab3f4e1-81bb-4388-b54a-35938446e11f None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:59.869252 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab3f4e1-81bb-4388-b54a-35938446e11f None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:59.930303 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54f62d5-568d-4d3a-9f68-8c8999f78764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:59.931944 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54f62d5-568d-4d3a-9f68-8c8999f78764 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:59.932474 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54f62d5-568d-4d3a-9f68-8c8999f78764 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:59.932951 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54f62d5-568d-4d3a-9f68-8c8999f78764 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:59.934191 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54f62d5-568d-4d3a-9f68-8c8999f78764 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:59.936797 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54f62d5-568d-4d3a-9f68-8c8999f78764 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:59.961591 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-a54f62d5-568d-4d3a-9f68-8c8999f78764 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 11 14:27:59.961591 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:59.961591 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 14:27:59.961591 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 14:27:59.961591 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 14:27:59.961591 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 14:27:59.961591 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 14:27:59.961591 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:27:59.961591 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 11 14:27:59.961591 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Jul 11 14:27:59.961591 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 14:27:59.961591 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Jul 11 14:27:59.961591 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:59.961591 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:59.961591 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:59.961591 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:59.962763 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:59.962763 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:59.962763 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:59.962763 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:59.962763 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:59.962763 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:59.962763 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:59.962763 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 14:27:59.962763 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 14:27:59.962763 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 14:27:59.962763 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 14:27:59.962763 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:59.962763 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:59.962763 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:59.962763 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:59.962763 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:59.963654 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:59.963654 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:59.963654 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:59.963654 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:59.963654 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:59.963654 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:59.963654 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:59.963654 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:59.963654 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:59.963654 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:59.963654 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:59.963654 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 14:27:59.963654 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:27:59.963654 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 11 14:27:59.963654 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Jul 11 14:27:59.964538 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 477/951] 10.222.0.70 () {56 vars in 1132 bytes} [Mon Jul 11 14:27:59 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:27:59.971609 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad34e36-59f1-4328-a84b-c21fe3a38093 None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:00.010854 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:00.155311 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad34e36-59f1-4328-a84b-c21fe3a38093 None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:00.216750 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd1356e-63cb-46cc-9fd4-8131c26407ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:00.217890 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd1356e-63cb-46cc-9fd4-8131c26407ad None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:00.218432 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd1356e-63cb-46cc-9fd4-8131c26407ad None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:00.218965 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd1356e-63cb-46cc-9fd4-8131c26407ad None admin] PATH_INFO: `/v3/services` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:00.220581 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd1356e-63cb-46cc-9fd4-8131c26407ad None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:28:00.221135 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd1356e-63cb-46cc-9fd4-8131c26407ad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:00.223721 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd1356e-63cb-46cc-9fd4-8131c26407ad None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:00.238081 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 475/952] 10.222.0.70 () {56 vars in 1126 bytes} [Mon Jul 11 14:27:59 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:28:00.240453 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54f62d5-568d-4d3a-9f68-8c8999f78764 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:00.333846 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:00.410068 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54f62d5-568d-4d3a-9f68-8c8999f78764 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:00.460949 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84723911-c475-4aa4-91fd-5e447d77ca70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:00.461700 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84723911-c475-4aa4-91fd-5e447d77ca70 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:00.462089 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84723911-c475-4aa4-91fd-5e447d77ca70 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:00.462380 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84723911-c475-4aa4-91fd-5e447d77ca70 None admin] PATH_INFO: `/v3/services` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:00.463186 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84723911-c475-4aa4-91fd-5e447d77ca70 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:28:00.463500 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84723911-c475-4aa4-91fd-5e447d77ca70 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:00.465493 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84723911-c475-4aa4-91fd-5e447d77ca70 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:00.474232 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 478/953] 10.222.0.70 () {56 vars in 1126 bytes} [Mon Jul 11 14:28:00 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:28:00.481706 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd1356e-63cb-46cc-9fd4-8131c26407ad None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:00.514893 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e9d890-ede0-4353-b04f-954d9fde6fe0 None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:00.515313 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e9d890-ede0-4353-b04f-954d9fde6fe0 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:00.515531 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e9d890-ede0-4353-b04f-954d9fde6fe0 None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:00.517496 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 479/954] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:28:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 14:28:00.524815 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a214e3d5-292d-4a75-81c8-1177aeacd026 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:00.525212 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a214e3d5-292d-4a75-81c8-1177aeacd026 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:00.525346 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a214e3d5-292d-4a75-81c8-1177aeacd026 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:00.552329 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-a214e3d5-292d-4a75-81c8-1177aeacd026 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:28:00.557430 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-a214e3d5-292d-4a75-81c8-1177aeacd026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:28:00.618868 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:00.642088 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd1356e-63cb-46cc-9fd4-8131c26407ad None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:00.664292 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 480/955] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:28:00 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 14:28:00.686462 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba04fef8-0f83-47d6-a152-f4d2f8daae06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:00.687766 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba04fef8-0f83-47d6-a152-f4d2f8daae06 None admin] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:00.688056 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba04fef8-0f83-47d6-a152-f4d2f8daae06 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:00.688360 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba04fef8-0f83-47d6-a152-f4d2f8daae06 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:00.689124 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba04fef8-0f83-47d6-a152-f4d2f8daae06 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:00.690316 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a214e3d5-292d-4a75-81c8-1177aeacd026 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:00.690518 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba04fef8-0f83-47d6-a152-f4d2f8daae06 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:00.715615 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 476/956] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Jul 11 14:28:00 2022] POST /identity/v3/endpoints => generated 347 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:28:00.758625 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:00.845664 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a214e3d5-292d-4a75-81c8-1177aeacd026 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:00.899155 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad92a771-c768-42aa-9431-9c4072b07a32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:00.900144 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad92a771-c768-42aa-9431-9c4072b07a32 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:00.900713 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad92a771-c768-42aa-9431-9c4072b07a32 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:00.901194 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad92a771-c768-42aa-9431-9c4072b07a32 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:00.925731 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad92a771-c768-42aa-9431-9c4072b07a32 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:28:00.934837 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-ad92a771-c768-42aa-9431-9c4072b07a32 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 11 14:28:00.934837 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:28:00.934837 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:28:00.934837 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:28:00.934837 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:28:00.934837 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:28:00.934837 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:28:00.934837 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:28:00.934837 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:28:00.934837 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:28:00.934837 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:28:00.934837 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:28:00.934837 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:28:00.934837 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:28:00.934837 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:28:00.934837 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:28:00.937749 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:28:00.937749 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:28:00.937749 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:28:00.937749 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:28:00.937749 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:28:00.937749 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:28:00.937749 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:28:00.937749 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:28:00.937749 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:28:00.937749 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:28:00.937749 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:28:00.937749 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( Jul 11 14:28:00.937749 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:28:00.937749 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:28:00.937749 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:28:00.937749 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:28:00.939768 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:28:00.939768 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:28:00.939768 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:28:00.939768 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:28:00.939768 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:28:00.939768 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:28:00.939768 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:28:00.939768 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:28:00.939768 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:28:00.939768 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:28:00.939768 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 11 14:28:00.939768 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Jul 11 14:28:00.939768 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 481/957] 10.222.0.70 () {56 vars in 1120 bytes} [Mon Jul 11 14:28:00 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:28:00.951162 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba04fef8-0f83-47d6-a152-f4d2f8daae06 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:01.108218 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba04fef8-0f83-47d6-a152-f4d2f8daae06 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:01.146208 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15401fb3-dea6-41ea-b201-480030355501 None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:01.146535 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15401fb3-dea6-41ea-b201-480030355501 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:01.146763 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15401fb3-dea6-41ea-b201-480030355501 None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:01.148408 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 482/958] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:28:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 14:28:01.153730 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b710af4-1544-4eea-9be0-5d4f03cd9a59 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:01.154014 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b710af4-1544-4eea-9be0-5d4f03cd9a59 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:01.154295 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b710af4-1544-4eea-9be0-5d4f03cd9a59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:01.164450 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e0cd64-bfb2-4286-98e1-574fdbb03c36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:01.165145 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e0cd64-bfb2-4286-98e1-574fdbb03c36 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:01.165422 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e0cd64-bfb2-4286-98e1-574fdbb03c36 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:01.165700 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e0cd64-bfb2-4286-98e1-574fdbb03c36 None admin] PATH_INFO: `/v3/roles` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:01.166460 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e0cd64-bfb2-4286-98e1-574fdbb03c36 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:28:01.166770 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e0cd64-bfb2-4286-98e1-574fdbb03c36 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:01.168160 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e0cd64-bfb2-4286-98e1-574fdbb03c36 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:01.182472 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 477/959] 10.222.0.70 () {56 vars in 1115 bytes} [Mon Jul 11 14:28:00 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:28:01.182646 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-5b710af4-1544-4eea-9be0-5d4f03cd9a59 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:28:01.182646 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-5b710af4-1544-4eea-9be0-5d4f03cd9a59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:28:01.184893 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e0cd64-bfb2-4286-98e1-574fdbb03c36 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:01.188754 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:01.287122 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 483/960] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:28:01 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 14:28:01.311275 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b710af4-1544-4eea-9be0-5d4f03cd9a59 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:01.327757 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e0cd64-bfb2-4286-98e1-574fdbb03c36 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:01.343903 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:01.390319 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0533cc-90e1-4434-9aec-f874d3122023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:01.391130 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0533cc-90e1-4434-9aec-f874d3122023 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:01.391432 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0533cc-90e1-4434-9aec-f874d3122023 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:01.391680 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0533cc-90e1-4434-9aec-f874d3122023 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:01.405440 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0533cc-90e1-4434-9aec-f874d3122023 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:01.407049 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0533cc-90e1-4434-9aec-f874d3122023 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:01.427043 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application [None req-bc0533cc-90e1-4434-9aec-f874d3122023 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:28:01.427043 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:28:01.427043 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:28:01.427043 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:28:01.427043 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:28:01.427043 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:28:01.427043 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:28:01.427043 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:28:01.427043 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:28:01.427043 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:28:01.427043 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:28:01.427043 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:28:01.427043 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:28:01.427043 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:28:01.427043 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:28:01.428187 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:28:01.428187 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:28:01.428187 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:28:01.428187 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:28:01.428187 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:28:01.428187 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:28:01.428187 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:28:01.428187 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:28:01.428187 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application with Lock( Jul 11 14:28:01.428187 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:28:01.428187 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:28:01.428187 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:28:01.428187 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:28:01.428187 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:28:01.428187 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:28:01.428187 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:28:01.428187 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:28:01.429768 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:28:01.429768 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:28:01.429768 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:28:01.429768 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Jul 11 14:28:01.429768 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 478/961] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 11 14:28:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:28:01.436283 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0533cc-90e1-4434-9aec-f874d3122023 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:01.441328 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b710af4-1544-4eea-9be0-5d4f03cd9a59 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:01.490901 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d790d9-943d-49d3-aeef-22b92dbfac75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:01.492346 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d790d9-943d-49d3-aeef-22b92dbfac75 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:01.492872 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d790d9-943d-49d3-aeef-22b92dbfac75 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:01.493385 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d790d9-943d-49d3-aeef-22b92dbfac75 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:01.494666 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d790d9-943d-49d3-aeef-22b92dbfac75 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:01.497489 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d790d9-943d-49d3-aeef-22b92dbfac75 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:01.513221 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:01.517926 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-80d790d9-943d-49d3-aeef-22b92dbfac75 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 11 14:28:01.517926 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:28:01.517926 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 14:28:01.517926 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 14:28:01.517926 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 14:28:01.517926 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 14:28:01.517926 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 14:28:01.517926 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:28:01.517926 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 11 14:28:01.517926 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Jul 11 14:28:01.517926 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 14:28:01.517926 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Jul 11 14:28:01.517926 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:28:01.517926 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:28:01.517926 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:28:01.517926 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:28:01.517926 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:28:01.519867 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:28:01.519867 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:28:01.519867 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:28:01.519867 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:28:01.519867 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:28:01.519867 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:28:01.519867 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 14:28:01.519867 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 14:28:01.519867 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 14:28:01.519867 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 14:28:01.519867 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:28:01.519867 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:28:01.519867 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:28:01.519867 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:28:01.519867 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:28:01.519867 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:28:01.521753 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:28:01.521753 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( Jul 11 14:28:01.521753 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:28:01.521753 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:28:01.521753 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:28:01.521753 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:28:01.521753 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:28:01.521753 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:28:01.521753 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:28:01.521753 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:28:01.521753 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 14:28:01.521753 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:28:01.521753 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 11 14:28:01.521753 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Jul 11 14:28:01.521753 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 484/962] 10.222.0.70 () {56 vars in 1126 bytes} [Mon Jul 11 14:28:01 2022] GET /identity/v3/services/object-store => generated 93 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:28:01.526850 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d790d9-943d-49d3-aeef-22b92dbfac75 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:01.595794 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0533cc-90e1-4434-9aec-f874d3122023 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:01.651298 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:01.658882 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17ba27b-3bc8-4af9-a88d-9d8aaa2efaea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:01.660190 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17ba27b-3bc8-4af9-a88d-9d8aaa2efaea None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:01.660796 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17ba27b-3bc8-4af9-a88d-9d8aaa2efaea None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:01.661152 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17ba27b-3bc8-4af9-a88d-9d8aaa2efaea None admin] PATH_INFO: `/v3/domains` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:01.662606 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17ba27b-3bc8-4af9-a88d-9d8aaa2efaea None admin] RBAC: Adding query filter params (name=Default) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:28:01.663257 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17ba27b-3bc8-4af9-a88d-9d8aaa2efaea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:01.665943 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17ba27b-3bc8-4af9-a88d-9d8aaa2efaea None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:01.666091 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d790d9-943d-49d3-aeef-22b92dbfac75 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:01.689579 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 479/963] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jul 11 14:28:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:28:01.695366 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17ba27b-3bc8-4af9-a88d-9d8aaa2efaea None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:01.718310 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22323053-c86c-4a83-b7a6-36e0d0692178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:01.719438 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22323053-c86c-4a83-b7a6-36e0d0692178 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:01.720103 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22323053-c86c-4a83-b7a6-36e0d0692178 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:01.720487 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22323053-c86c-4a83-b7a6-36e0d0692178 None admin] PATH_INFO: `/v3/services` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:01.721288 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22323053-c86c-4a83-b7a6-36e0d0692178 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:28:01.721803 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22323053-c86c-4a83-b7a6-36e0d0692178 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:01.723756 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22323053-c86c-4a83-b7a6-36e0d0692178 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:01.730682 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 485/964] 10.222.0.70 () {56 vars in 1122 bytes} [Mon Jul 11 14:28:01 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:28:01.738897 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22323053-c86c-4a83-b7a6-36e0d0692178 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:01.837049 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17ba27b-3bc8-4af9-a88d-9d8aaa2efaea None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:01.854362 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:01.885769 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9caecac-fc5b-49ce-a2f3-783fea0a0acf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:01.887180 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9caecac-fc5b-49ce-a2f3-783fea0a0acf None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:01.887498 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9caecac-fc5b-49ce-a2f3-783fea0a0acf None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:01.887997 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9caecac-fc5b-49ce-a2f3-783fea0a0acf None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:01.890590 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22323053-c86c-4a83-b7a6-36e0d0692178 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:01.899855 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9caecac-fc5b-49ce-a2f3-783fea0a0acf None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:01.901894 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9caecac-fc5b-49ce-a2f3-783fea0a0acf None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:01.930441 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application [None req-f9caecac-fc5b-49ce-a2f3-783fea0a0acf None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 11 14:28:01.930441 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:28:01.930441 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:28:01.930441 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:28:01.930441 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:28:01.930441 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:28:01.930441 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:28:01.930441 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:28:01.930441 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:28:01.930441 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:28:01.930441 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:28:01.930441 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:28:01.930441 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 14:28:01.930441 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 14:28:01.930441 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 14:28:01.930441 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 14:28:01.931885 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:28:01.931885 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:28:01.931885 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 14:28:01.931885 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:28:01.931885 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 14:28:01.931885 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:28:01.931885 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:28:01.931885 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:28:01.931885 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:28:01.931885 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:28:01.931885 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:28:01.931885 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application with Lock( Jul 11 14:28:01.931885 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:28:01.931885 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:28:01.931885 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:28:01.931885 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:28:01.931885 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:28:01.931885 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:28:01.932878 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:28:01.932878 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:28:01.932878 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 14:28:01.932878 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 14:28:01.932878 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 14:28:01.932878 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 14:28:01.932878 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 14:28:01.932878 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 14:28:01.932878 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 11 14:28:01.932878 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Jul 11 14:28:01.932878 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 480/965] 10.222.0.70 () {56 vars in 1117 bytes} [Mon Jul 11 14:28:01 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:28:01.934966 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfc0a63-32cb-4aea-b573-b69505e00143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:01.935688 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfc0a63-32cb-4aea-b573-b69505e00143 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:01.935981 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfc0a63-32cb-4aea-b573-b69505e00143 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:01.936299 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfc0a63-32cb-4aea-b573-b69505e00143 None admin] PATH_INFO: `/v3/services` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:01.937854 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfc0a63-32cb-4aea-b573-b69505e00143 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:28:01.938155 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfc0a63-32cb-4aea-b573-b69505e00143 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:01.938986 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9caecac-fc5b-49ce-a2f3-783fea0a0acf None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:01.939676 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfc0a63-32cb-4aea-b573-b69505e00143 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:01.952584 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 486/966] 10.222.0.70 () {56 vars in 1122 bytes} [Mon Jul 11 14:28:01 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:28:01.955652 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfc0a63-32cb-4aea-b573-b69505e00143 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:01.988778 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:02.069821 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9caecac-fc5b-49ce-a2f3-783fea0a0acf None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:02.102835 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfc0a63-32cb-4aea-b573-b69505e00143 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:02.117711 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bf6825-6553-4243-b436-4acb363bc4e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:02.118409 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bf6825-6553-4243-b436-4acb363bc4e3 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:02.118693 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bf6825-6553-4243-b436-4acb363bc4e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:02.118975 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bf6825-6553-4243-b436-4acb363bc4e3 None admin] PATH_INFO: `/v3/users` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:02.119850 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bf6825-6553-4243-b436-4acb363bc4e3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:28:02.120324 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bf6825-6553-4243-b436-4acb363bc4e3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:02.121830 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bf6825-6553-4243-b436-4acb363bc4e3 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:02.145903 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 481/967] 10.222.0.70 () {56 vars in 1149 bytes} [Mon Jul 11 14:28:01 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:28:02.152080 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bf6825-6553-4243-b436-4acb363bc4e3 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:02.171327 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e401939d-7152-4966-90b5-05b48067f112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:02.172586 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e401939d-7152-4966-90b5-05b48067f112 None admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:02.173097 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e401939d-7152-4966-90b5-05b48067f112 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:02.173605 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e401939d-7152-4966-90b5-05b48067f112 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:02.175075 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e401939d-7152-4966-90b5-05b48067f112 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:02.177793 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e401939d-7152-4966-90b5-05b48067f112 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:02.209483 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:02.220253 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 487/968] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Jul 11 14:28:01 2022] POST /identity/v3/endpoints => generated 349 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:28:02.356276 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bf6825-6553-4243-b436-4acb363bc4e3 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:02.431224 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f72e0e-0bfc-4157-a3aa-33387747fdfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:02.432411 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f72e0e-0bfc-4157-a3aa-33387747fdfe None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:02.432916 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f72e0e-0bfc-4157-a3aa-33387747fdfe None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:02.433413 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f72e0e-0bfc-4157-a3aa-33387747fdfe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:02.553306 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f72e0e-0bfc-4157-a3aa-33387747fdfe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:02.556292 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f72e0e-0bfc-4157-a3aa-33387747fdfe None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:02.596890 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:02.703317 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 482/969] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Jul 11 14:28:02 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 552 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 11 14:28:02.712676 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e401939d-7152-4966-90b5-05b48067f112 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:02.862003 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:02.905217 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e401939d-7152-4966-90b5-05b48067f112 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:02.974065 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdf2219-2fd9-4b98-bc96-429e8b5c1c9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:02.975469 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdf2219-2fd9-4b98-bc96-429e8b5c1c9f None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:02.975979 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdf2219-2fd9-4b98-bc96-429e8b5c1c9f None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:02.976510 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdf2219-2fd9-4b98-bc96-429e8b5c1c9f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:02.996267 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdf2219-2fd9-4b98-bc96-429e8b5c1c9f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:02.998907 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdf2219-2fd9-4b98-bc96-429e8b5c1c9f None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:03.015333 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8149b8-b24c-4389-8f08-e56197c260b1 None None] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:03.015888 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8149b8-b24c-4389-8f08-e56197c260b1 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:03.016167 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8149b8-b24c-4389-8f08-e56197c260b1 None None] PATH_INFO: `/` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:03.017957 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 483/970] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:28:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:28:03.023627 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70148867-be68-4bbb-8ad5-3be062a5a836 None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:03.023967 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70148867-be68-4bbb-8ad5-3be062a5a836 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:03.024179 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70148867-be68-4bbb-8ad5-3be062a5a836 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:03.036278 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-abdf2219-2fd9-4b98-bc96-429e8b5c1c9f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:28:03.036278 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:28:03.036278 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:28:03.036278 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:28:03.036278 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:28:03.036278 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:28:03.036278 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:28:03.036278 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:28:03.036278 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:28:03.036278 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:28:03.036278 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:28:03.036278 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:28:03.036278 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:28:03.036278 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:28:03.036278 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:28:03.037260 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:28:03.037260 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:28:03.037260 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:28:03.037260 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:28:03.037260 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:28:03.037260 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:28:03.037260 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:28:03.037260 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:28:03.037260 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( Jul 11 14:28:03.037260 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:28:03.037260 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:28:03.037260 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:28:03.037260 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:28:03.037260 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:28:03.037260 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:28:03.037260 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:28:03.037260 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:28:03.038166 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:28:03.038166 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:28:03.038166 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:28:03.038166 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Jul 11 14:28:03.040616 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 488/971] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 11 14:28:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:28:03.043080 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdf2219-2fd9-4b98-bc96-429e8b5c1c9f None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:03.045189 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-70148867-be68-4bbb-8ad5-3be062a5a836 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:28:03.047256 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-70148867-be68-4bbb-8ad5-3be062a5a836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:28:03.141041 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 484/972] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:28:03 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 14:28:03.163615 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70148867-be68-4bbb-8ad5-3be062a5a836 None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:03.199908 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdf2219-2fd9-4b98-bc96-429e8b5c1c9f None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:03.250127 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:03.264244 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c7d25e-9ec5-4e53-832a-c529bfbd4b1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:03.266186 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c7d25e-9ec5-4e53-832a-c529bfbd4b1f None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:03.266672 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c7d25e-9ec5-4e53-832a-c529bfbd4b1f None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:03.267144 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c7d25e-9ec5-4e53-832a-c529bfbd4b1f None admin] PATH_INFO: `/v3/domains` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:03.268526 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c7d25e-9ec5-4e53-832a-c529bfbd4b1f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:28:03.269059 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c7d25e-9ec5-4e53-832a-c529bfbd4b1f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:03.271333 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c7d25e-9ec5-4e53-832a-c529bfbd4b1f None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:03.273888 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:03.290105 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 489/973] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jul 11 14:28:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:28:03.296710 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c7d25e-9ec5-4e53-832a-c529bfbd4b1f None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:03.339559 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70148867-be68-4bbb-8ad5-3be062a5a836 None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:03.391760 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f188b6-6269-4d0c-a2f1-e0bd2705d3e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:03.392520 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f188b6-6269-4d0c-a2f1-e0bd2705d3e8 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:03.392801 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f188b6-6269-4d0c-a2f1-e0bd2705d3e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:03.393076 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f188b6-6269-4d0c-a2f1-e0bd2705d3e8 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:03.393771 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f188b6-6269-4d0c-a2f1-e0bd2705d3e8 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:03.395182 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f188b6-6269-4d0c-a2f1-e0bd2705d3e8 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:03.408520 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application [None req-54f188b6-6269-4d0c-a2f1-e0bd2705d3e8 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 11 14:28:03.408520 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:28:03.408520 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 14:28:03.408520 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 14:28:03.408520 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 14:28:03.408520 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 14:28:03.408520 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 14:28:03.408520 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:28:03.408520 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 11 14:28:03.408520 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Jul 11 14:28:03.408520 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 14:28:03.408520 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Jul 11 14:28:03.408520 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:28:03.408520 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:28:03.408520 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:28:03.408520 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:28:03.408520 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:28:03.409607 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:28:03.409607 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:28:03.409607 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:28:03.409607 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:28:03.409607 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:28:03.409607 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:28:03.409607 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 14:28:03.409607 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 14:28:03.409607 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 14:28:03.409607 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 14:28:03.409607 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:28:03.409607 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:28:03.409607 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:28:03.409607 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:28:03.409607 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:28:03.409607 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:28:03.410556 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:28:03.410556 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application with Lock( Jul 11 14:28:03.410556 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:28:03.410556 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:28:03.410556 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:28:03.410556 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:28:03.410556 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:28:03.410556 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:28:03.410556 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:28:03.410556 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:28:03.410556 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 14:28:03.410556 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:28:03.410556 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 11 14:28:03.410556 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Jul 11 14:28:03.410556 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 485/974] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Jul 11 14:28:03 2022] GET /identity/v3/services/compute => generated 88 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:28:03.416070 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f188b6-6269-4d0c-a2f1-e0bd2705d3e8 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:03.440853 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c7d25e-9ec5-4e53-832a-c529bfbd4b1f None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:03.484636 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78377821-e1af-45fe-b8c9-39b86bb12ce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:03.485673 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78377821-e1af-45fe-b8c9-39b86bb12ce9 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:03.485960 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78377821-e1af-45fe-b8c9-39b86bb12ce9 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:03.486244 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78377821-e1af-45fe-b8c9-39b86bb12ce9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:03.494269 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78377821-e1af-45fe-b8c9-39b86bb12ce9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:03.495759 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78377821-e1af-45fe-b8c9-39b86bb12ce9 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:03.516471 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-78377821-e1af-45fe-b8c9-39b86bb12ce9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:28:03.516471 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:28:03.516471 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:28:03.516471 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:28:03.516471 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:28:03.516471 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:28:03.516471 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:28:03.516471 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:28:03.516471 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:28:03.516471 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:28:03.516471 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:28:03.516471 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:28:03.516471 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 14:28:03.516471 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 14:28:03.516471 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 14:28:03.517437 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 14:28:03.517437 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:28:03.517437 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:28:03.517437 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:28:03.517437 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:28:03.517437 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:28:03.517437 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:28:03.517437 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:28:03.517437 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( Jul 11 14:28:03.517437 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:28:03.517437 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:28:03.517437 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:28:03.517437 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:28:03.517437 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:28:03.517437 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:28:03.517437 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:28:03.517437 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:28:03.518332 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 14:28:03.518332 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 14:28:03.518332 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 14:28:03.518332 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 14:28:03.518332 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 14:28:03.518332 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 14:28:03.518332 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:28:03.518332 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Jul 11 14:28:03.518332 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 490/975] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Jul 11 14:28:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:28:03.523865 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78377821-e1af-45fe-b8c9-39b86bb12ce9 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:03.537232 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f188b6-6269-4d0c-a2f1-e0bd2705d3e8 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:03.578772 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:03.593914 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:03.595397 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc1d737-336d-4459-a5cb-893354c99691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:03.596458 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc1d737-336d-4459-a5cb-893354c99691 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:03.596911 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc1d737-336d-4459-a5cb-893354c99691 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:03.597252 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc1d737-336d-4459-a5cb-893354c99691 None admin] PATH_INFO: `/v3/services` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:03.598085 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc1d737-336d-4459-a5cb-893354c99691 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:28:03.598391 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc1d737-336d-4459-a5cb-893354c99691 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:03.599775 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc1d737-336d-4459-a5cb-893354c99691 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:03.604813 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 486/976] 10.222.0.70 () {56 vars in 1112 bytes} [Mon Jul 11 14:28:03 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:28:03.611055 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc1d737-336d-4459-a5cb-893354c99691 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:03.662766 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78377821-e1af-45fe-b8c9-39b86bb12ce9 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:03.699881 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb14bb83-d7fe-4b8a-82e1-36d275058934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:03.700592 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb14bb83-d7fe-4b8a-82e1-36d275058934 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:03.700890 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb14bb83-d7fe-4b8a-82e1-36d275058934 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:03.701169 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb14bb83-d7fe-4b8a-82e1-36d275058934 None admin] PATH_INFO: `/v3/projects` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:03.701971 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb14bb83-d7fe-4b8a-82e1-36d275058934 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:28:03.702310 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb14bb83-d7fe-4b8a-82e1-36d275058934 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:03.703935 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb14bb83-d7fe-4b8a-82e1-36d275058934 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:03.717982 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 491/977] 10.222.0.70 () {56 vars in 1148 bytes} [Mon Jul 11 14:28:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:28:03.723882 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb14bb83-d7fe-4b8a-82e1-36d275058934 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:03.732326 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc1d737-336d-4459-a5cb-893354c99691 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:03.773579 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a19e744-7594-4580-80ce-14696837cdfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:03.774304 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a19e744-7594-4580-80ce-14696837cdfc None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:03.774593 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a19e744-7594-4580-80ce-14696837cdfc None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:03.775195 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a19e744-7594-4580-80ce-14696837cdfc None admin] PATH_INFO: `/v3/services` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:03.775588 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a19e744-7594-4580-80ce-14696837cdfc None admin] RBAC: Adding query filter params (type=compute) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:28:03.775899 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a19e744-7594-4580-80ce-14696837cdfc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:03.777435 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a19e744-7594-4580-80ce-14696837cdfc None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:03.782312 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 487/978] 10.222.0.70 () {56 vars in 1112 bytes} [Mon Jul 11 14:28:03 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:28:03.849168 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb14bb83-d7fe-4b8a-82e1-36d275058934 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:03.860774 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:03.892219 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9144fd99-e218-49ab-a98a-ee8ff13530fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:03.892995 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9144fd99-e218-49ab-a98a-ee8ff13530fc None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:03.893342 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9144fd99-e218-49ab-a98a-ee8ff13530fc None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:03.893679 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9144fd99-e218-49ab-a98a-ee8ff13530fc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:03.894593 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9144fd99-e218-49ab-a98a-ee8ff13530fc None admin] RBAC: Adding query filter params (role.id=c6848bb77ffc4294ab0b88315a5dc1e1, scope.project.id=ccd34295bf7b435a96b37487c8e89fc3, user.id=2ef7b195b623456aa0b12dac0a4bf4d3) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:28:03.894977 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9144fd99-e218-49ab-a98a-ee8ff13530fc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:03.896658 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9144fd99-e218-49ab-a98a-ee8ff13530fc None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:03.903739 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 492/979] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Jul 11 14:28:03 2022] GET /identity/v3/role_assignments?user.id=2ef7b195b623456aa0b12dac0a4bf4d3&scope.project.id=ccd34295bf7b435a96b37487c8e89fc3&role.id=c6848bb77ffc4294ab0b88315a5dc1e1 => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:28:04.489026 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666be084-afd8-4500-ba8d-f098e65dd4da None None] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:04.489412 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666be084-afd8-4500-ba8d-f098e65dd4da None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:04.489703 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666be084-afd8-4500-ba8d-f098e65dd4da None None] PATH_INFO: `/` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:04.491437 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 488/980] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:28:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:28:04.497861 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c6ed4a-0098-4296-b1cb-1b6de0126ac4 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:04.498219 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c6ed4a-0098-4296-b1cb-1b6de0126ac4 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:04.498507 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c6ed4a-0098-4296-b1cb-1b6de0126ac4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:04.518249 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-02c6ed4a-0098-4296-b1cb-1b6de0126ac4 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:28:04.519456 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-02c6ed4a-0098-4296-b1cb-1b6de0126ac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:28:04.610809 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 493/981] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:28:04 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:28:04.633730 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666be084-afd8-4500-ba8d-f098e65dd4da None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:04.701047 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:04.778690 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666be084-afd8-4500-ba8d-f098e65dd4da None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:04.822715 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8605a084-839e-4133-9337-14904eab3feb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:04.823589 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8605a084-839e-4133-9337-14904eab3feb None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:04.823871 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8605a084-839e-4133-9337-14904eab3feb None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:04.824195 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8605a084-839e-4133-9337-14904eab3feb None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:04.824887 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8605a084-839e-4133-9337-14904eab3feb None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:04.826259 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8605a084-839e-4133-9337-14904eab3feb None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:04.841546 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application [None req-8605a084-839e-4133-9337-14904eab3feb None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 11 14:28:04.841546 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:28:04.841546 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 14:28:04.841546 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 14:28:04.841546 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 14:28:04.841546 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 14:28:04.841546 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 14:28:04.841546 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:28:04.841546 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 11 14:28:04.841546 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Jul 11 14:28:04.841546 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 14:28:04.841546 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Jul 11 14:28:04.841546 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:28:04.841546 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:28:04.841546 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:28:04.841546 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:28:04.841546 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:28:04.842638 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:28:04.842638 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:28:04.842638 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:28:04.842638 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:28:04.842638 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:28:04.842638 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:28:04.842638 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 14:28:04.842638 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 14:28:04.842638 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 14:28:04.842638 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 14:28:04.842638 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:28:04.842638 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:28:04.842638 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:28:04.842638 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:28:04.842638 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:28:04.842638 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:28:04.844109 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:28:04.844109 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application with Lock( Jul 11 14:28:04.844109 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:28:04.844109 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:28:04.844109 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:28:04.844109 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:28:04.844109 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:28:04.844109 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:28:04.844109 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:28:04.844109 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:28:04.844109 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 14:28:04.844109 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:28:04.844109 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 11 14:28:04.844109 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Jul 11 14:28:04.848582 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 489/982] 10.222.0.70 () {56 vars in 1126 bytes} [Mon Jul 11 14:28:04 2022] GET /identity/v3/services/object-store => generated 93 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:28:04.849905 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c6ed4a-0098-4296-b1cb-1b6de0126ac4 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:04.979465 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c6ed4a-0098-4296-b1cb-1b6de0126ac4 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:04.981377 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:05.026832 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edb9a3c-b51e-4358-a1b9-8564b50463bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:05.027789 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edb9a3c-b51e-4358-a1b9-8564b50463bd None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:05.028271 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edb9a3c-b51e-4358-a1b9-8564b50463bd None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:05.028768 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edb9a3c-b51e-4358-a1b9-8564b50463bd None admin] PATH_INFO: `/v3/services` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:05.029664 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edb9a3c-b51e-4358-a1b9-8564b50463bd None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:28:05.030121 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edb9a3c-b51e-4358-a1b9-8564b50463bd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:05.031851 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edb9a3c-b51e-4358-a1b9-8564b50463bd None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:05.037735 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 494/983] 10.222.0.70 () {56 vars in 1122 bytes} [Mon Jul 11 14:28:04 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:28:05.043623 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8605a084-839e-4133-9337-14904eab3feb None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:05.158509 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8605a084-839e-4133-9337-14904eab3feb None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:05.174542 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:05.211552 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89b58ca-5847-4a73-a6d0-d93f820f5311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:05.212779 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89b58ca-5847-4a73-a6d0-d93f820f5311 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:05.213365 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89b58ca-5847-4a73-a6d0-d93f820f5311 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:05.213877 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89b58ca-5847-4a73-a6d0-d93f820f5311 None admin] PATH_INFO: `/v3/services` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:05.215304 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89b58ca-5847-4a73-a6d0-d93f820f5311 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:28:05.215880 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89b58ca-5847-4a73-a6d0-d93f820f5311 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:05.219037 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89b58ca-5847-4a73-a6d0-d93f820f5311 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:05.235687 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 490/984] 10.222.0.70 () {56 vars in 1122 bytes} [Mon Jul 11 14:28:05 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:28:05.237385 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edb9a3c-b51e-4358-a1b9-8564b50463bd None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:05.362198 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edb9a3c-b51e-4358-a1b9-8564b50463bd None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:05.401470 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9a6d56-24c1-489a-adb2-e7bd18af7831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:05.402155 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9a6d56-24c1-489a-adb2-e7bd18af7831 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:05.402441 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9a6d56-24c1-489a-adb2-e7bd18af7831 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:05.402718 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9a6d56-24c1-489a-adb2-e7bd18af7831 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:05.403585 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9a6d56-24c1-489a-adb2-e7bd18af7831 None admin] RBAC: Adding query filter params (interface=admin, service_id=18d3001dbca94232810e962459c76f7b, region_id=RegionOne) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:28:05.403863 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9a6d56-24c1-489a-adb2-e7bd18af7831 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:05.405350 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9a6d56-24c1-489a-adb2-e7bd18af7831 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:05.411621 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 495/985] 10.222.0.70 () {56 vars in 1249 bytes} [Mon Jul 11 14:28:05 2022] GET /identity/v3/endpoints?service_id=18d3001dbca94232810e962459c76f7b&interface=admin®ion_id=RegionOne => generated 193 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:28:05.417816 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89b58ca-5847-4a73-a6d0-d93f820f5311 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:05.597588 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89b58ca-5847-4a73-a6d0-d93f820f5311 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:05.649269 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54741604-8240-455e-9ae5-5a268860ee13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:05.649963 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54741604-8240-455e-9ae5-5a268860ee13 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:05.650215 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54741604-8240-455e-9ae5-5a268860ee13 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:05.650531 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54741604-8240-455e-9ae5-5a268860ee13 None admin] PATH_INFO: `/v3/services` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:05.651379 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54741604-8240-455e-9ae5-5a268860ee13 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:05.653331 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54741604-8240-455e-9ae5-5a268860ee13 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:05.660548 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 491/986] 10.222.0.70 () {56 vars in 1087 bytes} [Mon Jul 11 14:28:05 2022] GET /identity/v3/services => generated 1497 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:28:05.907027 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8829a8e-f859-464d-abae-cac5a1434a9c None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:05.907573 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8829a8e-f859-464d-abae-cac5a1434a9c None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:05.907651 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8829a8e-f859-464d-abae-cac5a1434a9c None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:05.909293 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 496/987] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:28:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:28:05.914763 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179421d2-d782-4d9f-ace1-26fdec2b1c6f None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:05.915249 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179421d2-d782-4d9f-ace1-26fdec2b1c6f None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:05.915364 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179421d2-d782-4d9f-ace1-26fdec2b1c6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:05.934004 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-179421d2-d782-4d9f-ace1-26fdec2b1c6f None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:28:05.935199 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-179421d2-d782-4d9f-ace1-26fdec2b1c6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:28:05.978013 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:06.017502 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 492/988] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:28:05 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:28:06.044052 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8829a8e-f859-464d-abae-cac5a1434a9c None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:06.100535 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:06.161544 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031c5962-98ab-44d6-bd7a-a5df2e24be21 None None] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:06.161544 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031c5962-98ab-44d6-bd7a-a5df2e24be21 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:06.161945 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031c5962-98ab-44d6-bd7a-a5df2e24be21 None None] PATH_INFO: `/` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:06.164262 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 493/989] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:28:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:28:06.170150 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117fe23f-1a64-4a3b-a8a0-c42ba8d50244 None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:06.170438 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117fe23f-1a64-4a3b-a8a0-c42ba8d50244 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:06.170722 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117fe23f-1a64-4a3b-a8a0-c42ba8d50244 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:06.189141 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-117fe23f-1a64-4a3b-a8a0-c42ba8d50244 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:28:06.190347 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-117fe23f-1a64-4a3b-a8a0-c42ba8d50244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:28:06.217970 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8829a8e-f859-464d-abae-cac5a1434a9c None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:06.255334 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6570c6f-92bc-4939-be98-53a80a5f5e30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:06.256010 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6570c6f-92bc-4939-be98-53a80a5f5e30 None admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:06.256319 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6570c6f-92bc-4939-be98-53a80a5f5e30 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:06.256598 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6570c6f-92bc-4939-be98-53a80a5f5e30 None admin] PATH_INFO: `/v3/services` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:06.257318 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6570c6f-92bc-4939-be98-53a80a5f5e30 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:06.258695 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6570c6f-92bc-4939-be98-53a80a5f5e30 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:06.269128 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 494/990] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:28:06 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 14:28:06.284271 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 497/991] 10.222.0.70 () {60 vars in 1141 bytes} [Mon Jul 11 14:28:06 2022] POST /identity/v3/services => generated 242 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:28:06.293325 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117fe23f-1a64-4a3b-a8a0-c42ba8d50244 None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:06.432038 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117fe23f-1a64-4a3b-a8a0-c42ba8d50244 None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:06.433950 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:06.498005 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df601e6-6d55-4f08-947d-bf363f431c8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:06.498817 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df601e6-6d55-4f08-947d-bf363f431c8f None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:06.499682 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df601e6-6d55-4f08-947d-bf363f431c8f None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:06.500069 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df601e6-6d55-4f08-947d-bf363f431c8f None admin] PATH_INFO: `/v3/services/image` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:06.500854 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df601e6-6d55-4f08-947d-bf363f431c8f None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:06.502318 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df601e6-6d55-4f08-947d-bf363f431c8f None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:06.516000 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application [None req-6df601e6-6d55-4f08-947d-bf363f431c8f None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 11 14:28:06.516000 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:28:06.516000 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 14:28:06.516000 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 14:28:06.516000 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 14:28:06.516000 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 14:28:06.516000 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 14:28:06.516000 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:28:06.516000 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 11 14:28:06.516000 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Jul 11 14:28:06.516000 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 14:28:06.516000 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Jul 11 14:28:06.516000 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:28:06.516000 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:28:06.516000 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:28:06.516000 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:28:06.516000 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:28:06.517373 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:28:06.517373 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:28:06.517373 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:28:06.517373 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:28:06.517373 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:28:06.517373 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:28:06.517373 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 14:28:06.517373 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 14:28:06.517373 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 14:28:06.517373 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 14:28:06.517373 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:28:06.517373 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:28:06.517373 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:28:06.517373 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:28:06.517373 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:28:06.517373 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:28:06.518379 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:28:06.518379 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application with Lock( Jul 11 14:28:06.518379 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:28:06.518379 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:28:06.518379 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:28:06.518379 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:28:06.518379 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:28:06.518379 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:28:06.518379 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:28:06.518379 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:28:06.518379 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 14:28:06.518379 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:28:06.518379 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 11 14:28:06.518379 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Jul 11 14:28:06.518379 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 495/992] 10.222.0.70 () {56 vars in 1105 bytes} [Mon Jul 11 14:28:06 2022] GET /identity/v3/services/image => generated 86 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:28:06.525688 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6570c6f-92bc-4939-be98-53a80a5f5e30 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:06.639503 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:06.656739 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6570c6f-92bc-4939-be98-53a80a5f5e30 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:06.695418 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96440fbd-4119-4dc4-9301-53a5d2b2d046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:06.696067 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96440fbd-4119-4dc4-9301-53a5d2b2d046 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:06.696556 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96440fbd-4119-4dc4-9301-53a5d2b2d046 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:06.697029 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96440fbd-4119-4dc4-9301-53a5d2b2d046 None admin] PATH_INFO: `/v3/services` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:06.697806 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96440fbd-4119-4dc4-9301-53a5d2b2d046 None admin] RBAC: Adding query filter params (name=image) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:28:06.698118 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96440fbd-4119-4dc4-9301-53a5d2b2d046 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:06.699499 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96440fbd-4119-4dc4-9301-53a5d2b2d046 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:06.705926 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 498/993] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 11 14:28:06 2022] GET /identity/v3/services?name=image => generated 122 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:28:06.711522 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df601e6-6d55-4f08-947d-bf363f431c8f None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:06.850672 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df601e6-6d55-4f08-947d-bf363f431c8f None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:06.893919 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9bad64-7403-424e-9073-37ee5047c578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:06.894635 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9bad64-7403-424e-9073-37ee5047c578 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:06.894925 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9bad64-7403-424e-9073-37ee5047c578 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:06.895205 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9bad64-7403-424e-9073-37ee5047c578 None admin] PATH_INFO: `/v3/services` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:06.895932 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9bad64-7403-424e-9073-37ee5047c578 None admin] RBAC: Adding query filter params (type=image) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:28:06.896338 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9bad64-7403-424e-9073-37ee5047c578 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:06.897801 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9bad64-7403-424e-9073-37ee5047c578 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:06.912257 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 496/994] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 11 14:28:06 2022] GET /identity/v3/services?type=image => generated 122 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:28:07.921308 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3293e5a5-ac64-4426-b6f6-ec4faf199657 None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:07.921962 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3293e5a5-ac64-4426-b6f6-ec4faf199657 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:07.922553 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3293e5a5-ac64-4426-b6f6-ec4faf199657 None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:07.925263 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 499/995] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:28:07 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:28:07.932302 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746660f6-0c9e-43ca-91c8-6f3f648eba5d None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:07.932859 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746660f6-0c9e-43ca-91c8-6f3f648eba5d None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:07.932859 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746660f6-0c9e-43ca-91c8-6f3f648eba5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:07.953510 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-746660f6-0c9e-43ca-91c8-6f3f648eba5d None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:28:07.954733 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-746660f6-0c9e-43ca-91c8-6f3f648eba5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:28:07.978399 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:08.048238 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 497/996] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:28:07 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:28:08.079356 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3293e5a5-ac64-4426-b6f6-ec4faf199657 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:08.254516 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3293e5a5-ac64-4426-b6f6-ec4faf199657 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:08.300645 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597db537-4da9-4b0f-969f-4d4da66d1ea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:08.301498 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597db537-4da9-4b0f-969f-4d4da66d1ea0 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:08.301780 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597db537-4da9-4b0f-969f-4d4da66d1ea0 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:08.302061 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597db537-4da9-4b0f-969f-4d4da66d1ea0 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:08.302732 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597db537-4da9-4b0f-969f-4d4da66d1ea0 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:08.304148 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597db537-4da9-4b0f-969f-4d4da66d1ea0 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:08.318434 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-597db537-4da9-4b0f-969f-4d4da66d1ea0 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 11 14:28:08.318434 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:28:08.318434 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 14:28:08.318434 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 14:28:08.318434 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 14:28:08.318434 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 14:28:08.318434 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 14:28:08.318434 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:28:08.318434 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 11 14:28:08.318434 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Jul 11 14:28:08.318434 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 14:28:08.318434 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Jul 11 14:28:08.318434 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:28:08.318434 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:28:08.318434 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:28:08.318434 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:28:08.318434 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:28:08.319559 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:28:08.319559 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:28:08.319559 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:28:08.319559 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:28:08.319559 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:28:08.319559 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:28:08.319559 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 14:28:08.319559 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 14:28:08.319559 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 14:28:08.319559 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 14:28:08.319559 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:28:08.319559 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:28:08.319559 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:28:08.319559 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:28:08.319559 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:28:08.319559 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:28:08.320449 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:28:08.320449 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( Jul 11 14:28:08.320449 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:28:08.320449 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:28:08.320449 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:28:08.320449 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:28:08.320449 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:28:08.320449 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:28:08.320449 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:28:08.320449 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:28:08.320449 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 14:28:08.320449 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:28:08.320449 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 11 14:28:08.320449 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Jul 11 14:28:08.324432 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 500/997] 10.222.0.70 () {56 vars in 1126 bytes} [Mon Jul 11 14:28:08 2022] GET /identity/v3/services/object-store => generated 93 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:28:08.326252 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746660f6-0c9e-43ca-91c8-6f3f648eba5d None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:08.446342 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e2ee8c-8a1f-4a24-b9c2-602f931a059b None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:08.446626 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e2ee8c-8a1f-4a24-b9c2-602f931a059b None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:08.446911 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e2ee8c-8a1f-4a24-b9c2-602f931a059b None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:08.448459 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 501/998] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:28:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 14:28:08.452793 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746660f6-0c9e-43ca-91c8-6f3f648eba5d None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:08.454912 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dc1ba6-1cbc-4c45-9dc8-beab2892d430 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:08.455202 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dc1ba6-1cbc-4c45-9dc8-beab2892d430 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:08.455468 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dc1ba6-1cbc-4c45-9dc8-beab2892d430 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:08.473868 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-24dc1ba6-1cbc-4c45-9dc8-beab2892d430 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:28:08.475088 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-24dc1ba6-1cbc-4c45-9dc8-beab2892d430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:28:08.491691 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:08.497969 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca9cf33-9a96-4e3c-8842-b1196a86d562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:08.499507 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca9cf33-9a96-4e3c-8842-b1196a86d562 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:08.500734 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca9cf33-9a96-4e3c-8842-b1196a86d562 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:08.500734 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca9cf33-9a96-4e3c-8842-b1196a86d562 None admin] PATH_INFO: `/v3/services` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:08.501607 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca9cf33-9a96-4e3c-8842-b1196a86d562 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:28:08.502039 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca9cf33-9a96-4e3c-8842-b1196a86d562 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:08.503921 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca9cf33-9a96-4e3c-8842-b1196a86d562 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:08.517181 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 498/999] 10.222.0.70 () {56 vars in 1122 bytes} [Mon Jul 11 14:28:08 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:28:08.518725 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca9cf33-9a96-4e3c-8842-b1196a86d562 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:08.553049 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:08.584244 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 502/1000] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:28:08 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 14:28:08.621124 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dc1ba6-1cbc-4c45-9dc8-beab2892d430 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:08.662762 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca9cf33-9a96-4e3c-8842-b1196a86d562 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:08.711619 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f04b5c-3563-48d3-b475-27ce4caa6b65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:08.711619 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f04b5c-3563-48d3-b475-27ce4caa6b65 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:08.712444 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f04b5c-3563-48d3-b475-27ce4caa6b65 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:08.712444 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f04b5c-3563-48d3-b475-27ce4caa6b65 None admin] PATH_INFO: `/v3/services` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:08.713952 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f04b5c-3563-48d3-b475-27ce4caa6b65 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:28:08.713952 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f04b5c-3563-48d3-b475-27ce4caa6b65 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:08.714652 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f04b5c-3563-48d3-b475-27ce4caa6b65 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:08.726400 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 499/1001] 10.222.0.70 () {56 vars in 1122 bytes} [Mon Jul 11 14:28:08 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:28:08.727702 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f04b5c-3563-48d3-b475-27ce4caa6b65 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:08.777468 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dc1ba6-1cbc-4c45-9dc8-beab2892d430 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:08.827859 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2da803-1374-4da4-956c-feb1d3493f8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:08.828747 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2da803-1374-4da4-956c-feb1d3493f8f None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:08.829033 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2da803-1374-4da4-956c-feb1d3493f8f None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:08.829336 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2da803-1374-4da4-956c-feb1d3493f8f None admin] PATH_INFO: `/v3/services/compute` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:08.830599 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2da803-1374-4da4-956c-feb1d3493f8f None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:08.832049 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2da803-1374-4da4-956c-feb1d3493f8f None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:08.847205 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-8c2da803-1374-4da4-956c-feb1d3493f8f None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 11 14:28:08.847205 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:28:08.847205 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 14:28:08.847205 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 14:28:08.847205 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 14:28:08.847205 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 14:28:08.847205 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 14:28:08.847205 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:28:08.847205 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 11 14:28:08.847205 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Jul 11 14:28:08.847205 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 14:28:08.847205 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Jul 11 14:28:08.847205 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:28:08.847205 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:28:08.847205 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:28:08.847205 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:28:08.847205 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:28:08.849782 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:28:08.849782 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:28:08.849782 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:28:08.849782 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:28:08.849782 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:28:08.849782 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:28:08.849782 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 14:28:08.849782 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 14:28:08.849782 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 14:28:08.849782 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 14:28:08.849782 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:28:08.849782 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:28:08.849782 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:28:08.849782 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:28:08.849782 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:28:08.849782 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:28:08.851713 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:28:08.851713 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( Jul 11 14:28:08.851713 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:28:08.851713 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:28:08.851713 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:28:08.851713 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:28:08.851713 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:28:08.851713 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:28:08.851713 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:28:08.851713 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:28:08.851713 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 14:28:08.851713 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:28:08.851713 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 11 14:28:08.851713 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Jul 11 14:28:08.851713 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 503/1002] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Jul 11 14:28:08 2022] GET /identity/v3/services/compute => generated 88 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:28:08.854898 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2da803-1374-4da4-956c-feb1d3493f8f None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:08.879451 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:08.888706 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:08.914909 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f04b5c-3563-48d3-b475-27ce4caa6b65 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:08.961333 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4923fef6-8d1f-4470-b3de-13c644b277ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:08.962489 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4923fef6-8d1f-4470-b3de-13c644b277ec None admin] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:08.963018 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4923fef6-8d1f-4470-b3de-13c644b277ec None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:08.963380 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4923fef6-8d1f-4470-b3de-13c644b277ec None admin] PATH_INFO: `/v3/endpoints` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:08.964252 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4923fef6-8d1f-4470-b3de-13c644b277ec None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:08.966005 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4923fef6-8d1f-4470-b3de-13c644b277ec None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:08.987825 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 500/1003] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Jul 11 14:28:08 2022] POST /identity/v3/endpoints => generated 325 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:28:09.009612 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2da803-1374-4da4-956c-feb1d3493f8f None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:09.079928 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2048e3-8efe-42a6-ab29-84aac337f30b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:09.080989 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2048e3-8efe-42a6-ab29-84aac337f30b None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:09.081500 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2048e3-8efe-42a6-ab29-84aac337f30b None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:09.082043 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2048e3-8efe-42a6-ab29-84aac337f30b None admin] PATH_INFO: `/v3/services` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:09.082993 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2048e3-8efe-42a6-ab29-84aac337f30b None admin] RBAC: Adding query filter params (name=compute) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:28:09.083555 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2048e3-8efe-42a6-ab29-84aac337f30b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:09.085270 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2048e3-8efe-42a6-ab29-84aac337f30b None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:09.091510 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 504/1004] 10.222.0.70 () {56 vars in 1112 bytes} [Mon Jul 11 14:28:08 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:28:09.098503 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4923fef6-8d1f-4470-b3de-13c644b277ec None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:09.191024 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf01c3e7-db82-4f7f-8fc5-4ea7bc7af877 None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:09.191453 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf01c3e7-db82-4f7f-8fc5-4ea7bc7af877 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:09.191865 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf01c3e7-db82-4f7f-8fc5-4ea7bc7af877 None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:09.194051 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 505/1005] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:28:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:28:09.201149 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd19b433-d34e-4ee8-a11e-9f1a0d74f823 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:09.202156 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd19b433-d34e-4ee8-a11e-9f1a0d74f823 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:09.202590 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd19b433-d34e-4ee8-a11e-9f1a0d74f823 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:09.231707 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-fd19b433-d34e-4ee8-a11e-9f1a0d74f823 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:28:09.233984 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-fd19b433-d34e-4ee8-a11e-9f1a0d74f823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:28:09.250209 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4923fef6-8d1f-4470-b3de-13c644b277ec None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:09.289852 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd8ec6b-ed7e-4036-bec9-f236f038518f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:09.290529 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd8ec6b-ed7e-4036-bec9-f236f038518f None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:09.290816 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd8ec6b-ed7e-4036-bec9-f236f038518f None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:09.291093 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd8ec6b-ed7e-4036-bec9-f236f038518f None admin] PATH_INFO: `/v3/services` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:09.291817 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd8ec6b-ed7e-4036-bec9-f236f038518f None admin] RBAC: Adding query filter params (type=compute) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:28:09.292127 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd8ec6b-ed7e-4036-bec9-f236f038518f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:09.293539 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd8ec6b-ed7e-4036-bec9-f236f038518f None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:09.299847 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 501/1006] 10.222.0.70 () {56 vars in 1112 bytes} [Mon Jul 11 14:28:09 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:28:09.305281 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd8ec6b-ed7e-4036-bec9-f236f038518f None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:09.320575 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:09.328251 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 506/1007] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:28:09 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:28:09.352779 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd19b433-d34e-4ee8-a11e-9f1a0d74f823 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:09.355169 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:09.430726 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd8ec6b-ed7e-4036-bec9-f236f038518f None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:09.467279 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cc8bd0-eec0-4649-afda-60d48744f8ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:09.468504 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cc8bd0-eec0-4649-afda-60d48744f8ad None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:09.468791 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cc8bd0-eec0-4649-afda-60d48744f8ad None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:09.469061 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cc8bd0-eec0-4649-afda-60d48744f8ad None admin] PATH_INFO: `/v3/endpoints` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:09.469869 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cc8bd0-eec0-4649-afda-60d48744f8ad None admin] RBAC: Adding query filter params (interface=public, service_id=cfd59bdaf5e644b1a56f65f197109e59, region_id=RegionOne) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:28:09.470183 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cc8bd0-eec0-4649-afda-60d48744f8ad None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:09.471560 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cc8bd0-eec0-4649-afda-60d48744f8ad None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:09.473048 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd19b433-d34e-4ee8-a11e-9f1a0d74f823 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:09.477325 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 502/1008] 10.222.0.70 () {56 vars in 1251 bytes} [Mon Jul 11 14:28:09 2022] GET /identity/v3/endpoints?service_id=cfd59bdaf5e644b1a56f65f197109e59&interface=public®ion_id=RegionOne => generated 194 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:28:09.482744 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cc8bd0-eec0-4649-afda-60d48744f8ad None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:09.524280 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1916dbc9-0c5f-4c4e-9a25-f0c11560c1c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:09.524991 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1916dbc9-0c5f-4c4e-9a25-f0c11560c1c4 None admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:09.525309 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1916dbc9-0c5f-4c4e-9a25-f0c11560c1c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:09.525591 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1916dbc9-0c5f-4c4e-9a25-f0c11560c1c4 None admin] PATH_INFO: `/v3/services` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:09.526442 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1916dbc9-0c5f-4c4e-9a25-f0c11560c1c4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:09.527846 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1916dbc9-0c5f-4c4e-9a25-f0c11560c1c4 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:09.546879 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 507/1009] 10.222.0.70 () {60 vars in 1141 bytes} [Mon Jul 11 14:28:09 2022] POST /identity/v3/services => generated 242 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:28:09.597497 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:09.635538 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cc8bd0-eec0-4649-afda-60d48744f8ad None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:09.680790 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832e333b-6f14-4aa0-85d2-5e7ff49ab6c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:09.681569 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832e333b-6f14-4aa0-85d2-5e7ff49ab6c7 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:09.681955 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832e333b-6f14-4aa0-85d2-5e7ff49ab6c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:09.682232 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832e333b-6f14-4aa0-85d2-5e7ff49ab6c7 None admin] PATH_INFO: `/v3/services` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:09.682925 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832e333b-6f14-4aa0-85d2-5e7ff49ab6c7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:09.684330 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832e333b-6f14-4aa0-85d2-5e7ff49ab6c7 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:09.692535 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 503/1010] 10.222.0.70 () {56 vars in 1087 bytes} [Mon Jul 11 14:28:09 2022] GET /identity/v3/services => generated 1957 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 14:28:11.137556 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c2d158-1063-4b2c-95fb-b6b9a4545163 None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:11.138089 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c2d158-1063-4b2c-95fb-b6b9a4545163 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:11.138089 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c2d158-1063-4b2c-95fb-b6b9a4545163 None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:11.140179 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 508/1011] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:28:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:28:11.145287 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc187b6-8ba4-4eff-8761-2bfd80fd34af None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:11.145721 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc187b6-8ba4-4eff-8761-2bfd80fd34af None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:11.145888 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc187b6-8ba4-4eff-8761-2bfd80fd34af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:11.163182 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-bfc187b6-8ba4-4eff-8761-2bfd80fd34af None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:28:11.164391 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-bfc187b6-8ba4-4eff-8761-2bfd80fd34af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:28:11.233971 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 504/1012] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:28:11 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:28:11.256804 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c2d158-1063-4b2c-95fb-b6b9a4545163 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:11.326392 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:11.371985 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c2d158-1063-4b2c-95fb-b6b9a4545163 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:11.409311 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc171a7-5d00-414c-ac5f-9ca1b6aa44bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:11.410113 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc171a7-5d00-414c-ac5f-9ca1b6aa44bb None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:11.410392 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc171a7-5d00-414c-ac5f-9ca1b6aa44bb None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:11.410665 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc171a7-5d00-414c-ac5f-9ca1b6aa44bb None admin] PATH_INFO: `/v3/domains/default` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:11.411862 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc171a7-5d00-414c-ac5f-9ca1b6aa44bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:11.413352 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc171a7-5d00-414c-ac5f-9ca1b6aa44bb None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:11.415145 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 509/1013] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 11 14:28:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:28:11.421621 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc187b6-8ba4-4eff-8761-2bfd80fd34af None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:11.492994 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:11.537286 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc187b6-8ba4-4eff-8761-2bfd80fd34af None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:11.587748 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097beb84-5f1d-4e05-ac4a-a60325319a8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:11.588444 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097beb84-5f1d-4e05-ac4a-a60325319a8c None admin] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:11.588725 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097beb84-5f1d-4e05-ac4a-a60325319a8c None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:11.588999 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097beb84-5f1d-4e05-ac4a-a60325319a8c None admin] PATH_INFO: `/v3/projects` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:11.589711 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097beb84-5f1d-4e05-ac4a-a60325319a8c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:11.591149 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097beb84-5f1d-4e05-ac4a-a60325319a8c None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:11.628235 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 505/1014] 10.222.0.70 () {60 vars in 1141 bytes} [Mon Jul 11 14:28:11 2022] POST /identity/v3/projects => generated 311 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:28:11.636822 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97ec28b-d89e-4c5d-bf5d-c50bb972fccb None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:11.637113 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97ec28b-d89e-4c5d-bf5d-c50bb972fccb None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:11.637391 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97ec28b-d89e-4c5d-bf5d-c50bb972fccb None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:11.639036 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 510/1015] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:28:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 14:28:11.645304 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cea619-db7d-4ec5-b69e-cec5084aa3c4 None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:11.645610 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cea619-db7d-4ec5-b69e-cec5084aa3c4 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:11.645862 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cea619-db7d-4ec5-b69e-cec5084aa3c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:11.666265 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-37cea619-db7d-4ec5-b69e-cec5084aa3c4 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:28:11.667419 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-37cea619-db7d-4ec5-b69e-cec5084aa3c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:28:11.752244 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 506/1016] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:28:11 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:28:11.765754 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206634d6-2246-43a5-acfe-8829d8509778 None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:11.766077 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206634d6-2246-43a5-acfe-8829d8509778 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:11.766319 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206634d6-2246-43a5-acfe-8829d8509778 None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:11.767964 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 511/1017] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:28:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:28:11.773906 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2d7dbd-922d-40e7-883e-08e84afd1a7f None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:11.774268 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2d7dbd-922d-40e7-883e-08e84afd1a7f None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:11.774471 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2d7dbd-922d-40e7-883e-08e84afd1a7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:11.781174 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206634d6-2246-43a5-acfe-8829d8509778 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:11.794053 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-8b2d7dbd-922d-40e7-883e-08e84afd1a7f None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:28:11.795336 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-8b2d7dbd-922d-40e7-883e-08e84afd1a7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:28:11.852196 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:11.887386 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 507/1018] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:28:11 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:28:11.910862 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206634d6-2246-43a5-acfe-8829d8509778 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:11.913359 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2d7dbd-922d-40e7-883e-08e84afd1a7f None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:11.946032 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:11.953651 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec05e488-8077-4d1a-946f-dd2fb51bb2f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:11.954459 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec05e488-8077-4d1a-946f-dd2fb51bb2f9 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:11.954769 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec05e488-8077-4d1a-946f-dd2fb51bb2f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:11.955023 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec05e488-8077-4d1a-946f-dd2fb51bb2f9 None admin] PATH_INFO: `/v3/services/image` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:11.955684 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec05e488-8077-4d1a-946f-dd2fb51bb2f9 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:11.957108 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec05e488-8077-4d1a-946f-dd2fb51bb2f9 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:11.970155 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-ec05e488-8077-4d1a-946f-dd2fb51bb2f9 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 11 14:28:11.970155 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:28:11.970155 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 14:28:11.970155 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 14:28:11.970155 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 14:28:11.970155 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 14:28:11.970155 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 14:28:11.970155 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:28:11.970155 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 11 14:28:11.970155 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Jul 11 14:28:11.970155 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 14:28:11.970155 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Jul 11 14:28:11.970155 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:28:11.970155 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:28:11.970155 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:28:11.970155 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:28:11.970155 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:28:11.971225 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:28:11.971225 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:28:11.971225 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:28:11.971225 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:28:11.971225 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:28:11.971225 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:28:11.971225 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 14:28:11.971225 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 14:28:11.971225 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 14:28:11.971225 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 14:28:11.971225 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:28:11.971225 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:28:11.971225 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:28:11.971225 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:28:11.971225 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:28:11.971225 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:28:11.972077 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:28:11.972077 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( Jul 11 14:28:11.972077 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:28:11.972077 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:28:11.972077 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:28:11.972077 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:28:11.972077 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:28:11.972077 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:28:11.972077 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:28:11.972077 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:28:11.972077 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 14:28:11.972077 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:28:11.972077 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 11 14:28:11.972077 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Jul 11 14:28:11.972077 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 512/1019] 10.222.0.70 () {56 vars in 1105 bytes} [Mon Jul 11 14:28:11 2022] GET /identity/v3/services/image => generated 86 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:28:11.977304 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec05e488-8077-4d1a-946f-dd2fb51bb2f9 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:12.041296 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2d7dbd-922d-40e7-883e-08e84afd1a7f None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:12.079792 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7b643e-7fd6-4ce4-bcd8-c29473691ebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:12.080726 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7b643e-7fd6-4ce4-bcd8-c29473691ebe None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:12.081017 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7b643e-7fd6-4ce4-bcd8-c29473691ebe None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:12.081278 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7b643e-7fd6-4ce4-bcd8-c29473691ebe None admin] PATH_INFO: `/v3/services/compute` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:12.081936 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7b643e-7fd6-4ce4-bcd8-c29473691ebe None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:12.083416 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7b643e-7fd6-4ce4-bcd8-c29473691ebe None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:12.093018 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec05e488-8077-4d1a-946f-dd2fb51bb2f9 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:12.096494 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application [None req-9b7b643e-7fd6-4ce4-bcd8-c29473691ebe None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 11 14:28:12.096494 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:28:12.096494 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 14:28:12.096494 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 14:28:12.096494 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 14:28:12.096494 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 14:28:12.096494 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 14:28:12.096494 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:28:12.096494 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 11 14:28:12.096494 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Jul 11 14:28:12.096494 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 14:28:12.096494 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Jul 11 14:28:12.096494 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:28:12.096494 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:28:12.096494 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:28:12.096494 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:28:12.096494 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:28:12.097530 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:28:12.097530 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:28:12.097530 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:28:12.097530 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:28:12.097530 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:28:12.097530 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:28:12.097530 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 14:28:12.097530 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 14:28:12.097530 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 14:28:12.097530 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 14:28:12.097530 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:28:12.097530 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:28:12.097530 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:28:12.097530 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:28:12.097530 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:28:12.097530 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:28:12.101128 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:28:12.101128 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application with Lock( Jul 11 14:28:12.101128 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:28:12.101128 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:28:12.101128 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:28:12.101128 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:28:12.101128 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:28:12.101128 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:28:12.101128 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:28:12.101128 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:28:12.101128 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 14:28:12.101128 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:28:12.101128 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 11 14:28:12.101128 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Jul 11 14:28:12.101128 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 508/1020] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Jul 11 14:28:11 2022] GET /identity/v3/services/compute => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:28:12.103550 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7b643e-7fd6-4ce4-bcd8-c29473691ebe None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:12.133133 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682cf949-feb0-4892-8d04-8e2c95bda70e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:12.133802 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682cf949-feb0-4892-8d04-8e2c95bda70e None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:12.134090 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682cf949-feb0-4892-8d04-8e2c95bda70e None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:12.134368 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682cf949-feb0-4892-8d04-8e2c95bda70e None admin] PATH_INFO: `/v3/services` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:12.135144 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682cf949-feb0-4892-8d04-8e2c95bda70e None admin] RBAC: Adding query filter params (name=image) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:28:12.135461 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682cf949-feb0-4892-8d04-8e2c95bda70e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:12.136913 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682cf949-feb0-4892-8d04-8e2c95bda70e None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:12.142429 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 513/1021] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 11 14:28:11 2022] GET /identity/v3/services?name=image => generated 122 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:28:12.148089 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682cf949-feb0-4892-8d04-8e2c95bda70e None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:12.153508 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:12.211756 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:12.223903 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7b643e-7fd6-4ce4-bcd8-c29473691ebe None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:12.261467 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba88e1bc-48ec-45c9-8806-3a46f5dc84fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:12.262142 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba88e1bc-48ec-45c9-8806-3a46f5dc84fb None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:12.262318 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682cf949-feb0-4892-8d04-8e2c95bda70e None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:12.262422 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba88e1bc-48ec-45c9-8806-3a46f5dc84fb None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:12.262692 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba88e1bc-48ec-45c9-8806-3a46f5dc84fb None admin] PATH_INFO: `/v3/services` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:12.263403 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba88e1bc-48ec-45c9-8806-3a46f5dc84fb None admin] RBAC: Adding query filter params (name=compute) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:28:12.263715 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba88e1bc-48ec-45c9-8806-3a46f5dc84fb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:12.265788 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba88e1bc-48ec-45c9-8806-3a46f5dc84fb None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:12.270828 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 509/1022] 10.222.0.70 () {56 vars in 1112 bytes} [Mon Jul 11 14:28:12 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:28:12.276593 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba88e1bc-48ec-45c9-8806-3a46f5dc84fb None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:12.303110 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7da75db-1c28-40bf-b811-5bf4398284be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:12.303772 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7da75db-1c28-40bf-b811-5bf4398284be None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:12.304057 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7da75db-1c28-40bf-b811-5bf4398284be None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:12.304374 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7da75db-1c28-40bf-b811-5bf4398284be None admin] PATH_INFO: `/v3/services` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:12.305075 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7da75db-1c28-40bf-b811-5bf4398284be None admin] RBAC: Adding query filter params (type=image) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:28:12.305632 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7da75db-1c28-40bf-b811-5bf4398284be None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:12.306986 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7da75db-1c28-40bf-b811-5bf4398284be None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:12.312969 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 514/1023] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 11 14:28:12 2022] GET /identity/v3/services?type=image => generated 350 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:28:12.318712 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7da75db-1c28-40bf-b811-5bf4398284be None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:12.387602 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba88e1bc-48ec-45c9-8806-3a46f5dc84fb None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:12.389190 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:12.425163 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b38f11-d27e-4a30-ba6c-59b1f0d912d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:12.425375 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7da75db-1c28-40bf-b811-5bf4398284be None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:12.425838 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b38f11-d27e-4a30-ba6c-59b1f0d912d4 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:12.426120 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b38f11-d27e-4a30-ba6c-59b1f0d912d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:12.426395 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b38f11-d27e-4a30-ba6c-59b1f0d912d4 None admin] PATH_INFO: `/v3/services` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:12.427112 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b38f11-d27e-4a30-ba6c-59b1f0d912d4 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:28:12.427457 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b38f11-d27e-4a30-ba6c-59b1f0d912d4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:12.428816 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b38f11-d27e-4a30-ba6c-59b1f0d912d4 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:12.434535 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 510/1024] 10.222.0.70 () {56 vars in 1112 bytes} [Mon Jul 11 14:28:12 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:28:12.440537 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b38f11-d27e-4a30-ba6c-59b1f0d912d4 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:12.450372 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:12.464065 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7797b8f-963c-453f-b0ea-fa248ee12ef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:12.464802 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7797b8f-963c-453f-b0ea-fa248ee12ef4 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:12.465083 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7797b8f-963c-453f-b0ea-fa248ee12ef4 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:12.465357 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7797b8f-963c-453f-b0ea-fa248ee12ef4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:12.466143 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7797b8f-963c-453f-b0ea-fa248ee12ef4 None admin] RBAC: Adding query filter params (interface=public, service_id=bc703352618b4286b77b400ffcd90d73, region_id=RegionOne) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:28:12.466454 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7797b8f-963c-453f-b0ea-fa248ee12ef4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:12.467974 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7797b8f-963c-453f-b0ea-fa248ee12ef4 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:12.478717 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 515/1025] 10.222.0.70 () {56 vars in 1251 bytes} [Mon Jul 11 14:28:12 2022] GET /identity/v3/endpoints?service_id=bc703352618b4286b77b400ffcd90d73&interface=public®ion_id=RegionOne => generated 194 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:28:12.479698 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7797b8f-963c-453f-b0ea-fa248ee12ef4 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:12.546536 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b38f11-d27e-4a30-ba6c-59b1f0d912d4 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:12.588123 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d139904-e198-41d6-902d-84f1dcd224f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:12.588813 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d139904-e198-41d6-902d-84f1dcd224f4 None admin] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:12.589096 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d139904-e198-41d6-902d-84f1dcd224f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:12.589369 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d139904-e198-41d6-902d-84f1dcd224f4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:12.590115 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d139904-e198-41d6-902d-84f1dcd224f4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:12.592007 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d139904-e198-41d6-902d-84f1dcd224f4 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:12.599393 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7797b8f-963c-453f-b0ea-fa248ee12ef4 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:12.612775 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 511/1026] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Jul 11 14:28:12 2022] POST /identity/v3/endpoints => generated 334 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:28:12.650183 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee65244-bb85-4374-9d8a-3ec3429ecab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:12.650955 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee65244-bb85-4374-9d8a-3ec3429ecab9 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:12.651333 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee65244-bb85-4374-9d8a-3ec3429ecab9 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:12.651651 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee65244-bb85-4374-9d8a-3ec3429ecab9 None admin] PATH_INFO: `/v3/services` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:12.652441 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee65244-bb85-4374-9d8a-3ec3429ecab9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:12.654123 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee65244-bb85-4374-9d8a-3ec3429ecab9 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:12.668709 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 516/1027] 10.222.0.70 () {56 vars in 1087 bytes} [Mon Jul 11 14:28:12 2022] GET /identity/v3/services => generated 1957 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:28:13.802429 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f768ddf2-ee4d-4066-8439-1df9af057a0c None None] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:13.802953 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f768ddf2-ee4d-4066-8439-1df9af057a0c None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:13.802953 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f768ddf2-ee4d-4066-8439-1df9af057a0c None None] PATH_INFO: `/` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:13.804429 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 512/1028] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:28:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:28:13.810727 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb19078-afb7-4c11-aae9-b7d710ca4704 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:13.811343 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb19078-afb7-4c11-aae9-b7d710ca4704 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:13.811343 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb19078-afb7-4c11-aae9-b7d710ca4704 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:13.829770 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-2bb19078-afb7-4c11-aae9-b7d710ca4704 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:28:13.830888 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-2bb19078-afb7-4c11-aae9-b7d710ca4704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:28:13.880908 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:13.911055 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 517/1029] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:28:13 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:28:13.935714 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f768ddf2-ee4d-4066-8439-1df9af057a0c None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:13.962304 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:14.044601 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f768ddf2-ee4d-4066-8439-1df9af057a0c None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:14.082150 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b3cd33-6bfe-4d4e-8305-bc33443cc8f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:14.082854 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b3cd33-6bfe-4d4e-8305-bc33443cc8f2 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:14.083130 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b3cd33-6bfe-4d4e-8305-bc33443cc8f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:14.083403 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b3cd33-6bfe-4d4e-8305-bc33443cc8f2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:14.084603 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b3cd33-6bfe-4d4e-8305-bc33443cc8f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:14.086082 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b3cd33-6bfe-4d4e-8305-bc33443cc8f2 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:14.087865 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 513/1030] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 11 14:28:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:28:14.093712 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb19078-afb7-4c11-aae9-b7d710ca4704 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:14.212219 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb19078-afb7-4c11-aae9-b7d710ca4704 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:14.249842 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476bc194-3615-40ca-964a-e3d7f0f451a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:14.250527 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476bc194-3615-40ca-964a-e3d7f0f451a4 None admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:14.250808 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476bc194-3615-40ca-964a-e3d7f0f451a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:14.251077 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476bc194-3615-40ca-964a-e3d7f0f451a4 None admin] PATH_INFO: `/v3/users` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:14.251798 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476bc194-3615-40ca-964a-e3d7f0f451a4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:14.253263 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476bc194-3615-40ca-964a-e3d7f0f451a4 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:14.275567 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 518/1031] 10.222.0.70 () {60 vars in 1132 bytes} [Mon Jul 11 14:28:14 2022] POST /identity/v3/users => generated 285 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:28:14.774937 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40cc926-e622-4e48-9b57-8f476b96d68d None None] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:14.775269 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40cc926-e622-4e48-9b57-8f476b96d68d None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:14.775500 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40cc926-e622-4e48-9b57-8f476b96d68d None None] PATH_INFO: `/` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:14.776967 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 514/1032] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:28:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 14:28:14.783205 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eae7ec8-7479-40f8-afbc-cbb4f23cbfd6 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:14.783497 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eae7ec8-7479-40f8-afbc-cbb4f23cbfd6 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:14.783779 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eae7ec8-7479-40f8-afbc-cbb4f23cbfd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:14.801735 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-0eae7ec8-7479-40f8-afbc-cbb4f23cbfd6 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:28:14.802937 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-0eae7ec8-7479-40f8-afbc-cbb4f23cbfd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:28:14.831967 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:14.877728 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 519/1033] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:28:14 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:28:14.901777 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40cc926-e622-4e48-9b57-8f476b96d68d None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:14.919318 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c826d7c1-9551-4b12-8a4f-3e2681b902f4 None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:14.919660 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c826d7c1-9551-4b12-8a4f-3e2681b902f4 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:14.919879 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c826d7c1-9551-4b12-8a4f-3e2681b902f4 None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:14.921894 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 520/1034] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:28:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 14:28:14.926908 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a026fbea-83b9-4288-97a9-7761c6cf7054 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:14.927193 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a026fbea-83b9-4288-97a9-7761c6cf7054 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:14.927481 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a026fbea-83b9-4288-97a9-7761c6cf7054 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:14.947936 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-a026fbea-83b9-4288-97a9-7761c6cf7054 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:28:14.949198 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-a026fbea-83b9-4288-97a9-7761c6cf7054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:28:15.012687 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:15.029515 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40cc926-e622-4e48-9b57-8f476b96d68d None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:15.039176 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 521/1035] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:28:14 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 14:28:15.063305 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a026fbea-83b9-4288-97a9-7761c6cf7054 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:15.072733 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c752ba23-6ef3-4cf1-baf7-89bd2fb6753b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:15.073586 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c752ba23-6ef3-4cf1-baf7-89bd2fb6753b None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:15.073873 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c752ba23-6ef3-4cf1-baf7-89bd2fb6753b None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:15.074149 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c752ba23-6ef3-4cf1-baf7-89bd2fb6753b None admin] PATH_INFO: `/v3/services/image` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:15.075313 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c752ba23-6ef3-4cf1-baf7-89bd2fb6753b None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:15.077707 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c752ba23-6ef3-4cf1-baf7-89bd2fb6753b None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:15.090998 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application [None req-c752ba23-6ef3-4cf1-baf7-89bd2fb6753b None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 11 14:28:15.090998 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:28:15.090998 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 14:28:15.090998 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 14:28:15.090998 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 14:28:15.090998 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 14:28:15.090998 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 14:28:15.090998 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:28:15.090998 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 11 14:28:15.090998 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Jul 11 14:28:15.090998 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 14:28:15.090998 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Jul 11 14:28:15.090998 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:28:15.090998 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:28:15.090998 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:28:15.090998 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:28:15.090998 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:28:15.092088 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:28:15.092088 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:28:15.092088 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:28:15.092088 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:28:15.092088 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:28:15.092088 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:28:15.092088 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 14:28:15.092088 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 14:28:15.092088 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 14:28:15.092088 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 14:28:15.092088 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:28:15.092088 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:28:15.092088 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:28:15.092088 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:28:15.092088 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:28:15.092088 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:28:15.093731 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:28:15.093731 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application with Lock( Jul 11 14:28:15.093731 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:28:15.093731 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:28:15.093731 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:28:15.093731 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:28:15.093731 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:28:15.093731 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:28:15.093731 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:28:15.093731 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:28:15.093731 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 14:28:15.093731 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:28:15.093731 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 11 14:28:15.093731 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Jul 11 14:28:15.093731 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 515/1036] 10.222.0.70 () {56 vars in 1105 bytes} [Mon Jul 11 14:28:14 2022] GET /identity/v3/services/image => generated 86 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:28:15.098882 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c752ba23-6ef3-4cf1-baf7-89bd2fb6753b None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:15.171665 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:15.182409 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a026fbea-83b9-4288-97a9-7761c6cf7054 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:15.215959 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c752ba23-6ef3-4cf1-baf7-89bd2fb6753b None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:15.227490 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a33f31-702d-4c88-b2be-9809c1be54db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:15.228592 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a33f31-702d-4c88-b2be-9809c1be54db None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:15.228875 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a33f31-702d-4c88-b2be-9809c1be54db None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:15.229147 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a33f31-702d-4c88-b2be-9809c1be54db None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:15.240458 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a33f31-702d-4c88-b2be-9809c1be54db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:28:15.249497 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-35a33f31-702d-4c88-b2be-9809c1be54db None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 11 14:28:15.249497 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:28:15.249497 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:28:15.249497 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:28:15.249497 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:28:15.249497 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:28:15.249497 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:28:15.249497 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:28:15.249497 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:28:15.249497 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:28:15.249497 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:28:15.249497 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:28:15.249497 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:28:15.249497 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:28:15.249497 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:28:15.249497 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:28:15.250446 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:28:15.250446 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:28:15.250446 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:28:15.250446 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:28:15.250446 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:28:15.250446 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:28:15.250446 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:28:15.250446 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:28:15.250446 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:28:15.250446 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:28:15.250446 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:28:15.250446 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( Jul 11 14:28:15.250446 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:28:15.250446 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:28:15.250446 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:28:15.250446 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:28:15.251361 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:28:15.251361 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:28:15.251361 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:28:15.251361 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:28:15.251361 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:28:15.251361 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:28:15.251361 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:28:15.251361 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:28:15.251361 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:28:15.251361 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:28:15.251361 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 11 14:28:15.251361 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Jul 11 14:28:15.251361 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 522/1037] 10.222.0.70 () {56 vars in 1120 bytes} [Mon Jul 11 14:28:15 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:28:15.255279 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b58cca4-51d7-4e88-a773-7dfb33fa58a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:15.256037 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b58cca4-51d7-4e88-a773-7dfb33fa58a1 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:15.256358 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b58cca4-51d7-4e88-a773-7dfb33fa58a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:15.256632 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b58cca4-51d7-4e88-a773-7dfb33fa58a1 None admin] PATH_INFO: `/v3/services` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:15.256908 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a33f31-702d-4c88-b2be-9809c1be54db None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:15.257340 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b58cca4-51d7-4e88-a773-7dfb33fa58a1 None admin] RBAC: Adding query filter params (name=image) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:28:15.257643 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b58cca4-51d7-4e88-a773-7dfb33fa58a1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:15.259167 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b58cca4-51d7-4e88-a773-7dfb33fa58a1 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:15.272699 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 516/1038] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 11 14:28:15 2022] GET /identity/v3/services?name=image => generated 122 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:28:15.273799 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b58cca4-51d7-4e88-a773-7dfb33fa58a1 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:15.296978 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:15.397574 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b58cca4-51d7-4e88-a773-7dfb33fa58a1 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:15.398111 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a33f31-702d-4c88-b2be-9809c1be54db None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:15.433478 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6346c121-f6df-4f1e-873e-d56100928a70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:15.433689 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7950ed-0523-456e-bc71-1bbf5d9e9ed8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:15.434147 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6346c121-f6df-4f1e-873e-d56100928a70 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:15.434251 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7950ed-0523-456e-bc71-1bbf5d9e9ed8 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:15.434425 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7950ed-0523-456e-bc71-1bbf5d9e9ed8 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:15.434520 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6346c121-f6df-4f1e-873e-d56100928a70 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:15.434782 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7950ed-0523-456e-bc71-1bbf5d9e9ed8 None admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:15.434884 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6346c121-f6df-4f1e-873e-d56100928a70 None admin] PATH_INFO: `/v3/services` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:15.435393 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6346c121-f6df-4f1e-873e-d56100928a70 None admin] RBAC: Adding query filter params (type=image) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:28:15.435502 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7950ed-0523-456e-bc71-1bbf5d9e9ed8 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:28:15.435701 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6346c121-f6df-4f1e-873e-d56100928a70 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:15.435874 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7950ed-0523-456e-bc71-1bbf5d9e9ed8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:15.437257 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6346c121-f6df-4f1e-873e-d56100928a70 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:15.437362 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7950ed-0523-456e-bc71-1bbf5d9e9ed8 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:15.447361 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 517/1039] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 11 14:28:15 2022] GET /identity/v3/services?type=image => generated 350 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:28:15.448182 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6346c121-f6df-4f1e-873e-d56100928a70 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:15.457187 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 523/1040] 10.222.0.70 () {56 vars in 1115 bytes} [Mon Jul 11 14:28:15 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:28:15.459633 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7950ed-0523-456e-bc71-1bbf5d9e9ed8 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:15.480060 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:15.556747 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:15.578966 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6346c121-f6df-4f1e-873e-d56100928a70 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:15.584011 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7950ed-0523-456e-bc71-1bbf5d9e9ed8 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:15.619034 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd06e6e-90cb-4bf6-a0a9-18520088a9f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:15.619693 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd06e6e-90cb-4bf6-a0a9-18520088a9f8 None admin] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:15.619982 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd06e6e-90cb-4bf6-a0a9-18520088a9f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:15.620086 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ceb8b6-2af6-4fed-8984-cd29c1ed5524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:15.620297 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd06e6e-90cb-4bf6-a0a9-18520088a9f8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:15.620912 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ceb8b6-2af6-4fed-8984-cd29c1ed5524 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:15.621012 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd06e6e-90cb-4bf6-a0a9-18520088a9f8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:15.621197 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ceb8b6-2af6-4fed-8984-cd29c1ed5524 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:15.621477 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ceb8b6-2af6-4fed-8984-cd29c1ed5524 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:15.622394 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd06e6e-90cb-4bf6-a0a9-18520088a9f8 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:15.635554 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ceb8b6-2af6-4fed-8984-cd29c1ed5524 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:15.637108 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ceb8b6-2af6-4fed-8984-cd29c1ed5524 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:15.656338 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 518/1041] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Jul 11 14:28:15 2022] POST /identity/v3/endpoints => generated 327 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:28:15.667201 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-d4ceb8b6-2af6-4fed-8984-cd29c1ed5524 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:28:15.667201 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:28:15.667201 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:28:15.667201 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:28:15.667201 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:28:15.667201 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:28:15.667201 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:28:15.667201 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:28:15.667201 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:28:15.667201 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:28:15.667201 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:28:15.667201 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:28:15.667201 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:28:15.667201 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:28:15.667201 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:28:15.668473 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:28:15.668473 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:28:15.668473 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:28:15.668473 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:28:15.668473 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:28:15.668473 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:28:15.668473 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:28:15.668473 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:28:15.668473 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( Jul 11 14:28:15.668473 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:28:15.668473 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:28:15.668473 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:28:15.668473 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:28:15.668473 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:28:15.668473 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:28:15.668473 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:28:15.668473 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:28:15.669596 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:28:15.669596 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:28:15.669596 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:28:15.669596 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Jul 11 14:28:15.669596 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 524/1042] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 11 14:28:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:28:15.676468 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd06e6e-90cb-4bf6-a0a9-18520088a9f8 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:15.816376 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd06e6e-90cb-4bf6-a0a9-18520088a9f8 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:15.856306 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2f8a43-24d6-45a6-bf6b-bcba2dd99efc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:15.857064 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2f8a43-24d6-45a6-bf6b-bcba2dd99efc None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:15.857353 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2f8a43-24d6-45a6-bf6b-bcba2dd99efc None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:15.857787 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2f8a43-24d6-45a6-bf6b-bcba2dd99efc None admin] PATH_INFO: `/v3/domains` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:15.858706 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2f8a43-24d6-45a6-bf6b-bcba2dd99efc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:28:15.859016 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2f8a43-24d6-45a6-bf6b-bcba2dd99efc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:15.860422 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2f8a43-24d6-45a6-bf6b-bcba2dd99efc None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:15.862148 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:15.880402 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 519/1043] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jul 11 14:28:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:28:15.881670 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ceb8b6-2af6-4fed-8984-cd29c1ed5524 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:15.950504 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:15.991803 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ceb8b6-2af6-4fed-8984-cd29c1ed5524 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:16.036082 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef7f6fb-567b-4741-8a54-99d49b0abb0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:16.036911 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef7f6fb-567b-4741-8a54-99d49b0abb0e None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:16.037199 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef7f6fb-567b-4741-8a54-99d49b0abb0e None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:16.037464 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef7f6fb-567b-4741-8a54-99d49b0abb0e None admin] PATH_INFO: `/v3/users/nova` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:16.046555 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef7f6fb-567b-4741-8a54-99d49b0abb0e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:16.048050 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef7f6fb-567b-4741-8a54-99d49b0abb0e None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:16.064038 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-6ef7f6fb-567b-4741-8a54-99d49b0abb0e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 11 14:28:16.064038 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:28:16.064038 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:28:16.064038 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:28:16.064038 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:28:16.064038 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:28:16.064038 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:28:16.064038 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:28:16.064038 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:28:16.064038 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:28:16.064038 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:28:16.064038 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:28:16.064038 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 14:28:16.064038 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 14:28:16.064038 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 14:28:16.064038 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 14:28:16.065582 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:28:16.065582 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:28:16.065582 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 14:28:16.065582 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:28:16.065582 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 14:28:16.065582 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:28:16.065582 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:28:16.065582 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:28:16.065582 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:28:16.065582 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:28:16.065582 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:28:16.065582 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( Jul 11 14:28:16.065582 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:28:16.065582 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:28:16.065582 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:28:16.065582 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:28:16.065582 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:28:16.065582 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:28:16.066560 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:28:16.066560 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:28:16.066560 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 14:28:16.066560 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 14:28:16.066560 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 14:28:16.066560 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 14:28:16.066560 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 14:28:16.066560 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 14:28:16.066560 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 11 14:28:16.066560 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Jul 11 14:28:16.071851 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 525/1044] 10.222.0.70 () {56 vars in 1093 bytes} [Mon Jul 11 14:28:15 2022] GET /identity/v3/users/nova => generated 82 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:28:16.073287 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2f8a43-24d6-45a6-bf6b-bcba2dd99efc None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:16.181601 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2f8a43-24d6-45a6-bf6b-bcba2dd99efc None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:16.218478 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5a5ce0-d063-45b9-b155-cb39cf6338ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:16.219080 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5a5ce0-d063-45b9-b155-cb39cf6338ff None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:16.219366 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5a5ce0-d063-45b9-b155-cb39cf6338ff None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:16.219645 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5a5ce0-d063-45b9-b155-cb39cf6338ff None admin] PATH_INFO: `/v3/users` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:16.220517 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5a5ce0-d063-45b9-b155-cb39cf6338ff None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:28:16.220836 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5a5ce0-d063-45b9-b155-cb39cf6338ff None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:16.222272 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5a5ce0-d063-45b9-b155-cb39cf6338ff None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:16.246901 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 520/1045] 10.222.0.70 () {56 vars in 1133 bytes} [Mon Jul 11 14:28:16 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:28:16.248069 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef7f6fb-567b-4741-8a54-99d49b0abb0e None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:16.358563 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef7f6fb-567b-4741-8a54-99d49b0abb0e None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:16.392248 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:16.402901 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7d1d2c-45b3-44b2-b860-ad6d6ea8f954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:16.403558 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7d1d2c-45b3-44b2-b860-ad6d6ea8f954 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:16.403843 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7d1d2c-45b3-44b2-b860-ad6d6ea8f954 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:16.404118 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7d1d2c-45b3-44b2-b860-ad6d6ea8f954 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:16.477657 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7d1d2c-45b3-44b2-b860-ad6d6ea8f954 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:16.479032 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7d1d2c-45b3-44b2-b860-ad6d6ea8f954 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:16.492323 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60664e26-f088-493a-a507-44e5b8f381a8 None None] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:16.492618 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60664e26-f088-493a-a507-44e5b8f381a8 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:16.492894 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60664e26-f088-493a-a507-44e5b8f381a8 None None] PATH_INFO: `/` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:16.494259 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 521/1046] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:28:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 14:28:16.500667 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bcbcfc-66b8-41b5-86f3-3a236646462b None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:16.500957 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bcbcfc-66b8-41b5-86f3-3a236646462b None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:16.501235 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bcbcfc-66b8-41b5-86f3-3a236646462b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:16.519407 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-51bcbcfc-66b8-41b5-86f3-3a236646462b None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:28:16.520672 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-51bcbcfc-66b8-41b5-86f3-3a236646462b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:28:16.579523 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:16.596120 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 526/1047] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Jul 11 14:28:16 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 11 14:28:16.601658 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7d1d2c-45b3-44b2-b860-ad6d6ea8f954 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:16.605284 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 522/1048] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:28:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 14:28:16.630061 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bcbcfc-66b8-41b5-86f3-3a236646462b None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:16.631372 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:16.713011 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7d1d2c-45b3-44b2-b860-ad6d6ea8f954 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:16.752486 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ad0c08-db5a-45b9-a137-ba41b90ddf97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:16.753369 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ad0c08-db5a-45b9-a137-ba41b90ddf97 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:16.753657 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ad0c08-db5a-45b9-a137-ba41b90ddf97 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:16.754239 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ad0c08-db5a-45b9-a137-ba41b90ddf97 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:16.767790 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ad0c08-db5a-45b9-a137-ba41b90ddf97 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:16.769304 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ad0c08-db5a-45b9-a137-ba41b90ddf97 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:16.771948 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bcbcfc-66b8-41b5-86f3-3a236646462b None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:16.788331 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-79ad0c08-db5a-45b9-a137-ba41b90ddf97 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:28:16.788331 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:28:16.788331 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:28:16.788331 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:28:16.788331 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:28:16.788331 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:28:16.788331 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:28:16.788331 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:28:16.788331 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:28:16.788331 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:28:16.788331 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:28:16.788331 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:28:16.788331 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:28:16.788331 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:28:16.788331 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:28:16.789310 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:28:16.789310 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:28:16.789310 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:28:16.789310 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:28:16.789310 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:28:16.789310 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:28:16.789310 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:28:16.789310 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:28:16.789310 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( Jul 11 14:28:16.789310 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:28:16.789310 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:28:16.789310 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:28:16.789310 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:28:16.789310 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:28:16.789310 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:28:16.789310 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:28:16.789310 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:28:16.790198 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:28:16.790198 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:28:16.790198 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:28:16.790198 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Jul 11 14:28:16.797229 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 527/1049] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 11 14:28:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:28:16.798336 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ad0c08-db5a-45b9-a137-ba41b90ddf97 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:16.809894 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fd4c3f-70e7-4212-b9a6-fc2a15355c39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:16.811235 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fd4c3f-70e7-4212-b9a6-fc2a15355c39 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:16.811585 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fd4c3f-70e7-4212-b9a6-fc2a15355c39 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:16.811790 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fd4c3f-70e7-4212-b9a6-fc2a15355c39 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:16.822857 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fd4c3f-70e7-4212-b9a6-fc2a15355c39 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:28:16.832264 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application [None req-d6fd4c3f-70e7-4212-b9a6-fc2a15355c39 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:28:16.832264 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:28:16.832264 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:28:16.832264 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:28:16.832264 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:28:16.832264 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:28:16.832264 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:28:16.832264 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:28:16.832264 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:28:16.832264 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:28:16.832264 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:28:16.832264 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:28:16.832264 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:28:16.832264 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:28:16.832264 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:28:16.832264 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:28:16.833557 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:28:16.833557 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:28:16.833557 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:28:16.833557 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:28:16.833557 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:28:16.833557 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:28:16.833557 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:28:16.833557 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:28:16.833557 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:28:16.833557 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:28:16.833557 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:28:16.833557 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application with Lock( Jul 11 14:28:16.833557 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:28:16.833557 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:28:16.833557 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:28:16.833557 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:28:16.835220 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:28:16.835220 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:28:16.835220 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:28:16.835220 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:28:16.835220 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:28:16.835220 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:28:16.835220 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:28:16.835220 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:28:16.835220 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:28:16.835220 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:28:16.835220 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:28:16.835220 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Jul 11 14:28:16.835220 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 523/1050] 10.222.0.70 () {56 vars in 1096 bytes} [Mon Jul 11 14:28:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:28:16.839533 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fd4c3f-70e7-4212-b9a6-fc2a15355c39 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:16.891626 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:16.896254 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:16.920761 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ad0c08-db5a-45b9-a137-ba41b90ddf97 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:16.956705 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fd4c3f-70e7-4212-b9a6-fc2a15355c39 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:16.958320 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934a266c-473f-4b85-8581-6ed966af6e8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:16.958989 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934a266c-473f-4b85-8581-6ed966af6e8c None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:16.959269 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934a266c-473f-4b85-8581-6ed966af6e8c None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:16.959543 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934a266c-473f-4b85-8581-6ed966af6e8c None admin] PATH_INFO: `/v3/domains` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:16.960293 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934a266c-473f-4b85-8581-6ed966af6e8c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:28:16.960705 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934a266c-473f-4b85-8581-6ed966af6e8c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:16.962072 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934a266c-473f-4b85-8581-6ed966af6e8c None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:16.974341 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 528/1051] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jul 11 14:28:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:28:16.979998 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934a266c-473f-4b85-8581-6ed966af6e8c None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:16.995983 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844ad937-b86b-4312-b15a-3a237e82bebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:16.996698 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844ad937-b86b-4312-b15a-3a237e82bebf None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:16.996983 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844ad937-b86b-4312-b15a-3a237e82bebf None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:16.997263 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844ad937-b86b-4312-b15a-3a237e82bebf None admin] PATH_INFO: `/v3/roles` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:16.998011 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844ad937-b86b-4312-b15a-3a237e82bebf None admin] RBAC: Adding query filter params (name=admin) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:28:16.998350 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844ad937-b86b-4312-b15a-3a237e82bebf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:16.999815 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844ad937-b86b-4312-b15a-3a237e82bebf None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:17.008763 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 524/1052] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Jul 11 14:28:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:28:17.017392 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844ad937-b86b-4312-b15a-3a237e82bebf None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:17.098455 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934a266c-473f-4b85-8581-6ed966af6e8c None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:17.129188 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844ad937-b86b-4312-b15a-3a237e82bebf None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:17.132502 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:17.139557 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac29f60-406d-4b15-8b90-ebe5c36830a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:17.140563 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac29f60-406d-4b15-8b90-ebe5c36830a6 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:17.141238 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac29f60-406d-4b15-8b90-ebe5c36830a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:17.141520 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac29f60-406d-4b15-8b90-ebe5c36830a6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:17.149521 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac29f60-406d-4b15-8b90-ebe5c36830a6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:17.151077 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac29f60-406d-4b15-8b90-ebe5c36830a6 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:17.154012 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:17.168878 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-3ac29f60-406d-4b15-8b90-ebe5c36830a6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:28:17.168878 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:28:17.168878 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:28:17.168878 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:28:17.168878 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:28:17.168878 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:28:17.168878 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:28:17.168878 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:28:17.168878 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:28:17.168878 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:28:17.168878 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:28:17.168878 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:28:17.168878 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 14:28:17.168878 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 14:28:17.168878 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 14:28:17.170066 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 14:28:17.170066 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:28:17.170066 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:28:17.170066 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:28:17.170066 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:28:17.170066 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:28:17.170066 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:28:17.170066 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:28:17.170066 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( Jul 11 14:28:17.170066 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:28:17.170066 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:28:17.170066 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:28:17.170066 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:28:17.170066 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:28:17.170066 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:28:17.170066 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:28:17.170066 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:28:17.171186 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 14:28:17.171186 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 14:28:17.171186 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 14:28:17.171186 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 14:28:17.171186 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 14:28:17.171186 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 14:28:17.171186 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:28:17.171186 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Jul 11 14:28:17.171186 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 529/1053] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Jul 11 14:28:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:28:17.175727 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c2fce4-d772-4936-9758-a897f6303200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:17.175866 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac29f60-406d-4b15-8b90-ebe5c36830a6 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:17.176645 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c2fce4-d772-4936-9758-a897f6303200 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:17.176929 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c2fce4-d772-4936-9758-a897f6303200 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:17.177209 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c2fce4-d772-4936-9758-a897f6303200 None admin] PATH_INFO: `/v3/users/30253209975f4f6ba410936e71878bfb` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:17.192947 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c2fce4-d772-4936-9758-a897f6303200 None admin] RBAC: Authorizing `identity:get_user(user_id=30253209975f4f6ba410936e71878bfb)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:17.194417 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c2fce4-d772-4936-9758-a897f6303200 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:17.196174 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 525/1054] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Jul 11 14:28:17 2022] GET /identity/v3/users/30253209975f4f6ba410936e71878bfb => generated 285 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:28:17.202568 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c2fce4-d772-4936-9758-a897f6303200 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:17.299599 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac29f60-406d-4b15-8b90-ebe5c36830a6 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:17.324050 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c2fce4-d772-4936-9758-a897f6303200 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:17.337775 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea868963-8a69-49d6-aaed-8ee98baee33c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:17.338447 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea868963-8a69-49d6-aaed-8ee98baee33c None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:17.338716 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea868963-8a69-49d6-aaed-8ee98baee33c None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:17.338996 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea868963-8a69-49d6-aaed-8ee98baee33c None admin] PATH_INFO: `/v3/projects` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:17.339793 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea868963-8a69-49d6-aaed-8ee98baee33c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:28:17.340101 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea868963-8a69-49d6-aaed-8ee98baee33c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:17.341623 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea868963-8a69-49d6-aaed-8ee98baee33c None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:17.355283 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 530/1055] 10.222.0.70 () {56 vars in 1148 bytes} [Mon Jul 11 14:28:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:28:17.362180 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea868963-8a69-49d6-aaed-8ee98baee33c None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:17.373038 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbc25de-f71a-47dc-aa4b-656941b3f1fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:17.374183 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbc25de-f71a-47dc-aa4b-656941b3f1fd None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:17.374472 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbc25de-f71a-47dc-aa4b-656941b3f1fd None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:17.374755 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbc25de-f71a-47dc-aa4b-656941b3f1fd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:17.409623 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:17.432849 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:17.457657 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbc25de-f71a-47dc-aa4b-656941b3f1fd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:17.459240 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbc25de-f71a-47dc-aa4b-656941b3f1fd None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:17.482341 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea868963-8a69-49d6-aaed-8ee98baee33c None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:17.521434 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9dfe21-d6db-4df1-b39d-c3b3d3f0a7a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:17.522105 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9dfe21-d6db-4df1-b39d-c3b3d3f0a7a3 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:17.522389 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9dfe21-d6db-4df1-b39d-c3b3d3f0a7a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:17.522667 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9dfe21-d6db-4df1-b39d-c3b3d3f0a7a3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:17.523506 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9dfe21-d6db-4df1-b39d-c3b3d3f0a7a3 None admin] RBAC: Adding query filter params (role.id=c6848bb77ffc4294ab0b88315a5dc1e1, scope.project.id=ccd34295bf7b435a96b37487c8e89fc3, user.id=f4f8c0d696af4bd5a205ca8e9110b8cc) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:28:17.523818 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9dfe21-d6db-4df1-b39d-c3b3d3f0a7a3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:17.525288 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9dfe21-d6db-4df1-b39d-c3b3d3f0a7a3 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:17.531292 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 531/1056] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Jul 11 14:28:17 2022] GET /identity/v3/role_assignments?user.id=f4f8c0d696af4bd5a205ca8e9110b8cc&scope.project.id=ccd34295bf7b435a96b37487c8e89fc3&role.id=c6848bb77ffc4294ab0b88315a5dc1e1 => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:28:17.595830 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 526/1057] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Jul 11 14:28:17 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 11 14:28:17.597426 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9dfe21-d6db-4df1-b39d-c3b3d3f0a7a3 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:17.745972 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9dfe21-d6db-4df1-b39d-c3b3d3f0a7a3 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:17.791337 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:17.811055 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2632b5-78a4-4a4b-9869-f5cf78cbbfb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:17.812722 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2632b5-78a4-4a4b-9869-f5cf78cbbfb6 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:17.813240 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2632b5-78a4-4a4b-9869-f5cf78cbbfb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:17.813749 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2632b5-78a4-4a4b-9869-f5cf78cbbfb6 None admin] PATH_INFO: `/v3/projects/2bac67fae19b462ea7ad2dfef8e7e4bd` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:17.815836 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2632b5-78a4-4a4b-9869-f5cf78cbbfb6 None admin] RBAC: Authorizing `identity:get_project(project_id=2bac67fae19b462ea7ad2dfef8e7e4bd)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:17.818644 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2632b5-78a4-4a4b-9869-f5cf78cbbfb6 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:17.818970 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8751bbed-dbef-4e14-a094-5a1e1c90ea36 None None] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:17.819253 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8751bbed-dbef-4e14-a094-5a1e1c90ea36 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:17.819572 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8751bbed-dbef-4e14-a094-5a1e1c90ea36 None None] PATH_INFO: `/` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:17.821169 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 527/1058] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:28:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:28:17.827496 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 532/1059] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Jul 11 14:28:17 2022] GET /identity/v3/projects/2bac67fae19b462ea7ad2dfef8e7e4bd => generated 311 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:28:17.828682 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2632b5-78a4-4a4b-9869-f5cf78cbbfb6 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:17.828789 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52996af-e948-4bd0-9976-c5c7381bf718 None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:17.829091 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52996af-e948-4bd0-9976-c5c7381bf718 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:17.829270 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52996af-e948-4bd0-9976-c5c7381bf718 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:17.850731 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-c52996af-e948-4bd0-9976-c5c7381bf718 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:28:17.851949 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-c52996af-e948-4bd0-9976-c5c7381bf718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:28:17.919723 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:17.949740 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2632b5-78a4-4a4b-9869-f5cf78cbbfb6 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:17.956531 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 528/1060] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:28:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 14:28:17.972001 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52996af-e948-4bd0-9976-c5c7381bf718 None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:17.997085 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3b5ece-8167-4f34-8c3b-09f441e0a93e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:17.997783 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3b5ece-8167-4f34-8c3b-09f441e0a93e None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:17.998196 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3b5ece-8167-4f34-8c3b-09f441e0a93e None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:17.998959 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3b5ece-8167-4f34-8c3b-09f441e0a93e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:17.999925 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3b5ece-8167-4f34-8c3b-09f441e0a93e None admin] RBAC: Adding query filter params (role.id=b46df176b0fe479da63c318db225bed4, scope.project.id=2bac67fae19b462ea7ad2dfef8e7e4bd, user.id=30253209975f4f6ba410936e71878bfb) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:28:18.000296 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3b5ece-8167-4f34-8c3b-09f441e0a93e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:18.001810 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3b5ece-8167-4f34-8c3b-09f441e0a93e None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:18.011615 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 533/1061] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Jul 11 14:28:17 2022] GET /identity/v3/role_assignments?user.id=30253209975f4f6ba410936e71878bfb&scope.project.id=2bac67fae19b462ea7ad2dfef8e7e4bd&role.id=b46df176b0fe479da63c318db225bed4 => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:28:18.102703 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52996af-e948-4bd0-9976-c5c7381bf718 None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:18.142716 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c81078-43d3-4991-8cd2-7357159375a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:18.143735 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c81078-43d3-4991-8cd2-7357159375a3 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:18.143735 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c81078-43d3-4991-8cd2-7357159375a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:18.143991 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c81078-43d3-4991-8cd2-7357159375a3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:18.214844 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:18.226738 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c81078-43d3-4991-8cd2-7357159375a3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:18.228231 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c81078-43d3-4991-8cd2-7357159375a3 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:18.338367 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 529/1062] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Jul 11 14:28:17 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 11 14:28:18.340105 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3b5ece-8167-4f34-8c3b-09f441e0a93e None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:18.401785 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:18.450654 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3b5ece-8167-4f34-8c3b-09f441e0a93e None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:18.487402 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39e5f99-0e12-4cf3-9655-a7841d082d6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:18.488212 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39e5f99-0e12-4cf3-9655-a7841d082d6e None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:18.488514 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39e5f99-0e12-4cf3-9655-a7841d082d6e None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:18.488791 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39e5f99-0e12-4cf3-9655-a7841d082d6e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:18.500376 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39e5f99-0e12-4cf3-9655-a7841d082d6e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:18.501843 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39e5f99-0e12-4cf3-9655-a7841d082d6e None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:18.520334 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-a39e5f99-0e12-4cf3-9655-a7841d082d6e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:28:18.520334 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:28:18.520334 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:28:18.520334 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:28:18.520334 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:28:18.520334 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:28:18.520334 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:28:18.520334 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:28:18.520334 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:28:18.520334 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:28:18.520334 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:28:18.520334 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:28:18.520334 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:28:18.520334 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:28:18.520334 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:28:18.521355 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:28:18.521355 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:28:18.521355 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:28:18.521355 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:28:18.521355 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:28:18.521355 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:28:18.521355 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:28:18.521355 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:28:18.521355 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( Jul 11 14:28:18.521355 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:28:18.521355 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:28:18.521355 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:28:18.521355 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:28:18.521355 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:28:18.521355 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:28:18.521355 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:28:18.521355 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:28:18.522337 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:28:18.522337 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:28:18.522337 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:28:18.522337 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Jul 11 14:28:18.526511 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 534/1063] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 11 14:28:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:28:18.527889 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c81078-43d3-4991-8cd2-7357159375a3 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:18.637434 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:18.648156 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c81078-43d3-4991-8cd2-7357159375a3 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:18.686135 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fafd07e-797b-46d1-8c2c-55dfa5afb61c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:18.686734 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fafd07e-797b-46d1-8c2c-55dfa5afb61c None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:18.687019 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fafd07e-797b-46d1-8c2c-55dfa5afb61c None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:18.687295 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fafd07e-797b-46d1-8c2c-55dfa5afb61c None admin] PATH_INFO: `/v3/domains` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:18.688051 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fafd07e-797b-46d1-8c2c-55dfa5afb61c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:28:18.688406 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fafd07e-797b-46d1-8c2c-55dfa5afb61c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:18.689827 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fafd07e-797b-46d1-8c2c-55dfa5afb61c None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:18.712251 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 530/1064] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jul 11 14:28:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:28:19.665192 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0debc6-c968-4c7c-8e1d-2f869d26e532 None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:19.665741 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0debc6-c968-4c7c-8e1d-2f869d26e532 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:19.665741 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0debc6-c968-4c7c-8e1d-2f869d26e532 None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:19.667120 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 535/1065] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:28:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:28:19.673176 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f664d725-d0f9-4d15-96ab-6b60132cf92c None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:19.673637 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f664d725-d0f9-4d15-96ab-6b60132cf92c None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:19.673743 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f664d725-d0f9-4d15-96ab-6b60132cf92c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:19.691384 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-f664d725-d0f9-4d15-96ab-6b60132cf92c None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:28:19.692593 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-f664d725-d0f9-4d15-96ab-6b60132cf92c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:28:19.774787 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 531/1066] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:28:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:28:19.798432 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0debc6-c968-4c7c-8e1d-2f869d26e532 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:19.909714 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0debc6-c968-4c7c-8e1d-2f869d26e532 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:19.916837 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:19.952672 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec580e3-99a9-44d7-b238-1055944d5a99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:19.953951 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec580e3-99a9-44d7-b238-1055944d5a99 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:19.954323 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec580e3-99a9-44d7-b238-1055944d5a99 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:19.954809 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec580e3-99a9-44d7-b238-1055944d5a99 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:19.969056 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec580e3-99a9-44d7-b238-1055944d5a99 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:28:19.977481 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-9ec580e3-99a9-44d7-b238-1055944d5a99 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 11 14:28:19.977481 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:28:19.977481 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:28:19.977481 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:28:19.977481 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:28:19.977481 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:28:19.977481 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:28:19.977481 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:28:19.977481 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:28:19.977481 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:28:19.977481 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:28:19.977481 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:28:19.977481 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:28:19.977481 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:28:19.977481 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:28:19.977481 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:28:19.978770 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:28:19.978770 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:28:19.978770 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:28:19.978770 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:28:19.978770 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:28:19.978770 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:28:19.978770 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:28:19.978770 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:28:19.978770 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:28:19.978770 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:28:19.978770 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:28:19.978770 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( Jul 11 14:28:19.978770 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:28:19.978770 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:28:19.978770 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:28:19.978770 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:28:19.981178 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:28:19.981178 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:28:19.981178 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:28:19.981178 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:28:19.981178 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:28:19.981178 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:28:19.981178 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:28:19.981178 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:28:19.981178 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:28:19.981178 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:28:19.981178 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 11 14:28:19.981178 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Jul 11 14:28:19.981178 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 536/1067] 10.222.0.70 () {56 vars in 1120 bytes} [Mon Jul 11 14:28:19 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:28:19.987611 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f664d725-d0f9-4d15-96ab-6b60132cf92c None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:20.077905 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:20.108235 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f664d725-d0f9-4d15-96ab-6b60132cf92c None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:20.119292 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd077cd-d7cd-4f0e-b4f1-03bdf67d66eb None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:20.121189 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd077cd-d7cd-4f0e-b4f1-03bdf67d66eb None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:20.121495 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd077cd-d7cd-4f0e-b4f1-03bdf67d66eb None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:20.122932 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 537/1068] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:28:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 14:28:20.128833 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e8235b-188b-4ca3-b9e2-49e577bfc124 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:20.129126 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e8235b-188b-4ca3-b9e2-49e577bfc124 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:20.129406 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e8235b-188b-4ca3-b9e2-49e577bfc124 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:20.148779 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-f9e8235b-188b-4ca3-b9e2-49e577bfc124 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:28:20.149559 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebb10c3-584a-41b4-b2cd-58e2c9790ba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:20.149975 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebb10c3-584a-41b4-b2cd-58e2c9790ba0 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:20.150376 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebb10c3-584a-41b4-b2cd-58e2c9790ba0 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:20.150630 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-f9e8235b-188b-4ca3-b9e2-49e577bfc124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:28:20.150735 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebb10c3-584a-41b4-b2cd-58e2c9790ba0 None admin] PATH_INFO: `/v3/roles` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:20.151286 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebb10c3-584a-41b4-b2cd-58e2c9790ba0 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:28:20.151591 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebb10c3-584a-41b4-b2cd-58e2c9790ba0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:20.152993 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebb10c3-584a-41b4-b2cd-58e2c9790ba0 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:20.162801 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 532/1069] 10.222.0.70 () {56 vars in 1115 bytes} [Mon Jul 11 14:28:19 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:28:20.168741 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebb10c3-584a-41b4-b2cd-58e2c9790ba0 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:20.231132 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 538/1070] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:28:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 14:28:20.255661 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e8235b-188b-4ca3-b9e2-49e577bfc124 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:20.292956 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebb10c3-584a-41b4-b2cd-58e2c9790ba0 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:20.337962 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757123a8-3a7f-48a5-b55a-d16f3b169923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:20.338799 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757123a8-3a7f-48a5-b55a-d16f3b169923 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:20.339078 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757123a8-3a7f-48a5-b55a-d16f3b169923 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:20.339353 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757123a8-3a7f-48a5-b55a-d16f3b169923 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:20.353177 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757123a8-3a7f-48a5-b55a-d16f3b169923 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:20.354658 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757123a8-3a7f-48a5-b55a-d16f3b169923 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:20.357579 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:20.373171 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:20.378367 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application [None req-757123a8-3a7f-48a5-b55a-d16f3b169923 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:28:20.378367 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:28:20.378367 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:28:20.378367 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:28:20.378367 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:28:20.378367 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:28:20.378367 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:28:20.378367 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:28:20.378367 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:28:20.378367 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:28:20.378367 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:28:20.378367 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:28:20.378367 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:28:20.378367 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:28:20.378367 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:28:20.380154 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:28:20.380154 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:28:20.380154 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:28:20.380154 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:28:20.380154 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:28:20.380154 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:28:20.380154 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:28:20.380154 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:28:20.380154 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application with Lock( Jul 11 14:28:20.380154 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:28:20.380154 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:28:20.380154 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:28:20.380154 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:28:20.380154 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:28:20.380154 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:28:20.380154 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:28:20.380154 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:28:20.382182 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:28:20.382182 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:28:20.382182 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:28:20.382182 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Jul 11 14:28:20.382182 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 533/1071] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 11 14:28:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:28:20.382817 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e8235b-188b-4ca3-b9e2-49e577bfc124 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:20.385981 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757123a8-3a7f-48a5-b55a-d16f3b169923 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:20.425125 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d564bfc1-2ff6-429c-b332-98532c8d70af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:20.425936 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d564bfc1-2ff6-429c-b332-98532c8d70af None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:20.426223 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d564bfc1-2ff6-429c-b332-98532c8d70af None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:20.426501 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d564bfc1-2ff6-429c-b332-98532c8d70af None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:20.441754 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d564bfc1-2ff6-429c-b332-98532c8d70af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:28:20.452067 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-d564bfc1-2ff6-429c-b332-98532c8d70af None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:28:20.452067 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:28:20.452067 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:28:20.452067 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:28:20.452067 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:28:20.452067 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:28:20.452067 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:28:20.452067 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:28:20.452067 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:28:20.452067 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:28:20.452067 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:28:20.452067 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:28:20.452067 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:28:20.452067 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:28:20.452067 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:28:20.452067 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:28:20.453656 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:28:20.453656 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:28:20.453656 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:28:20.453656 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:28:20.453656 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:28:20.453656 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:28:20.453656 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:28:20.453656 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:28:20.453656 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:28:20.453656 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:28:20.453656 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:28:20.453656 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( Jul 11 14:28:20.453656 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:28:20.453656 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:28:20.453656 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:28:20.453656 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:28:20.454686 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:28:20.454686 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:28:20.454686 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:28:20.454686 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:28:20.454686 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:28:20.454686 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:28:20.454686 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:28:20.454686 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:28:20.454686 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:28:20.454686 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:28:20.454686 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:28:20.454686 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Jul 11 14:28:20.456389 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 539/1072] 10.222.0.70 () {56 vars in 1096 bytes} [Mon Jul 11 14:28:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:28:20.461495 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d564bfc1-2ff6-429c-b332-98532c8d70af None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:20.515265 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757123a8-3a7f-48a5-b55a-d16f3b169923 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:20.560967 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207a38d3-fff2-4bfc-ac77-bcabb85cf086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:20.561736 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207a38d3-fff2-4bfc-ac77-bcabb85cf086 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:20.562024 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207a38d3-fff2-4bfc-ac77-bcabb85cf086 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:20.562298 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207a38d3-fff2-4bfc-ac77-bcabb85cf086 None admin] PATH_INFO: `/v3/domains` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:20.563036 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207a38d3-fff2-4bfc-ac77-bcabb85cf086 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:28:20.563346 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207a38d3-fff2-4bfc-ac77-bcabb85cf086 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:20.564753 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207a38d3-fff2-4bfc-ac77-bcabb85cf086 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:20.579818 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 534/1073] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jul 11 14:28:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:28:20.585888 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207a38d3-fff2-4bfc-ac77-bcabb85cf086 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:20.590427 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d564bfc1-2ff6-429c-b332-98532c8d70af None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:20.632804 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f55c100-3fd1-4a95-8966-2cc1e2d4f401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:20.633483 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f55c100-3fd1-4a95-8966-2cc1e2d4f401 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:20.633770 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f55c100-3fd1-4a95-8966-2cc1e2d4f401 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:20.634049 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f55c100-3fd1-4a95-8966-2cc1e2d4f401 None admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:20.634816 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f55c100-3fd1-4a95-8966-2cc1e2d4f401 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:28:20.635126 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f55c100-3fd1-4a95-8966-2cc1e2d4f401 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:20.636547 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f55c100-3fd1-4a95-8966-2cc1e2d4f401 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:20.648717 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 540/1074] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Jul 11 14:28:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:28:20.655570 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f55c100-3fd1-4a95-8966-2cc1e2d4f401 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:20.674106 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:20.685111 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:20.731032 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207a38d3-fff2-4bfc-ac77-bcabb85cf086 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:20.774245 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f078e2e-0eea-4244-9dd0-477473fdf97b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:20.775214 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f078e2e-0eea-4244-9dd0-477473fdf97b None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:20.775559 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f078e2e-0eea-4244-9dd0-477473fdf97b None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:20.775951 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f078e2e-0eea-4244-9dd0-477473fdf97b None admin] PATH_INFO: `/v3/users/nova` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:20.789604 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f078e2e-0eea-4244-9dd0-477473fdf97b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:20.789902 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f55c100-3fd1-4a95-8966-2cc1e2d4f401 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:20.792077 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f078e2e-0eea-4244-9dd0-477473fdf97b None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:20.810266 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application [None req-2f078e2e-0eea-4244-9dd0-477473fdf97b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 11 14:28:20.810266 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:28:20.810266 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:28:20.810266 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:28:20.810266 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:28:20.810266 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:28:20.810266 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:28:20.810266 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:28:20.810266 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:28:20.810266 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:28:20.810266 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:28:20.810266 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:28:20.810266 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 14:28:20.810266 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 14:28:20.810266 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 14:28:20.810266 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 14:28:20.811874 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:28:20.811874 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:28:20.811874 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 14:28:20.811874 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:28:20.811874 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 14:28:20.811874 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:28:20.811874 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:28:20.811874 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:28:20.811874 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:28:20.811874 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:28:20.811874 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:28:20.811874 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application with Lock( Jul 11 14:28:20.811874 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:28:20.811874 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:28:20.811874 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:28:20.811874 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:28:20.811874 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:28:20.811874 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:28:20.813054 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:28:20.813054 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:28:20.813054 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 14:28:20.813054 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 14:28:20.813054 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 14:28:20.813054 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 14:28:20.813054 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 14:28:20.813054 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 14:28:20.813054 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 11 14:28:20.813054 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Jul 11 14:28:20.813054 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 535/1075] 10.222.0.70 () {56 vars in 1093 bytes} [Mon Jul 11 14:28:20 2022] GET /identity/v3/users/nova => generated 82 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:28:20.818510 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f078e2e-0eea-4244-9dd0-477473fdf97b None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:20.834795 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f038d295-cd58-4f70-82ae-a6dd92d017bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:20.836973 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f038d295-cd58-4f70-82ae-a6dd92d017bf None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:20.836973 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f038d295-cd58-4f70-82ae-a6dd92d017bf None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:20.836973 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f038d295-cd58-4f70-82ae-a6dd92d017bf None admin] PATH_INFO: `/v3/users/30253209975f4f6ba410936e71878bfb` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:20.837551 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f038d295-cd58-4f70-82ae-a6dd92d017bf None admin] RBAC: Authorizing `identity:get_user(user_id=30253209975f4f6ba410936e71878bfb)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:20.838989 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f038d295-cd58-4f70-82ae-a6dd92d017bf None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:20.840717 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 541/1076] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Jul 11 14:28:20 2022] GET /identity/v3/users/30253209975f4f6ba410936e71878bfb => generated 285 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:28:20.849318 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f038d295-cd58-4f70-82ae-a6dd92d017bf None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:20.941343 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f078e2e-0eea-4244-9dd0-477473fdf97b None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:20.958269 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:20.963029 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:20.979799 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f038d295-cd58-4f70-82ae-a6dd92d017bf None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:20.981961 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4305c31-dfe5-4b1d-a780-53cebbdf85c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:20.983193 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4305c31-dfe5-4b1d-a780-53cebbdf85c5 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:20.983473 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4305c31-dfe5-4b1d-a780-53cebbdf85c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:20.983744 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4305c31-dfe5-4b1d-a780-53cebbdf85c5 None admin] PATH_INFO: `/v3/users` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:20.984661 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4305c31-dfe5-4b1d-a780-53cebbdf85c5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:28:20.984960 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4305c31-dfe5-4b1d-a780-53cebbdf85c5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:20.986903 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4305c31-dfe5-4b1d-a780-53cebbdf85c5 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:21.005754 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 536/1077] 10.222.0.70 () {56 vars in 1133 bytes} [Mon Jul 11 14:28:20 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:28:21.012193 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4305c31-dfe5-4b1d-a780-53cebbdf85c5 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:21.020755 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec79a79-3d80-40dc-838e-f60ccedac6d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:21.021625 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec79a79-3d80-40dc-838e-f60ccedac6d3 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:21.021910 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec79a79-3d80-40dc-838e-f60ccedac6d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:21.022189 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec79a79-3d80-40dc-838e-f60ccedac6d3 None admin] PATH_INFO: `/v3/projects/2bac67fae19b462ea7ad2dfef8e7e4bd` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:21.023400 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec79a79-3d80-40dc-838e-f60ccedac6d3 None admin] RBAC: Authorizing `identity:get_project(project_id=2bac67fae19b462ea7ad2dfef8e7e4bd)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:21.024886 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec79a79-3d80-40dc-838e-f60ccedac6d3 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:21.026619 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 542/1078] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Jul 11 14:28:20 2022] GET /identity/v3/projects/2bac67fae19b462ea7ad2dfef8e7e4bd => generated 311 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:28:21.032823 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec79a79-3d80-40dc-838e-f60ccedac6d3 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:21.120487 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4305c31-dfe5-4b1d-a780-53cebbdf85c5 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:21.146653 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec79a79-3d80-40dc-838e-f60ccedac6d3 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:21.159669 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb6aecd-ab19-482a-a4fa-00a744383bf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:21.161088 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb6aecd-ab19-482a-a4fa-00a744383bf7 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:21.161901 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb6aecd-ab19-482a-a4fa-00a744383bf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:21.162106 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb6aecd-ab19-482a-a4fa-00a744383bf7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:21.179199 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb6aecd-ab19-482a-a4fa-00a744383bf7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:21.181031 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb6aecd-ab19-482a-a4fa-00a744383bf7 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:21.184364 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed28a72c-c2bc-45bd-b7b5-b135ddba33ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:21.185270 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed28a72c-c2bc-45bd-b7b5-b135ddba33ad None admin] REQUEST_METHOD: `PUT` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:21.185584 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed28a72c-c2bc-45bd-b7b5-b135ddba33ad None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:21.185857 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed28a72c-c2bc-45bd-b7b5-b135ddba33ad None admin] PATH_INFO: `/v3/projects/2bac67fae19b462ea7ad2dfef8e7e4bd/users/30253209975f4f6ba410936e71878bfb/roles/b46df176b0fe479da63c318db225bed4` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:21.187885 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed28a72c-c2bc-45bd-b7b5-b135ddba33ad None admin] RBAC: Authorizing `identity:create_grant(project_id=2bac67fae19b462ea7ad2dfef8e7e4bd, user_id=30253209975f4f6ba410936e71878bfb, role_id=b46df176b0fe479da63c318db225bed4)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:21.189373 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed28a72c-c2bc-45bd-b7b5-b135ddba33ad None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:21.199825 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application [None req-ccb6aecd-ab19-482a-a4fa-00a744383bf7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:28:21.199825 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:28:21.199825 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:28:21.199825 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:28:21.199825 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:28:21.199825 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:28:21.199825 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:28:21.199825 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:28:21.199825 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:28:21.199825 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:28:21.199825 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:28:21.199825 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:28:21.199825 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:28:21.199825 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:28:21.199825 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:28:21.201005 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:28:21.201005 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:28:21.201005 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:28:21.201005 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:28:21.201005 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:28:21.201005 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:28:21.201005 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:28:21.201005 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:28:21.201005 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application with Lock( Jul 11 14:28:21.201005 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:28:21.201005 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:28:21.201005 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:28:21.201005 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:28:21.201005 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:28:21.201005 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:28:21.201005 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:28:21.201005 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:28:21.202143 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:28:21.202143 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:28:21.202143 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:28:21.202143 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Jul 11 14:28:21.202143 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 537/1079] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 11 14:28:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:28:21.205884 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 543/1080] 10.222.0.70 () {58 vars in 1439 bytes} [Mon Jul 11 14:28:21 2022] PUT /identity/v3/projects/2bac67fae19b462ea7ad2dfef8e7e4bd/users/30253209975f4f6ba410936e71878bfb/roles/b46df176b0fe479da63c318db225bed4 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:28:21.207020 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb6aecd-ab19-482a-a4fa-00a744383bf7 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:21.248118 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:21.334589 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb6aecd-ab19-482a-a4fa-00a744383bf7 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:21.377953 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ae371b-5f1f-42d5-bfa7-e4c9e21cae48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:21.378681 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ae371b-5f1f-42d5-bfa7-e4c9e21cae48 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:21.378965 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ae371b-5f1f-42d5-bfa7-e4c9e21cae48 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:21.379278 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ae371b-5f1f-42d5-bfa7-e4c9e21cae48 None admin] PATH_INFO: `/v3/domains` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:21.380028 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ae371b-5f1f-42d5-bfa7-e4c9e21cae48 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:28:21.380374 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ae371b-5f1f-42d5-bfa7-e4c9e21cae48 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:21.381786 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ae371b-5f1f-42d5-bfa7-e4c9e21cae48 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:21.395001 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 538/1081] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jul 11 14:28:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:28:21.400919 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed28a72c-c2bc-45bd-b7b5-b135ddba33ad None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:21.418839 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:21.511887 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed28a72c-c2bc-45bd-b7b5-b135ddba33ad None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:21.548887 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6314a3-47ad-432a-87b1-5478e7e3f1eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:21.549688 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6314a3-47ad-432a-87b1-5478e7e3f1eb None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:21.549974 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6314a3-47ad-432a-87b1-5478e7e3f1eb None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:21.550251 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6314a3-47ad-432a-87b1-5478e7e3f1eb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:21.558205 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6314a3-47ad-432a-87b1-5478e7e3f1eb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:21.559686 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6314a3-47ad-432a-87b1-5478e7e3f1eb None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:21.575396 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-2d6314a3-47ad-432a-87b1-5478e7e3f1eb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:28:21.575396 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:28:21.575396 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:28:21.575396 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:28:21.575396 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:28:21.575396 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:28:21.575396 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:28:21.575396 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:28:21.575396 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:28:21.575396 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:28:21.575396 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:28:21.575396 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:28:21.575396 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 14:28:21.575396 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 14:28:21.575396 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 14:28:21.576512 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 14:28:21.576512 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:28:21.576512 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:28:21.576512 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:28:21.576512 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:28:21.576512 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:28:21.576512 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:28:21.576512 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:28:21.576512 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( Jul 11 14:28:21.576512 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:28:21.576512 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:28:21.576512 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:28:21.576512 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:28:21.576512 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:28:21.576512 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:28:21.576512 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:28:21.576512 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:28:21.577452 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 14:28:21.577452 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 14:28:21.577452 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 14:28:21.577452 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 14:28:21.577452 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 14:28:21.577452 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 14:28:21.577452 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:28:21.577452 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Jul 11 14:28:21.577452 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 544/1082] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Jul 11 14:28:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:28:21.582576 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ae371b-5f1f-42d5-bfa7-e4c9e21cae48 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:21.668711 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:21.686221 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ae371b-5f1f-42d5-bfa7-e4c9e21cae48 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:21.720409 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c3ec57-84d0-42c3-a03a-41fbbad3868a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:21.721071 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c3ec57-84d0-42c3-a03a-41fbbad3868a None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:21.721349 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c3ec57-84d0-42c3-a03a-41fbbad3868a None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:21.721618 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c3ec57-84d0-42c3-a03a-41fbbad3868a None admin] PATH_INFO: `/v3/projects` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:21.722408 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c3ec57-84d0-42c3-a03a-41fbbad3868a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:28:21.722709 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c3ec57-84d0-42c3-a03a-41fbbad3868a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:21.724126 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c3ec57-84d0-42c3-a03a-41fbbad3868a None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:21.737875 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 539/1083] 10.222.0.70 () {56 vars in 1148 bytes} [Mon Jul 11 14:28:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:28:21.743721 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6314a3-47ad-432a-87b1-5478e7e3f1eb None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:21.827945 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:21.854685 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6314a3-47ad-432a-87b1-5478e7e3f1eb None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:21.891417 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b33b06-ac5e-42f0-9811-d50c5b220630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:21.892360 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b33b06-ac5e-42f0-9811-d50c5b220630 None admin] REQUEST_METHOD: `PUT` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:21.892648 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b33b06-ac5e-42f0-9811-d50c5b220630 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:21.892929 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b33b06-ac5e-42f0-9811-d50c5b220630 None admin] PATH_INFO: `/v3/projects/ccd34295bf7b435a96b37487c8e89fc3/users/f4f8c0d696af4bd5a205ca8e9110b8cc/roles/c6848bb77ffc4294ab0b88315a5dc1e1` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:21.895154 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b33b06-ac5e-42f0-9811-d50c5b220630 None admin] RBAC: Authorizing `identity:create_grant(project_id=ccd34295bf7b435a96b37487c8e89fc3, user_id=f4f8c0d696af4bd5a205ca8e9110b8cc, role_id=c6848bb77ffc4294ab0b88315a5dc1e1)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:21.896630 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b33b06-ac5e-42f0-9811-d50c5b220630 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:21.911370 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 545/1084] 10.222.0.70 () {58 vars in 1439 bytes} [Mon Jul 11 14:28:21 2022] PUT /identity/v3/projects/ccd34295bf7b435a96b37487c8e89fc3/users/f4f8c0d696af4bd5a205ca8e9110b8cc/roles/c6848bb77ffc4294ab0b88315a5dc1e1 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:28:23.316225 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf565867-0574-45b2-bbad-bcbbcb4e0b24 None None] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:23.316759 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf565867-0574-45b2-bbad-bcbbcb4e0b24 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:23.316881 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf565867-0574-45b2-bbad-bcbbcb4e0b24 None None] PATH_INFO: `/` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:23.318167 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 540/1085] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:28:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:28:23.323378 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a222335-7bca-4b12-9e78-6e724c27e8ac None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:23.323806 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a222335-7bca-4b12-9e78-6e724c27e8ac None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:23.323945 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a222335-7bca-4b12-9e78-6e724c27e8ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:23.341171 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-7a222335-7bca-4b12-9e78-6e724c27e8ac None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:28:23.343053 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-7a222335-7bca-4b12-9e78-6e724c27e8ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:28:23.411469 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 546/1086] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:28:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:28:23.434946 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf565867-0574-45b2-bbad-bcbbcb4e0b24 None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:23.538918 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf565867-0574-45b2-bbad-bcbbcb4e0b24 None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:23.576025 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7960cce7-e9fb-490f-a544-c7703851e63d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:23.577047 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7960cce7-e9fb-490f-a544-c7703851e63d None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:23.577344 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7960cce7-e9fb-490f-a544-c7703851e63d None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:23.577695 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7960cce7-e9fb-490f-a544-c7703851e63d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:23.588616 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7960cce7-e9fb-490f-a544-c7703851e63d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:28:23.596831 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application [None req-7960cce7-e9fb-490f-a544-c7703851e63d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:28:23.596831 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:28:23.596831 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:28:23.596831 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:28:23.596831 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:28:23.596831 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:28:23.596831 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:28:23.596831 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:28:23.596831 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:28:23.596831 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:28:23.596831 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:28:23.596831 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:28:23.596831 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:28:23.596831 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:28:23.596831 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:28:23.596831 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:28:23.597824 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:28:23.597824 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:28:23.597824 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:28:23.597824 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:28:23.597824 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:28:23.597824 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:28:23.597824 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:28:23.597824 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:28:23.597824 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:28:23.597824 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:28:23.597824 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:28:23.597824 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application with Lock( Jul 11 14:28:23.597824 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:28:23.597824 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:28:23.597824 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:28:23.597824 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:28:23.598661 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:28:23.598661 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:28:23.598661 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:28:23.598661 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:28:23.598661 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:28:23.598661 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:28:23.598661 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:28:23.598661 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:28:23.598661 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:28:23.598661 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:28:23.598661 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:28:23.598661 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Jul 11 14:28:23.598661 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 541/1087] 10.222.0.70 () {56 vars in 1096 bytes} [Mon Jul 11 14:28:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:28:23.604246 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a222335-7bca-4b12-9e78-6e724c27e8ac None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:23.671273 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:23.710486 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a222335-7bca-4b12-9e78-6e724c27e8ac None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:23.745940 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de63ea25-45d1-470f-9874-642780cd8b13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:23.746604 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de63ea25-45d1-470f-9874-642780cd8b13 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:23.746883 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de63ea25-45d1-470f-9874-642780cd8b13 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:23.747154 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de63ea25-45d1-470f-9874-642780cd8b13 None admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:23.747973 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de63ea25-45d1-470f-9874-642780cd8b13 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:28:23.748262 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de63ea25-45d1-470f-9874-642780cd8b13 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:23.749686 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de63ea25-45d1-470f-9874-642780cd8b13 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:23.763069 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 547/1088] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Jul 11 14:28:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:28:23.771112 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7960cce7-e9fb-490f-a544-c7703851e63d None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:23.782783 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:23.892361 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7960cce7-e9fb-490f-a544-c7703851e63d None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:23.926973 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b80156-a3b4-4333-96e2-f61e0857aef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:23.927841 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b80156-a3b4-4333-96e2-f61e0857aef1 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:23.928119 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b80156-a3b4-4333-96e2-f61e0857aef1 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:23.928414 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b80156-a3b4-4333-96e2-f61e0857aef1 None admin] PATH_INFO: `/v3/users/30253209975f4f6ba410936e71878bfb` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:23.929601 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b80156-a3b4-4333-96e2-f61e0857aef1 None admin] RBAC: Authorizing `identity:get_user(user_id=30253209975f4f6ba410936e71878bfb)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:23.931282 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b80156-a3b4-4333-96e2-f61e0857aef1 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:23.932933 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 542/1089] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Jul 11 14:28:23 2022] GET /identity/v3/users/30253209975f4f6ba410936e71878bfb => generated 285 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:28:23.938756 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de63ea25-45d1-470f-9874-642780cd8b13 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:23.978305 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5910f4fe-5c95-49d7-a7f0-88367a778641 None None] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:23.978603 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5910f4fe-5c95-49d7-a7f0-88367a778641 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:23.978866 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5910f4fe-5c95-49d7-a7f0-88367a778641 None None] PATH_INFO: `/` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:23.980310 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 543/1090] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:28:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 14:28:23.986537 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74713d0b-c7aa-4165-9d94-c087839028ff None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:23.986821 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74713d0b-c7aa-4165-9d94-c087839028ff None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:23.987096 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74713d0b-c7aa-4165-9d94-c087839028ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:24.004703 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-74713d0b-c7aa-4165-9d94-c087839028ff None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:28:24.005885 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-74713d0b-c7aa-4165-9d94-c087839028ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:28:24.056110 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de63ea25-45d1-470f-9874-642780cd8b13 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:24.081636 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 544/1091] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:28:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 14:28:24.083455 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:24.093370 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5ded78-2b84-4256-892b-fc21a4e5bbbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:24.094028 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5ded78-2b84-4256-892b-fc21a4e5bbbe None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:24.094308 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5ded78-2b84-4256-892b-fc21a4e5bbbe None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:24.094580 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5ded78-2b84-4256-892b-fc21a4e5bbbe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:24.106484 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74713d0b-c7aa-4165-9d94-c087839028ff None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:24.109855 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:24.172415 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5ded78-2b84-4256-892b-fc21a4e5bbbe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:24.173879 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5ded78-2b84-4256-892b-fc21a4e5bbbe None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:24.218128 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74713d0b-c7aa-4165-9d94-c087839028ff None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:24.252854 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89da5e8-63ff-4f20-8051-4a2e00125976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:24.253674 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89da5e8-63ff-4f20-8051-4a2e00125976 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:24.253955 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89da5e8-63ff-4f20-8051-4a2e00125976 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:24.254227 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89da5e8-63ff-4f20-8051-4a2e00125976 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:24.265140 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89da5e8-63ff-4f20-8051-4a2e00125976 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:28:24.273265 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application [None req-b89da5e8-63ff-4f20-8051-4a2e00125976 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 11 14:28:24.273265 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:28:24.273265 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:28:24.273265 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:28:24.273265 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:28:24.273265 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:28:24.273265 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:28:24.273265 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:28:24.273265 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:28:24.273265 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:28:24.273265 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:28:24.273265 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:28:24.273265 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:28:24.273265 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:28:24.273265 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:28:24.273265 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:28:24.274303 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:28:24.274303 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:28:24.274303 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:28:24.274303 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:28:24.274303 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:28:24.274303 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:28:24.274303 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:28:24.274303 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:28:24.274303 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:28:24.274303 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:28:24.274303 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:28:24.274303 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application with Lock( Jul 11 14:28:24.274303 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:28:24.274303 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:28:24.274303 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:28:24.274303 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:28:24.275178 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:28:24.275178 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:28:24.275178 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:28:24.275178 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:28:24.275178 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:28:24.275178 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:28:24.275178 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:28:24.275178 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:28:24.275178 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:28:24.275178 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:28:24.275178 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 11 14:28:24.275178 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Jul 11 14:28:24.275178 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 545/1092] 10.222.0.70 () {56 vars in 1120 bytes} [Mon Jul 11 14:28:24 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:28:24.281413 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89da5e8-63ff-4f20-8051-4a2e00125976 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:24.288935 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 548/1093] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Jul 11 14:28:23 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 11 14:28:24.289964 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5ded78-2b84-4256-892b-fc21a4e5bbbe None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:24.317264 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:24.348480 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:24.390348 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89da5e8-63ff-4f20-8051-4a2e00125976 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:24.393512 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5ded78-2b84-4256-892b-fc21a4e5bbbe None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:24.427110 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f9d787-2f45-4d16-8cf8-877b52b0e489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:24.427693 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f9d787-2f45-4d16-8cf8-877b52b0e489 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:24.427977 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f9d787-2f45-4d16-8cf8-877b52b0e489 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:24.428095 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac337f05-5c12-44aa-a9bb-315c636d0505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:24.428282 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f9d787-2f45-4d16-8cf8-877b52b0e489 None admin] PATH_INFO: `/v3/roles` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:24.428886 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac337f05-5c12-44aa-a9bb-315c636d0505 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:24.429032 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f9d787-2f45-4d16-8cf8-877b52b0e489 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:28:24.429167 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac337f05-5c12-44aa-a9bb-315c636d0505 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:24.429340 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f9d787-2f45-4d16-8cf8-877b52b0e489 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:24.429432 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac337f05-5c12-44aa-a9bb-315c636d0505 None admin] PATH_INFO: `/v3/projects/2bac67fae19b462ea7ad2dfef8e7e4bd` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:24.430857 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac337f05-5c12-44aa-a9bb-315c636d0505 None admin] RBAC: Authorizing `identity:get_project(project_id=2bac67fae19b462ea7ad2dfef8e7e4bd)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:24.430960 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f9d787-2f45-4d16-8cf8-877b52b0e489 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:24.432290 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac337f05-5c12-44aa-a9bb-315c636d0505 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:24.433979 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 549/1094] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Jul 11 14:28:24 2022] GET /identity/v3/projects/2bac67fae19b462ea7ad2dfef8e7e4bd => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:28:24.441048 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac337f05-5c12-44aa-a9bb-315c636d0505 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:24.446683 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 546/1095] 10.222.0.70 () {56 vars in 1115 bytes} [Mon Jul 11 14:28:24 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:28:24.447772 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f9d787-2f45-4d16-8cf8-877b52b0e489 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:24.536266 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:24.543569 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac337f05-5c12-44aa-a9bb-315c636d0505 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:24.554264 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f9d787-2f45-4d16-8cf8-877b52b0e489 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:24.585478 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75ea55b-7ea4-4a4a-a5e7-59de674e9b4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:24.586067 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:24.586177 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75ea55b-7ea4-4a4a-a5e7-59de674e9b4d None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:24.586420 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75ea55b-7ea4-4a4a-a5e7-59de674e9b4d None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:24.586700 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75ea55b-7ea4-4a4a-a5e7-59de674e9b4d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:24.587563 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75ea55b-7ea4-4a4a-a5e7-59de674e9b4d None admin] RBAC: Adding query filter params (role.id=b46df176b0fe479da63c318db225bed4, scope.project.id=2bac67fae19b462ea7ad2dfef8e7e4bd, user.id=30253209975f4f6ba410936e71878bfb) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:28:24.587880 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75ea55b-7ea4-4a4a-a5e7-59de674e9b4d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:24.589395 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75ea55b-7ea4-4a4a-a5e7-59de674e9b4d None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:24.595503 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 550/1096] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Jul 11 14:28:24 2022] GET /identity/v3/role_assignments?user.id=30253209975f4f6ba410936e71878bfb&scope.project.id=2bac67fae19b462ea7ad2dfef8e7e4bd&role.id=b46df176b0fe479da63c318db225bed4 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:28:24.596093 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7202f09-552a-46e0-8123-08e63697b04a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:24.596918 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7202f09-552a-46e0-8123-08e63697b04a None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:24.597199 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7202f09-552a-46e0-8123-08e63697b04a None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:24.597474 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7202f09-552a-46e0-8123-08e63697b04a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:24.610543 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7202f09-552a-46e0-8123-08e63697b04a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:24.612028 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7202f09-552a-46e0-8123-08e63697b04a None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:24.631943 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application [None req-f7202f09-552a-46e0-8123-08e63697b04a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:28:24.631943 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:28:24.631943 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:28:24.631943 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:28:24.631943 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:28:24.631943 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:28:24.631943 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:28:24.631943 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:28:24.631943 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:28:24.631943 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:28:24.631943 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:28:24.631943 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:28:24.631943 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:28:24.631943 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:28:24.631943 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:28:24.633166 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:28:24.633166 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:28:24.633166 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:28:24.633166 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:28:24.633166 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:28:24.633166 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:28:24.633166 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:28:24.633166 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:28:24.633166 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application with Lock( Jul 11 14:28:24.633166 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:28:24.633166 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:28:24.633166 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:28:24.633166 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:28:24.633166 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:28:24.633166 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:28:24.633166 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:28:24.633166 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:28:24.634084 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:28:24.634084 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:28:24.634084 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:28:24.634084 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Jul 11 14:28:24.634084 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 547/1097] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 11 14:28:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:28:24.639240 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75ea55b-7ea4-4a4a-a5e7-59de674e9b4d None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:24.750003 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75ea55b-7ea4-4a4a-a5e7-59de674e9b4d None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:24.790128 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203b7efe-86b3-485d-b7d3-76f95ceb5cb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:24.790797 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203b7efe-86b3-485d-b7d3-76f95ceb5cb9 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:24.791082 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203b7efe-86b3-485d-b7d3-76f95ceb5cb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:24.791358 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203b7efe-86b3-485d-b7d3-76f95ceb5cb9 None admin] PATH_INFO: `/v3/domains` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:24.792120 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203b7efe-86b3-485d-b7d3-76f95ceb5cb9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:28:24.792493 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203b7efe-86b3-485d-b7d3-76f95ceb5cb9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:24.793895 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203b7efe-86b3-485d-b7d3-76f95ceb5cb9 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:24.807859 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 551/1098] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jul 11 14:28:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:28:24.814388 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7202f09-552a-46e0-8123-08e63697b04a None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:24.940816 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7202f09-552a-46e0-8123-08e63697b04a None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:24.974124 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c038e7d5-a74a-4dc9-9079-cccfa3449006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:24.974913 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c038e7d5-a74a-4dc9-9079-cccfa3449006 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:24.975194 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c038e7d5-a74a-4dc9-9079-cccfa3449006 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:24.975467 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c038e7d5-a74a-4dc9-9079-cccfa3449006 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:24.983833 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c038e7d5-a74a-4dc9-9079-cccfa3449006 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:24.985304 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c038e7d5-a74a-4dc9-9079-cccfa3449006 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:24.999436 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application [None req-c038e7d5-a74a-4dc9-9079-cccfa3449006 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 11 14:28:24.999436 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:28:24.999436 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:28:24.999436 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:28:24.999436 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:28:24.999436 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:28:24.999436 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:28:24.999436 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:28:24.999436 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:28:24.999436 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:28:24.999436 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:28:24.999436 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:28:24.999436 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 14:28:24.999436 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 14:28:24.999436 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 14:28:24.999436 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 14:28:25.000677 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:28:25.000677 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:28:25.000677 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 14:28:25.000677 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:28:25.000677 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 14:28:25.000677 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:28:25.000677 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:28:25.000677 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:28:25.000677 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:28:25.000677 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:28:25.000677 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:28:25.000677 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application with Lock( Jul 11 14:28:25.000677 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:28:25.000677 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:28:25.000677 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:28:25.000677 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:28:25.000677 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:28:25.000677 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:28:25.001916 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:28:25.001916 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:28:25.001916 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 14:28:25.001916 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 14:28:25.001916 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 14:28:25.001916 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 14:28:25.001916 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 14:28:25.001916 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 14:28:25.001916 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 11 14:28:25.001916 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Jul 11 14:28:25.001916 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 548/1099] 10.222.0.70 () {56 vars in 1093 bytes} [Mon Jul 11 14:28:24 2022] GET /identity/v3/users/nova => generated 82 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:28:25.006355 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203b7efe-86b3-485d-b7d3-76f95ceb5cb9 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:25.027009 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:25.111191 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203b7efe-86b3-485d-b7d3-76f95ceb5cb9 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:25.146519 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef34706f-1f52-4a07-9e6c-bb3bc0cdd0cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:25.147208 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef34706f-1f52-4a07-9e6c-bb3bc0cdd0cd None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:25.147490 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef34706f-1f52-4a07-9e6c-bb3bc0cdd0cd None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:25.147763 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef34706f-1f52-4a07-9e6c-bb3bc0cdd0cd None admin] PATH_INFO: `/v3/users` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:25.148649 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef34706f-1f52-4a07-9e6c-bb3bc0cdd0cd None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:28:25.148958 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef34706f-1f52-4a07-9e6c-bb3bc0cdd0cd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:25.150423 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef34706f-1f52-4a07-9e6c-bb3bc0cdd0cd None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:25.170677 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 552/1100] 10.222.0.70 () {56 vars in 1133 bytes} [Mon Jul 11 14:28:25 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:28:25.176458 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c038e7d5-a74a-4dc9-9079-cccfa3449006 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:25.220029 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:25.284597 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c038e7d5-a74a-4dc9-9079-cccfa3449006 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:25.317800 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0040906-458d-4876-9a08-b038267e2f7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:25.318446 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0040906-458d-4876-9a08-b038267e2f7d None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:25.318729 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0040906-458d-4876-9a08-b038267e2f7d None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:25.319006 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0040906-458d-4876-9a08-b038267e2f7d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:25.389300 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0040906-458d-4876-9a08-b038267e2f7d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:25.390756 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0040906-458d-4876-9a08-b038267e2f7d None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:25.428566 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:25.490354 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 549/1101] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Jul 11 14:28:25 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 11 14:28:25.496246 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef34706f-1f52-4a07-9e6c-bb3bc0cdd0cd None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:25.575329 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:25.599880 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef34706f-1f52-4a07-9e6c-bb3bc0cdd0cd None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:25.634647 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f96eb6-8ab3-4885-86d1-1810e4c9deca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:25.635417 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f96eb6-8ab3-4885-86d1-1810e4c9deca None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:25.635699 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f96eb6-8ab3-4885-86d1-1810e4c9deca None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:25.635974 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f96eb6-8ab3-4885-86d1-1810e4c9deca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:25.647333 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f96eb6-8ab3-4885-86d1-1810e4c9deca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:25.648881 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f96eb6-8ab3-4885-86d1-1810e4c9deca None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:25.667164 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-06f96eb6-8ab3-4885-86d1-1810e4c9deca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:28:25.667164 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:28:25.667164 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:28:25.667164 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:28:25.667164 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:28:25.667164 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:28:25.667164 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:28:25.667164 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:28:25.667164 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:28:25.667164 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:28:25.667164 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:28:25.667164 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:28:25.667164 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:28:25.667164 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:28:25.667164 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:28:25.668302 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:28:25.668302 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:28:25.668302 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:28:25.668302 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:28:25.668302 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:28:25.668302 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:28:25.668302 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:28:25.668302 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:28:25.668302 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( Jul 11 14:28:25.668302 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:28:25.668302 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:28:25.668302 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:28:25.668302 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:28:25.668302 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:28:25.668302 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:28:25.668302 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:28:25.668302 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:28:25.669275 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:28:25.669275 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:28:25.669275 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:28:25.669275 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Jul 11 14:28:25.670262 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 553/1102] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 11 14:28:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:28:25.676015 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0040906-458d-4876-9a08-b038267e2f7d None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:25.787401 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0040906-458d-4876-9a08-b038267e2f7d None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:25.821468 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3616f842-f174-4236-9842-7c599a6203ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:25.822135 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3616f842-f174-4236-9842-7c599a6203ad None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:25.822423 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3616f842-f174-4236-9842-7c599a6203ad None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:25.822709 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3616f842-f174-4236-9842-7c599a6203ad None admin] PATH_INFO: `/v3/domains` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:25.823486 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3616f842-f174-4236-9842-7c599a6203ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:28:25.823741 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3616f842-f174-4236-9842-7c599a6203ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:25.825138 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3616f842-f174-4236-9842-7c599a6203ad None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:25.833256 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:25.839244 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 550/1103] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jul 11 14:28:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:28:25.845121 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f96eb6-8ab3-4885-86d1-1810e4c9deca None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:25.949270 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f96eb6-8ab3-4885-86d1-1810e4c9deca None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:25.976222 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:25.985003 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff75aa3-cfe5-4702-8454-a40c5c5126f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:25.985805 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff75aa3-cfe5-4702-8454-a40c5c5126f9 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:25.986093 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff75aa3-cfe5-4702-8454-a40c5c5126f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:25.986372 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff75aa3-cfe5-4702-8454-a40c5c5126f9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:25.993135 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff75aa3-cfe5-4702-8454-a40c5c5126f9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:25.994585 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff75aa3-cfe5-4702-8454-a40c5c5126f9 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:26.009117 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-7ff75aa3-cfe5-4702-8454-a40c5c5126f9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:28:26.009117 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:28:26.009117 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:28:26.009117 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:28:26.009117 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:28:26.009117 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:28:26.009117 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:28:26.009117 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:28:26.009117 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:28:26.009117 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:28:26.009117 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:28:26.009117 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:28:26.009117 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 14:28:26.009117 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 14:28:26.009117 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 14:28:26.010021 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 14:28:26.010021 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:28:26.010021 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:28:26.010021 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:28:26.010021 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:28:26.010021 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:28:26.010021 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:28:26.010021 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:28:26.010021 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( Jul 11 14:28:26.010021 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:28:26.010021 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:28:26.010021 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:28:26.010021 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:28:26.010021 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:28:26.010021 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:28:26.010021 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:28:26.010021 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:28:26.010924 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 14:28:26.010924 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 14:28:26.010924 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 14:28:26.010924 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 14:28:26.010924 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 14:28:26.010924 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 14:28:26.010924 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:28:26.010924 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Jul 11 14:28:26.010924 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 554/1104] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Jul 11 14:28:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:28:26.016460 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3616f842-f174-4236-9842-7c599a6203ad None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:26.116688 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3616f842-f174-4236-9842-7c599a6203ad None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:26.151963 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f3cf11-53af-4a2f-8727-151ad1ac380d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:26.152662 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f3cf11-53af-4a2f-8727-151ad1ac380d None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:26.152943 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f3cf11-53af-4a2f-8727-151ad1ac380d None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:26.153221 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f3cf11-53af-4a2f-8727-151ad1ac380d None admin] PATH_INFO: `/v3/projects` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:26.154081 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f3cf11-53af-4a2f-8727-151ad1ac380d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:28:26.154388 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f3cf11-53af-4a2f-8727-151ad1ac380d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:26.155830 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f3cf11-53af-4a2f-8727-151ad1ac380d None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:26.167861 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 551/1105] 10.222.0.70 () {56 vars in 1148 bytes} [Mon Jul 11 14:28:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:28:26.174620 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff75aa3-cfe5-4702-8454-a40c5c5126f9 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:26.277951 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff75aa3-cfe5-4702-8454-a40c5c5126f9 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:26.315604 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47615b85-c6d8-4f22-8839-8291fd6633e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:26.316298 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47615b85-c6d8-4f22-8839-8291fd6633e0 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:26.316583 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47615b85-c6d8-4f22-8839-8291fd6633e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:26.316855 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47615b85-c6d8-4f22-8839-8291fd6633e0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:26.317688 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47615b85-c6d8-4f22-8839-8291fd6633e0 None admin] RBAC: Adding query filter params (role.id=c6848bb77ffc4294ab0b88315a5dc1e1, scope.project.id=ccd34295bf7b435a96b37487c8e89fc3, user.id=f4f8c0d696af4bd5a205ca8e9110b8cc) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:28:26.318001 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47615b85-c6d8-4f22-8839-8291fd6633e0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:26.319442 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47615b85-c6d8-4f22-8839-8291fd6633e0 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:26.326054 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 555/1106] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Jul 11 14:28:26 2022] GET /identity/v3/role_assignments?user.id=f4f8c0d696af4bd5a205ca8e9110b8cc&scope.project.id=ccd34295bf7b435a96b37487c8e89fc3&role.id=c6848bb77ffc4294ab0b88315a5dc1e1 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:28:26.738635 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647899a1-db99-449b-80d0-f2b5a415a2c3 None None] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:26.739266 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647899a1-db99-449b-80d0-f2b5a415a2c3 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:26.739266 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647899a1-db99-449b-80d0-f2b5a415a2c3 None None] PATH_INFO: `/` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:26.740681 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 552/1107] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:28:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:28:26.746416 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e4f38b-d38a-4525-8d9e-75570171ee2b None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:26.746885 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e4f38b-d38a-4525-8d9e-75570171ee2b None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:26.746988 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e4f38b-d38a-4525-8d9e-75570171ee2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:26.767802 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-29e4f38b-d38a-4525-8d9e-75570171ee2b None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:28:26.769037 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-29e4f38b-d38a-4525-8d9e-75570171ee2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:28:26.821907 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:26.844065 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 556/1108] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:28:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:28:26.868946 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647899a1-db99-449b-80d0-f2b5a415a2c3 None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:26.932577 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:26.977140 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647899a1-db99-449b-80d0-f2b5a415a2c3 None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:27.013878 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a5169f-97cf-4944-b828-5d9e4efc66bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:27.014680 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a5169f-97cf-4944-b828-5d9e4efc66bd None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:27.014956 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a5169f-97cf-4944-b828-5d9e4efc66bd None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:27.015228 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a5169f-97cf-4944-b828-5d9e4efc66bd None admin] PATH_INFO: `/v3/domains/default` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:27.016446 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a5169f-97cf-4944-b828-5d9e4efc66bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:27.017883 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a5169f-97cf-4944-b828-5d9e4efc66bd None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:27.019708 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 553/1109] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 11 14:28:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:28:27.025314 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e4f38b-d38a-4525-8d9e-75570171ee2b None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:27.130637 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e4f38b-d38a-4525-8d9e-75570171ee2b None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:27.167090 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca2449c-1423-4189-a77c-892beb4ce32b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:27.167810 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca2449c-1423-4189-a77c-892beb4ce32b None admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:27.168100 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca2449c-1423-4189-a77c-892beb4ce32b None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:27.168504 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca2449c-1423-4189-a77c-892beb4ce32b None admin] PATH_INFO: `/v3/users` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:27.169408 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca2449c-1423-4189-a77c-892beb4ce32b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:27.171388 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca2449c-1423-4189-a77c-892beb4ce32b None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:27.194505 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 557/1110] 10.222.0.70 () {60 vars in 1132 bytes} [Mon Jul 11 14:28:27 2022] POST /identity/v3/users => generated 286 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:28:29.270728 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae7bcab-ec9c-4096-a07c-90740a3b03b8 None None] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:29.271271 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae7bcab-ec9c-4096-a07c-90740a3b03b8 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:29.271271 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae7bcab-ec9c-4096-a07c-90740a3b03b8 None None] PATH_INFO: `/` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:29.272694 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 554/1111] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:28:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:28:29.278383 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefb01e4-dd62-4408-807d-ac91df3277a2 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:29.278876 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefb01e4-dd62-4408-807d-ac91df3277a2 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:29.279646 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefb01e4-dd62-4408-807d-ac91df3277a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:29.297050 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-cefb01e4-dd62-4408-807d-ac91df3277a2 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:28:29.298238 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-cefb01e4-dd62-4408-807d-ac91df3277a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:28:29.327827 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:29.366660 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 558/1112] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:28:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:28:29.391123 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae7bcab-ec9c-4096-a07c-90740a3b03b8 None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:29.492273 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae7bcab-ec9c-4096-a07c-90740a3b03b8 None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:29.517821 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:29.526914 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c935a06f-44b6-402d-95d3-3042df62bd8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:29.527701 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c935a06f-44b6-402d-95d3-3042df62bd8d None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:29.527985 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c935a06f-44b6-402d-95d3-3042df62bd8d None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:29.528289 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c935a06f-44b6-402d-95d3-3042df62bd8d None admin] PATH_INFO: `/v3/roles/7d8b0827910944f29bfa3a92d6cb7c92` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:29.530595 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c935a06f-44b6-402d-95d3-3042df62bd8d None admin] RBAC: Authorizing `identity:get_role(role_id=7d8b0827910944f29bfa3a92d6cb7c92)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:29.531966 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c935a06f-44b6-402d-95d3-3042df62bd8d None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:29.533372 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 555/1113] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Jul 11 14:28:29 2022] GET /identity/v3/roles/7d8b0827910944f29bfa3a92d6cb7c92 => generated 223 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:28:29.539336 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefb01e4-dd62-4408-807d-ac91df3277a2 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:29.643208 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefb01e4-dd62-4408-807d-ac91df3277a2 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:29.678184 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c80a579-f984-4de7-a4f9-0acea00dc97e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:29.679052 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c80a579-f984-4de7-a4f9-0acea00dc97e None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:29.679334 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c80a579-f984-4de7-a4f9-0acea00dc97e None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:29.679861 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c80a579-f984-4de7-a4f9-0acea00dc97e None admin] PATH_INFO: `/v3/users/b4bb9f722d924844af8c9b99554d2418` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:29.694253 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c80a579-f984-4de7-a4f9-0acea00dc97e None admin] RBAC: Authorizing `identity:get_user(user_id=b4bb9f722d924844af8c9b99554d2418)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:29.696160 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c80a579-f984-4de7-a4f9-0acea00dc97e None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:29.697920 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 559/1114] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Jul 11 14:28:29 2022] GET /identity/v3/users/b4bb9f722d924844af8c9b99554d2418 => generated 286 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:28:29.704132 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c935a06f-44b6-402d-95d3-3042df62bd8d None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:29.812848 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c935a06f-44b6-402d-95d3-3042df62bd8d None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:29.851908 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b19466-2e19-4360-abb1-e3ca0c8f62dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:29.852582 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b19466-2e19-4360-abb1-e3ca0c8f62dc None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:29.852866 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b19466-2e19-4360-abb1-e3ca0c8f62dc None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:29.853140 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b19466-2e19-4360-abb1-e3ca0c8f62dc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:29.921687 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:29.930440 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b19466-2e19-4360-abb1-e3ca0c8f62dc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:29.931909 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b19466-2e19-4360-abb1-e3ca0c8f62dc None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:30.041362 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 556/1115] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Jul 11 14:28:29 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 11 14:28:30.049359 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c80a579-f984-4de7-a4f9-0acea00dc97e None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:30.079762 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:30.151080 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c80a579-f984-4de7-a4f9-0acea00dc97e None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:30.185540 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ceae14-a170-440e-a43b-21672b911fd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:30.186385 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ceae14-a170-440e-a43b-21672b911fd3 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:30.186676 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ceae14-a170-440e-a43b-21672b911fd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:30.186950 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ceae14-a170-440e-a43b-21672b911fd3 None admin] PATH_INFO: `/v3/projects/2bac67fae19b462ea7ad2dfef8e7e4bd` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:30.188127 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ceae14-a170-440e-a43b-21672b911fd3 None admin] RBAC: Authorizing `identity:get_project(project_id=2bac67fae19b462ea7ad2dfef8e7e4bd)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:30.189576 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ceae14-a170-440e-a43b-21672b911fd3 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:30.191281 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 560/1116] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Jul 11 14:28:30 2022] GET /identity/v3/projects/2bac67fae19b462ea7ad2dfef8e7e4bd => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:28:30.197623 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b19466-2e19-4360-abb1-e3ca0c8f62dc None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:30.292401 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:30.300282 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b19466-2e19-4360-abb1-e3ca0c8f62dc None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:30.333699 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b12696-7e92-45c7-b2fc-1adb62db65c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:30.334270 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b12696-7e92-45c7-b2fc-1adb62db65c3 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:30.334556 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b12696-7e92-45c7-b2fc-1adb62db65c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:30.334834 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b12696-7e92-45c7-b2fc-1adb62db65c3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:30.335670 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b12696-7e92-45c7-b2fc-1adb62db65c3 None admin] RBAC: Adding query filter params (role.id=7d8b0827910944f29bfa3a92d6cb7c92, scope.project.id=2bac67fae19b462ea7ad2dfef8e7e4bd, user.id=b4bb9f722d924844af8c9b99554d2418) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:28:30.335983 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b12696-7e92-45c7-b2fc-1adb62db65c3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:30.337449 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b12696-7e92-45c7-b2fc-1adb62db65c3 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:30.343632 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 557/1117] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Jul 11 14:28:30 2022] GET /identity/v3/role_assignments?user.id=b4bb9f722d924844af8c9b99554d2418&scope.project.id=2bac67fae19b462ea7ad2dfef8e7e4bd&role.id=7d8b0827910944f29bfa3a92d6cb7c92 => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:28:32.446282 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2c7a47-58aa-44aa-8428-3d12a38e9b2d None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:32.446850 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2c7a47-58aa-44aa-8428-3d12a38e9b2d None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:32.446850 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2c7a47-58aa-44aa-8428-3d12a38e9b2d None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:32.448215 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 561/1118] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:28:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:28:32.456948 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714ec7a8-7b92-43a2-978d-c7b03460fec7 None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:32.457454 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714ec7a8-7b92-43a2-978d-c7b03460fec7 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:32.457944 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714ec7a8-7b92-43a2-978d-c7b03460fec7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:32.485840 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-714ec7a8-7b92-43a2-978d-c7b03460fec7 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:28:32.487681 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-714ec7a8-7b92-43a2-978d-c7b03460fec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:28:32.597833 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 558/1119] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:28:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:28:32.623117 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2c7a47-58aa-44aa-8428-3d12a38e9b2d None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:32.721995 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:32.730603 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2c7a47-58aa-44aa-8428-3d12a38e9b2d None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:32.768233 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e3d503-b1a6-4298-b6ab-b32ba0b09177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:32.769156 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e3d503-b1a6-4298-b6ab-b32ba0b09177 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:32.769442 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e3d503-b1a6-4298-b6ab-b32ba0b09177 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:32.769724 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e3d503-b1a6-4298-b6ab-b32ba0b09177 None admin] PATH_INFO: `/v3/roles/7d8b0827910944f29bfa3a92d6cb7c92` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:32.771297 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e3d503-b1a6-4298-b6ab-b32ba0b09177 None admin] RBAC: Authorizing `identity:get_role(role_id=7d8b0827910944f29bfa3a92d6cb7c92)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:32.772702 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e3d503-b1a6-4298-b6ab-b32ba0b09177 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:32.774170 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 562/1120] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Jul 11 14:28:32 2022] GET /identity/v3/roles/7d8b0827910944f29bfa3a92d6cb7c92 => generated 223 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:28:32.781550 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714ec7a8-7b92-43a2-978d-c7b03460fec7 None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:32.867936 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:32.879972 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714ec7a8-7b92-43a2-978d-c7b03460fec7 None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:32.914167 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32becd0f-7edc-41a1-897b-cdc517b05497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:32.915033 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32becd0f-7edc-41a1-897b-cdc517b05497 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:32.915312 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32becd0f-7edc-41a1-897b-cdc517b05497 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:32.915583 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32becd0f-7edc-41a1-897b-cdc517b05497 None admin] PATH_INFO: `/v3/users/b4bb9f722d924844af8c9b99554d2418` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:32.916777 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32becd0f-7edc-41a1-897b-cdc517b05497 None admin] RBAC: Authorizing `identity:get_user(user_id=b4bb9f722d924844af8c9b99554d2418)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:32.918196 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32becd0f-7edc-41a1-897b-cdc517b05497 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:32.919844 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 559/1121] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Jul 11 14:28:32 2022] GET /identity/v3/users/b4bb9f722d924844af8c9b99554d2418 => generated 286 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:28:32.926534 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e3d503-b1a6-4298-b6ab-b32ba0b09177 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:33.040119 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e3d503-b1a6-4298-b6ab-b32ba0b09177 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:33.078160 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05a12f2-b4b0-48cc-8886-7031699be954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:33.079028 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05a12f2-b4b0-48cc-8886-7031699be954 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:33.079309 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05a12f2-b4b0-48cc-8886-7031699be954 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:33.079583 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05a12f2-b4b0-48cc-8886-7031699be954 None admin] PATH_INFO: `/v3/projects/2bac67fae19b462ea7ad2dfef8e7e4bd` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:33.080806 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05a12f2-b4b0-48cc-8886-7031699be954 None admin] RBAC: Authorizing `identity:get_project(project_id=2bac67fae19b462ea7ad2dfef8e7e4bd)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:33.083312 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05a12f2-b4b0-48cc-8886-7031699be954 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:33.085145 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 563/1122] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Jul 11 14:28:32 2022] GET /identity/v3/projects/2bac67fae19b462ea7ad2dfef8e7e4bd => generated 311 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:28:33.091938 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32becd0f-7edc-41a1-897b-cdc517b05497 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:33.193352 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32becd0f-7edc-41a1-897b-cdc517b05497 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:33.227070 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a724fa-6523-4fa0-a99e-408caa91dbcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:33.227957 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a724fa-6523-4fa0-a99e-408caa91dbcc None admin] REQUEST_METHOD: `PUT` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:33.228264 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a724fa-6523-4fa0-a99e-408caa91dbcc None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:33.228541 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a724fa-6523-4fa0-a99e-408caa91dbcc None admin] PATH_INFO: `/v3/projects/2bac67fae19b462ea7ad2dfef8e7e4bd/users/b4bb9f722d924844af8c9b99554d2418/roles/7d8b0827910944f29bfa3a92d6cb7c92` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:33.230741 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a724fa-6523-4fa0-a99e-408caa91dbcc None admin] RBAC: Authorizing `identity:create_grant(project_id=2bac67fae19b462ea7ad2dfef8e7e4bd, user_id=b4bb9f722d924844af8c9b99554d2418, role_id=7d8b0827910944f29bfa3a92d6cb7c92)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:33.232363 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a724fa-6523-4fa0-a99e-408caa91dbcc None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:33.245220 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 560/1123] 10.222.0.70 () {58 vars in 1439 bytes} [Mon Jul 11 14:28:33 2022] PUT /identity/v3/projects/2bac67fae19b462ea7ad2dfef8e7e4bd/users/b4bb9f722d924844af8c9b99554d2418/roles/7d8b0827910944f29bfa3a92d6cb7c92 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:28:35.305736 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29588d46-ded6-4c37-aa06-99323d09278b None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:35.306339 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29588d46-ded6-4c37-aa06-99323d09278b None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:35.306451 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29588d46-ded6-4c37-aa06-99323d09278b None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:35.307750 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 564/1124] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:28:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:28:35.314259 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca946ec8-47a4-4fb3-acaa-37240c5db950 None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:35.314674 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca946ec8-47a4-4fb3-acaa-37240c5db950 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:35.314862 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca946ec8-47a4-4fb3-acaa-37240c5db950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:35.332042 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-ca946ec8-47a4-4fb3-acaa-37240c5db950 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:28:35.333257 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-ca946ec8-47a4-4fb3-acaa-37240c5db950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:28:35.345191 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:35.405574 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 561/1125] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:28:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:28:35.430019 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29588d46-ded6-4c37-aa06-99323d09278b None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:35.462002 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:35.535036 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29588d46-ded6-4c37-aa06-99323d09278b None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:35.571812 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cafd734-6b9b-49ae-985b-2516bc314d3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:35.572746 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cafd734-6b9b-49ae-985b-2516bc314d3d None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:35.573025 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cafd734-6b9b-49ae-985b-2516bc314d3d None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:35.573828 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cafd734-6b9b-49ae-985b-2516bc314d3d None admin] PATH_INFO: `/v3/roles/7d8b0827910944f29bfa3a92d6cb7c92` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:35.574793 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cafd734-6b9b-49ae-985b-2516bc314d3d None admin] RBAC: Authorizing `identity:get_role(role_id=7d8b0827910944f29bfa3a92d6cb7c92)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:35.576883 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cafd734-6b9b-49ae-985b-2516bc314d3d None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:35.578277 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 565/1126] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Jul 11 14:28:35 2022] GET /identity/v3/roles/7d8b0827910944f29bfa3a92d6cb7c92 => generated 223 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:28:35.584143 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca946ec8-47a4-4fb3-acaa-37240c5db950 None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:35.683687 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca946ec8-47a4-4fb3-acaa-37240c5db950 None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:35.717465 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7858ca-1733-42fb-a0d0-927dc4aa0515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:35.718328 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7858ca-1733-42fb-a0d0-927dc4aa0515 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:35.718612 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7858ca-1733-42fb-a0d0-927dc4aa0515 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:35.718882 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7858ca-1733-42fb-a0d0-927dc4aa0515 None admin] PATH_INFO: `/v3/users/b4bb9f722d924844af8c9b99554d2418` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:35.720070 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7858ca-1733-42fb-a0d0-927dc4aa0515 None admin] RBAC: Authorizing `identity:get_user(user_id=b4bb9f722d924844af8c9b99554d2418)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:35.721522 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7858ca-1733-42fb-a0d0-927dc4aa0515 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:35.723129 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 562/1127] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Jul 11 14:28:35 2022] GET /identity/v3/users/b4bb9f722d924844af8c9b99554d2418 => generated 286 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:28:35.729110 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cafd734-6b9b-49ae-985b-2516bc314d3d None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:35.828597 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:35.832664 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cafd734-6b9b-49ae-985b-2516bc314d3d None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:35.867944 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e4b2f8-52f6-411d-a0ca-c336bcedbf79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:35.868628 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e4b2f8-52f6-411d-a0ca-c336bcedbf79 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:35.868913 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e4b2f8-52f6-411d-a0ca-c336bcedbf79 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:35.869193 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e4b2f8-52f6-411d-a0ca-c336bcedbf79 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:35.939486 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e4b2f8-52f6-411d-a0ca-c336bcedbf79 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:35.940969 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e4b2f8-52f6-411d-a0ca-c336bcedbf79 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:36.037265 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:36.042488 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 566/1128] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Jul 11 14:28:35 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 11 14:28:36.048187 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7858ca-1733-42fb-a0d0-927dc4aa0515 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:36.064019 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:36.151724 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7858ca-1733-42fb-a0d0-927dc4aa0515 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:36.186831 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f508a33a-f8e3-44af-af9d-49acf84aacab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:36.187691 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f508a33a-f8e3-44af-af9d-49acf84aacab None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:36.187973 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f508a33a-f8e3-44af-af9d-49acf84aacab None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:36.188274 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f508a33a-f8e3-44af-af9d-49acf84aacab None admin] PATH_INFO: `/v3/projects/2bac67fae19b462ea7ad2dfef8e7e4bd` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:36.189490 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f508a33a-f8e3-44af-af9d-49acf84aacab None admin] RBAC: Authorizing `identity:get_project(project_id=2bac67fae19b462ea7ad2dfef8e7e4bd)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:36.190928 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f508a33a-f8e3-44af-af9d-49acf84aacab None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:36.192678 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 563/1129] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Jul 11 14:28:36 2022] GET /identity/v3/projects/2bac67fae19b462ea7ad2dfef8e7e4bd => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:28:36.198889 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e4b2f8-52f6-411d-a0ca-c336bcedbf79 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:36.308341 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e4b2f8-52f6-411d-a0ca-c336bcedbf79 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:36.344714 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d6caea-3691-4787-825e-e394cdf1b61b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:36.345377 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d6caea-3691-4787-825e-e394cdf1b61b None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:36.345662 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d6caea-3691-4787-825e-e394cdf1b61b None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:36.345941 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d6caea-3691-4787-825e-e394cdf1b61b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:36.346778 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d6caea-3691-4787-825e-e394cdf1b61b None admin] RBAC: Adding query filter params (role.id=7d8b0827910944f29bfa3a92d6cb7c92, scope.project.id=2bac67fae19b462ea7ad2dfef8e7e4bd, user.id=b4bb9f722d924844af8c9b99554d2418) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:28:36.347092 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d6caea-3691-4787-825e-e394cdf1b61b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:36.348569 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d6caea-3691-4787-825e-e394cdf1b61b None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:36.354752 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 567/1130] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Jul 11 14:28:36 2022] GET /identity/v3/role_assignments?user.id=b4bb9f722d924844af8c9b99554d2418&scope.project.id=2bac67fae19b462ea7ad2dfef8e7e4bd&role.id=7d8b0827910944f29bfa3a92d6cb7c92 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:28:38.474413 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38fca28-4c89-48ad-9fcd-6ad7611a11d5 None None] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:38.475012 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38fca28-4c89-48ad-9fcd-6ad7611a11d5 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:38.475012 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38fca28-4c89-48ad-9fcd-6ad7611a11d5 None None] PATH_INFO: `/` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:38.476395 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 564/1131] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:28:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:28:38.482363 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e9528e-5bcd-4aad-8a99-2f92a47f6e83 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:38.482799 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e9528e-5bcd-4aad-8a99-2f92a47f6e83 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:38.482919 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e9528e-5bcd-4aad-8a99-2f92a47f6e83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:38.500792 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-88e9528e-5bcd-4aad-8a99-2f92a47f6e83 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:28:38.501999 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-88e9528e-5bcd-4aad-8a99-2f92a47f6e83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:28:38.561655 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:38.572509 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 568/1132] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:28:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:28:38.597477 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38fca28-4c89-48ad-9fcd-6ad7611a11d5 None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:38.682463 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:38.702560 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38fca28-4c89-48ad-9fcd-6ad7611a11d5 None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:38.737306 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712bed58-4373-4e6e-ab4f-4ae015d5a414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:38.738017 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712bed58-4373-4e6e-ab4f-4ae015d5a414 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:38.738298 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712bed58-4373-4e6e-ab4f-4ae015d5a414 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:38.738576 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712bed58-4373-4e6e-ab4f-4ae015d5a414 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:38.739757 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712bed58-4373-4e6e-ab4f-4ae015d5a414 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:38.741212 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712bed58-4373-4e6e-ab4f-4ae015d5a414 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:38.742827 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 565/1133] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 11 14:28:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:28:38.749519 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e9528e-5bcd-4aad-8a99-2f92a47f6e83 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:38.854982 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e9528e-5bcd-4aad-8a99-2f92a47f6e83 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:38.888745 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7331b8-2559-4fe9-b7db-74ef73849af0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:38.889410 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7331b8-2559-4fe9-b7db-74ef73849af0 None admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:38.889698 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7331b8-2559-4fe9-b7db-74ef73849af0 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:38.889981 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7331b8-2559-4fe9-b7db-74ef73849af0 None admin] PATH_INFO: `/v3/projects` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:38.890694 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7331b8-2559-4fe9-b7db-74ef73849af0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:38.892130 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7331b8-2559-4fe9-b7db-74ef73849af0 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:38.919316 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 569/1134] 10.222.0.70 () {60 vars in 1141 bytes} [Mon Jul 11 14:28:38 2022] POST /identity/v3/projects => generated 311 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:28:41.009527 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb69e873-5cee-4081-b8e3-fcc74508a615 None None] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:41.010066 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb69e873-5cee-4081-b8e3-fcc74508a615 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:41.010066 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb69e873-5cee-4081-b8e3-fcc74508a615 None None] PATH_INFO: `/` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:41.011430 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 566/1135] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:28:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:28:41.017276 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf1386c-14c0-4416-ad34-ba31bb972a14 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:41.017709 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf1386c-14c0-4416-ad34-ba31bb972a14 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:41.017835 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf1386c-14c0-4416-ad34-ba31bb972a14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:41.035733 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-3bf1386c-14c0-4416-ad34-ba31bb972a14 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:28:41.036954 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-3bf1386c-14c0-4416-ad34-ba31bb972a14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:28:41.078141 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:41.105591 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 570/1136] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:28:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:28:41.130358 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb69e873-5cee-4081-b8e3-fcc74508a615 None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:41.236431 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb69e873-5cee-4081-b8e3-fcc74508a615 None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:41.271353 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609f4076-abbf-4edd-859f-74d61476d7d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:41.272061 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609f4076-abbf-4edd-859f-74d61476d7d4 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:41.272370 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609f4076-abbf-4edd-859f-74d61476d7d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:41.272641 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609f4076-abbf-4edd-859f-74d61476d7d4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:41.273807 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609f4076-abbf-4edd-859f-74d61476d7d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:41.275247 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609f4076-abbf-4edd-859f-74d61476d7d4 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:41.276876 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 567/1137] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 11 14:28:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:28:41.283277 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf1386c-14c0-4416-ad34-ba31bb972a14 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:41.384219 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf1386c-14c0-4416-ad34-ba31bb972a14 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:41.424509 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42887143-5e96-4092-af03-5cb3c5670c3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:41.425206 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42887143-5e96-4092-af03-5cb3c5670c3a None admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:41.425492 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42887143-5e96-4092-af03-5cb3c5670c3a None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:41.425771 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42887143-5e96-4092-af03-5cb3c5670c3a None admin] PATH_INFO: `/v3/users` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:41.426499 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42887143-5e96-4092-af03-5cb3c5670c3a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:41.427983 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42887143-5e96-4092-af03-5cb3c5670c3a None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:41.451203 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 571/1138] 10.222.0.70 () {60 vars in 1132 bytes} [Mon Jul 11 14:28:41 2022] POST /identity/v3/users => generated 286 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:28:43.521940 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912133f2-d2cc-429f-a211-32c60a0f16bd None None] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:43.522477 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912133f2-d2cc-429f-a211-32c60a0f16bd None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:43.522477 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912133f2-d2cc-429f-a211-32c60a0f16bd None None] PATH_INFO: `/` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:43.523827 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 568/1139] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:28:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:28:43.529272 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468f8141-41b9-48e8-941f-324ac027b5ff None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:43.529717 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468f8141-41b9-48e8-941f-324ac027b5ff None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:43.529861 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468f8141-41b9-48e8-941f-324ac027b5ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:43.547042 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-468f8141-41b9-48e8-941f-324ac027b5ff None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:28:43.548292 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-468f8141-41b9-48e8-941f-324ac027b5ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:28:43.578382 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:43.627153 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 572/1140] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:28:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:28:43.670070 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912133f2-d2cc-429f-a211-32c60a0f16bd None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:43.701757 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:43.836704 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912133f2-d2cc-429f-a211-32c60a0f16bd None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:43.872733 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e521573-104f-4676-b338-144ac412b2fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:43.873705 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e521573-104f-4676-b338-144ac412b2fd None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:43.873999 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e521573-104f-4676-b338-144ac412b2fd None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:43.874323 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e521573-104f-4676-b338-144ac412b2fd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:43.885675 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e521573-104f-4676-b338-144ac412b2fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:28:43.893388 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application [None req-5e521573-104f-4676-b338-144ac412b2fd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:28:43.893388 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:28:43.893388 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:28:43.893388 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:28:43.893388 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:28:43.893388 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:28:43.893388 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:28:43.893388 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:28:43.893388 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:28:43.893388 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:28:43.893388 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:28:43.893388 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:28:43.893388 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:28:43.893388 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:28:43.893388 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:28:43.893388 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:28:43.894536 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:28:43.894536 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:28:43.894536 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:28:43.894536 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:28:43.894536 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:28:43.894536 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:28:43.894536 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:28:43.894536 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:28:43.894536 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:28:43.894536 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:28:43.894536 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:28:43.894536 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application with Lock( Jul 11 14:28:43.894536 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:28:43.894536 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:28:43.894536 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:28:43.894536 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:28:43.895810 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:28:43.895810 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:28:43.895810 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:28:43.895810 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:28:43.895810 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:28:43.895810 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:28:43.895810 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:28:43.895810 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:28:43.895810 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:28:43.895810 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:28:43.895810 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:28:43.895810 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Jul 11 14:28:43.895810 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 569/1141] 10.222.0.70 () {56 vars in 1096 bytes} [Mon Jul 11 14:28:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:28:43.901121 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468f8141-41b9-48e8-941f-324ac027b5ff None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:44.001799 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468f8141-41b9-48e8-941f-324ac027b5ff None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:44.039112 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5505a861-9a6f-47d0-894f-4e0867380bf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:44.039805 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5505a861-9a6f-47d0-894f-4e0867380bf5 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:44.040089 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5505a861-9a6f-47d0-894f-4e0867380bf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:44.040399 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5505a861-9a6f-47d0-894f-4e0867380bf5 None admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:44.041201 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5505a861-9a6f-47d0-894f-4e0867380bf5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:28:44.041514 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5505a861-9a6f-47d0-894f-4e0867380bf5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:44.042924 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5505a861-9a6f-47d0-894f-4e0867380bf5 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:44.052893 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 573/1142] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Jul 11 14:28:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:28:44.059616 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e521573-104f-4676-b338-144ac412b2fd None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:44.145069 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:44.168523 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e521573-104f-4676-b338-144ac412b2fd None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:44.204780 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9b2ed7-6e83-43e8-92b9-58f1f24c1db7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:44.205668 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9b2ed7-6e83-43e8-92b9-58f1f24c1db7 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:44.205949 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9b2ed7-6e83-43e8-92b9-58f1f24c1db7 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:44.206222 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9b2ed7-6e83-43e8-92b9-58f1f24c1db7 None admin] PATH_INFO: `/v3/users/e06d82d6d8fe40308bba1ec67a9c2583` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:44.221614 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9b2ed7-6e83-43e8-92b9-58f1f24c1db7 None admin] RBAC: Authorizing `identity:get_user(user_id=e06d82d6d8fe40308bba1ec67a9c2583)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:44.223043 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9b2ed7-6e83-43e8-92b9-58f1f24c1db7 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:44.224817 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 570/1143] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Jul 11 14:28:44 2022] GET /identity/v3/users/e06d82d6d8fe40308bba1ec67a9c2583 => generated 286 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:28:44.230661 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5505a861-9a6f-47d0-894f-4e0867380bf5 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:44.255666 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:44.330753 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5505a861-9a6f-47d0-894f-4e0867380bf5 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:44.363994 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd8f8b2-9740-4c1d-a1b2-8af92ae9dafc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:44.364662 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd8f8b2-9740-4c1d-a1b2-8af92ae9dafc None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:44.364944 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd8f8b2-9740-4c1d-a1b2-8af92ae9dafc None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:44.365216 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd8f8b2-9740-4c1d-a1b2-8af92ae9dafc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:44.431339 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd8f8b2-9740-4c1d-a1b2-8af92ae9dafc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:44.432812 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd8f8b2-9740-4c1d-a1b2-8af92ae9dafc None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:44.456278 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:44.531122 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 574/1144] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Jul 11 14:28:44 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 11 14:28:44.536813 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9b2ed7-6e83-43e8-92b9-58f1f24c1db7 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:44.641966 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9b2ed7-6e83-43e8-92b9-58f1f24c1db7 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:44.675178 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0b6731-cef2-4c3f-9048-43b789508f86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:44.676025 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0b6731-cef2-4c3f-9048-43b789508f86 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:44.676334 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0b6731-cef2-4c3f-9048-43b789508f86 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:44.676610 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0b6731-cef2-4c3f-9048-43b789508f86 None admin] PATH_INFO: `/v3/projects/85b8fad1b94547eaab4ed52695e9e460` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:44.677773 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0b6731-cef2-4c3f-9048-43b789508f86 None admin] RBAC: Authorizing `identity:get_project(project_id=85b8fad1b94547eaab4ed52695e9e460)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:44.679444 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0b6731-cef2-4c3f-9048-43b789508f86 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:44.681148 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 571/1145] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Jul 11 14:28:44 2022] GET /identity/v3/projects/85b8fad1b94547eaab4ed52695e9e460 => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:28:44.687785 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd8f8b2-9740-4c1d-a1b2-8af92ae9dafc None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:44.786354 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd8f8b2-9740-4c1d-a1b2-8af92ae9dafc None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:44.810136 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:44.821746 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96264fbb-c8e0-4290-bf8d-22b22c6d98ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:44.822403 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96264fbb-c8e0-4290-bf8d-22b22c6d98ce None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:44.822691 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96264fbb-c8e0-4290-bf8d-22b22c6d98ce None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:44.822972 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96264fbb-c8e0-4290-bf8d-22b22c6d98ce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:44.823798 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96264fbb-c8e0-4290-bf8d-22b22c6d98ce None admin] RBAC: Adding query filter params (role.id=b46df176b0fe479da63c318db225bed4, scope.project.id=85b8fad1b94547eaab4ed52695e9e460, user.id=e06d82d6d8fe40308bba1ec67a9c2583) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:28:44.824112 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96264fbb-c8e0-4290-bf8d-22b22c6d98ce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:44.825733 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96264fbb-c8e0-4290-bf8d-22b22c6d98ce None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:44.831053 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 575/1146] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Jul 11 14:28:44 2022] GET /identity/v3/role_assignments?user.id=e06d82d6d8fe40308bba1ec67a9c2583&scope.project.id=85b8fad1b94547eaab4ed52695e9e460&role.id=b46df176b0fe479da63c318db225bed4 => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:28:46.913558 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438fef99-7b02-4f4d-ae49-2ea39f1e6555 None None] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:46.914110 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438fef99-7b02-4f4d-ae49-2ea39f1e6555 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:46.914110 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438fef99-7b02-4f4d-ae49-2ea39f1e6555 None None] PATH_INFO: `/` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:46.915467 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 572/1147] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:28:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:28:46.921522 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113c9a2f-c9d9-4570-9438-85b3a8d32281 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:46.921923 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113c9a2f-c9d9-4570-9438-85b3a8d32281 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:46.922090 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113c9a2f-c9d9-4570-9438-85b3a8d32281 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:46.940905 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-113c9a2f-c9d9-4570-9438-85b3a8d32281 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:28:46.942111 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-113c9a2f-c9d9-4570-9438-85b3a8d32281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:28:47.008771 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 576/1148] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:28:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:28:47.031554 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438fef99-7b02-4f4d-ae49-2ea39f1e6555 None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:47.035361 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:47.141857 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438fef99-7b02-4f4d-ae49-2ea39f1e6555 None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:47.174946 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750a7e3d-2ec8-4a73-a7e6-a7351d0b5afd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:47.175647 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750a7e3d-2ec8-4a73-a7e6-a7351d0b5afd None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:47.175927 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750a7e3d-2ec8-4a73-a7e6-a7351d0b5afd None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:47.176230 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750a7e3d-2ec8-4a73-a7e6-a7351d0b5afd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:47.186940 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750a7e3d-2ec8-4a73-a7e6-a7351d0b5afd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:28:47.194426 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application [None req-750a7e3d-2ec8-4a73-a7e6-a7351d0b5afd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:28:47.194426 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:28:47.194426 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:28:47.194426 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:28:47.194426 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:28:47.194426 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:28:47.194426 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:28:47.194426 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:28:47.194426 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:28:47.194426 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:28:47.194426 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:28:47.194426 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:28:47.194426 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:28:47.194426 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:28:47.194426 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:28:47.194426 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:28:47.195517 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:28:47.195517 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:28:47.195517 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:28:47.195517 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:28:47.195517 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:28:47.195517 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:28:47.195517 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:28:47.195517 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:28:47.195517 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:28:47.195517 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:28:47.195517 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:28:47.195517 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application with Lock( Jul 11 14:28:47.195517 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:28:47.195517 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:28:47.195517 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:28:47.195517 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:28:47.196431 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:28:47.196431 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:28:47.196431 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:28:47.196431 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:28:47.196431 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:28:47.196431 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:28:47.196431 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:28:47.196431 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:28:47.196431 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:28:47.196431 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:28:47.196431 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:28:47.196431 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Jul 11 14:28:47.196431 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 573/1149] 10.222.0.70 () {56 vars in 1096 bytes} [Mon Jul 11 14:28:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:28:47.201859 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113c9a2f-c9d9-4570-9438-85b3a8d32281 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:47.299449 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113c9a2f-c9d9-4570-9438-85b3a8d32281 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:47.315861 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:47.334000 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5d3973-b9c3-4fdf-be47-e18f18fc5d8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:47.334666 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5d3973-b9c3-4fdf-be47-e18f18fc5d8e None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:47.334946 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5d3973-b9c3-4fdf-be47-e18f18fc5d8e None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:47.335219 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5d3973-b9c3-4fdf-be47-e18f18fc5d8e None admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:47.335951 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5d3973-b9c3-4fdf-be47-e18f18fc5d8e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:28:47.336280 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5d3973-b9c3-4fdf-be47-e18f18fc5d8e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:47.337642 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5d3973-b9c3-4fdf-be47-e18f18fc5d8e None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:47.346050 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 577/1150] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Jul 11 14:28:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:28:47.352088 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750a7e3d-2ec8-4a73-a7e6-a7351d0b5afd None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:47.422224 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:47.462713 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750a7e3d-2ec8-4a73-a7e6-a7351d0b5afd None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:47.497334 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b099f58-14fa-47b3-a7bc-ac4234e9e76a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:47.498200 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b099f58-14fa-47b3-a7bc-ac4234e9e76a None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:47.498486 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b099f58-14fa-47b3-a7bc-ac4234e9e76a None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:47.498758 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b099f58-14fa-47b3-a7bc-ac4234e9e76a None admin] PATH_INFO: `/v3/users/e06d82d6d8fe40308bba1ec67a9c2583` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:47.499951 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b099f58-14fa-47b3-a7bc-ac4234e9e76a None admin] RBAC: Authorizing `identity:get_user(user_id=e06d82d6d8fe40308bba1ec67a9c2583)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:47.501408 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b099f58-14fa-47b3-a7bc-ac4234e9e76a None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:47.503007 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 574/1151] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Jul 11 14:28:47 2022] GET /identity/v3/users/e06d82d6d8fe40308bba1ec67a9c2583 => generated 286 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:28:47.509196 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5d3973-b9c3-4fdf-be47-e18f18fc5d8e None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:47.609055 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5d3973-b9c3-4fdf-be47-e18f18fc5d8e None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:47.643019 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e03d3b-0fb7-4430-92d4-3b37e77eaf9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:47.643874 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e03d3b-0fb7-4430-92d4-3b37e77eaf9d None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:47.644159 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e03d3b-0fb7-4430-92d4-3b37e77eaf9d None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:47.644469 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e03d3b-0fb7-4430-92d4-3b37e77eaf9d None admin] PATH_INFO: `/v3/projects/85b8fad1b94547eaab4ed52695e9e460` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:47.645650 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e03d3b-0fb7-4430-92d4-3b37e77eaf9d None admin] RBAC: Authorizing `identity:get_project(project_id=85b8fad1b94547eaab4ed52695e9e460)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:47.647091 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e03d3b-0fb7-4430-92d4-3b37e77eaf9d None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:47.648825 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 578/1152] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Jul 11 14:28:47 2022] GET /identity/v3/projects/85b8fad1b94547eaab4ed52695e9e460 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:28:47.654876 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b099f58-14fa-47b3-a7bc-ac4234e9e76a None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:47.767292 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b099f58-14fa-47b3-a7bc-ac4234e9e76a None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:47.798521 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:47.804564 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd13035d-eb54-4457-85b8-488717016261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:47.805456 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd13035d-eb54-4457-85b8-488717016261 None admin] REQUEST_METHOD: `PUT` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:47.805736 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd13035d-eb54-4457-85b8-488717016261 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:47.806009 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd13035d-eb54-4457-85b8-488717016261 None admin] PATH_INFO: `/v3/projects/85b8fad1b94547eaab4ed52695e9e460/users/e06d82d6d8fe40308bba1ec67a9c2583/roles/b46df176b0fe479da63c318db225bed4` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:47.807984 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd13035d-eb54-4457-85b8-488717016261 None admin] RBAC: Authorizing `identity:create_grant(project_id=85b8fad1b94547eaab4ed52695e9e460, user_id=e06d82d6d8fe40308bba1ec67a9c2583, role_id=b46df176b0fe479da63c318db225bed4)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:47.810691 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd13035d-eb54-4457-85b8-488717016261 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:47.823698 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 575/1153] 10.222.0.70 () {58 vars in 1439 bytes} [Mon Jul 11 14:28:47 2022] PUT /identity/v3/projects/85b8fad1b94547eaab4ed52695e9e460/users/e06d82d6d8fe40308bba1ec67a9c2583/roles/b46df176b0fe479da63c318db225bed4 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:28:49.906037 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d009dac8-6319-4e82-82f8-c7abef0b3fc1 None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:49.906639 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d009dac8-6319-4e82-82f8-c7abef0b3fc1 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:49.906639 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d009dac8-6319-4e82-82f8-c7abef0b3fc1 None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:49.907987 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 579/1154] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:28:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:28:49.913990 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72285b2f-8eab-4269-872b-9d42a0acc1ef None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:49.914564 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72285b2f-8eab-4269-872b-9d42a0acc1ef None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:49.914564 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72285b2f-8eab-4269-872b-9d42a0acc1ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:49.933013 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-72285b2f-8eab-4269-872b-9d42a0acc1ef None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:28:49.934270 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-72285b2f-8eab-4269-872b-9d42a0acc1ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:28:50.007477 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 576/1155] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:28:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:28:50.031975 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d009dac8-6319-4e82-82f8-c7abef0b3fc1 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:50.080002 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:50.134370 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d009dac8-6319-4e82-82f8-c7abef0b3fc1 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:50.168810 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30782f10-a497-4acf-a71c-d0d7d1f0f980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:50.169519 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30782f10-a497-4acf-a71c-d0d7d1f0f980 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:50.169804 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30782f10-a497-4acf-a71c-d0d7d1f0f980 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:50.170081 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30782f10-a497-4acf-a71c-d0d7d1f0f980 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:50.180591 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30782f10-a497-4acf-a71c-d0d7d1f0f980 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:28:50.188329 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-30782f10-a497-4acf-a71c-d0d7d1f0f980 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:28:50.188329 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:28:50.188329 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:28:50.188329 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:28:50.188329 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:28:50.188329 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:28:50.188329 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:28:50.188329 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:28:50.188329 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:28:50.188329 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:28:50.188329 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:28:50.188329 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:28:50.188329 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:28:50.188329 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:28:50.188329 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:28:50.188329 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:28:50.189430 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:28:50.189430 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:28:50.189430 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:28:50.189430 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:28:50.189430 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:28:50.189430 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:28:50.189430 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:28:50.189430 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:28:50.189430 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:28:50.189430 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:28:50.189430 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:28:50.189430 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( Jul 11 14:28:50.189430 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:28:50.189430 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:28:50.189430 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:28:50.189430 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:28:50.190431 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:28:50.190431 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:28:50.190431 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:28:50.190431 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:28:50.190431 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:28:50.190431 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:28:50.190431 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:28:50.190431 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:28:50.190431 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:28:50.190431 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:28:50.190431 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:28:50.190431 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Jul 11 14:28:50.190431 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 580/1156] 10.222.0.70 () {56 vars in 1096 bytes} [Mon Jul 11 14:28:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:28:50.195632 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72285b2f-8eab-4269-872b-9d42a0acc1ef None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:50.292553 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72285b2f-8eab-4269-872b-9d42a0acc1ef None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:50.317187 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:50.329624 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c6195a-7576-4699-b68c-9b28e99a9f30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:50.330286 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c6195a-7576-4699-b68c-9b28e99a9f30 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:50.330566 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c6195a-7576-4699-b68c-9b28e99a9f30 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:50.330840 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c6195a-7576-4699-b68c-9b28e99a9f30 None admin] PATH_INFO: `/v3/roles` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:50.331577 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c6195a-7576-4699-b68c-9b28e99a9f30 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:28:50.331878 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c6195a-7576-4699-b68c-9b28e99a9f30 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:50.333265 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c6195a-7576-4699-b68c-9b28e99a9f30 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:50.341608 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 577/1157] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Jul 11 14:28:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:28:50.347561 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30782f10-a497-4acf-a71c-d0d7d1f0f980 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:50.447964 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30782f10-a497-4acf-a71c-d0d7d1f0f980 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:50.456711 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:50.488633 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e436a43-9afb-4110-a5ce-0f0271dc2b78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:50.489825 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e436a43-9afb-4110-a5ce-0f0271dc2b78 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:50.490113 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e436a43-9afb-4110-a5ce-0f0271dc2b78 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:50.490395 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e436a43-9afb-4110-a5ce-0f0271dc2b78 None admin] PATH_INFO: `/v3/users/e06d82d6d8fe40308bba1ec67a9c2583` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:50.491593 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e436a43-9afb-4110-a5ce-0f0271dc2b78 None admin] RBAC: Authorizing `identity:get_user(user_id=e06d82d6d8fe40308bba1ec67a9c2583)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:50.493060 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e436a43-9afb-4110-a5ce-0f0271dc2b78 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:50.494714 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 581/1158] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Jul 11 14:28:50 2022] GET /identity/v3/users/e06d82d6d8fe40308bba1ec67a9c2583 => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:28:50.501017 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c6195a-7576-4699-b68c-9b28e99a9f30 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:50.602119 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c6195a-7576-4699-b68c-9b28e99a9f30 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:50.634874 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3861261c-30ca-48a8-8e2d-df8984864c2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:50.635523 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3861261c-30ca-48a8-8e2d-df8984864c2b None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:50.635809 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3861261c-30ca-48a8-8e2d-df8984864c2b None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:50.636087 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3861261c-30ca-48a8-8e2d-df8984864c2b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:50.686843 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:50.703084 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3861261c-30ca-48a8-8e2d-df8984864c2b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:50.704494 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3861261c-30ca-48a8-8e2d-df8984864c2b None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:50.812753 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 578/1159] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Jul 11 14:28:50 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 11 14:28:50.818656 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e436a43-9afb-4110-a5ce-0f0271dc2b78 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:50.921471 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e436a43-9afb-4110-a5ce-0f0271dc2b78 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:50.957259 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28e25f8-55d0-41c9-91eb-b42214d6ac5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:50.958037 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28e25f8-55d0-41c9-91eb-b42214d6ac5f None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:50.958319 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28e25f8-55d0-41c9-91eb-b42214d6ac5f None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:50.958593 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28e25f8-55d0-41c9-91eb-b42214d6ac5f None admin] PATH_INFO: `/v3/projects/85b8fad1b94547eaab4ed52695e9e460` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:50.959757 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28e25f8-55d0-41c9-91eb-b42214d6ac5f None admin] RBAC: Authorizing `identity:get_project(project_id=85b8fad1b94547eaab4ed52695e9e460)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:50.961226 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28e25f8-55d0-41c9-91eb-b42214d6ac5f None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:50.962927 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 582/1160] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Jul 11 14:28:50 2022] GET /identity/v3/projects/85b8fad1b94547eaab4ed52695e9e460 => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:28:50.969594 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3861261c-30ca-48a8-8e2d-df8984864c2b None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:51.052165 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:51.068443 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3861261c-30ca-48a8-8e2d-df8984864c2b None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:51.103291 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c48389-d0c9-4566-ac8a-e9262324296d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:51.103948 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c48389-d0c9-4566-ac8a-e9262324296d None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:51.104252 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c48389-d0c9-4566-ac8a-e9262324296d None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:51.104532 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c48389-d0c9-4566-ac8a-e9262324296d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:51.106034 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c48389-d0c9-4566-ac8a-e9262324296d None admin] RBAC: Adding query filter params (role.id=b46df176b0fe479da63c318db225bed4, scope.project.id=85b8fad1b94547eaab4ed52695e9e460, user.id=e06d82d6d8fe40308bba1ec67a9c2583) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:28:51.106348 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c48389-d0c9-4566-ac8a-e9262324296d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:51.107793 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c48389-d0c9-4566-ac8a-e9262324296d None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:51.114205 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 579/1161] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Jul 11 14:28:50 2022] GET /identity/v3/role_assignments?user.id=e06d82d6d8fe40308bba1ec67a9c2583&scope.project.id=85b8fad1b94547eaab4ed52695e9e460&role.id=b46df176b0fe479da63c318db225bed4 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:28:53.220027 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997d12a8-ee74-418a-b611-b90b5e0e82b3 None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:53.220621 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997d12a8-ee74-418a-b611-b90b5e0e82b3 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:53.220621 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997d12a8-ee74-418a-b611-b90b5e0e82b3 None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:53.222003 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 583/1162] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:28:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:28:53.227321 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3282309-5067-4f41-809e-86bbcb36085a None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:53.227775 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3282309-5067-4f41-809e-86bbcb36085a None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:53.227874 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3282309-5067-4f41-809e-86bbcb36085a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:53.246538 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-c3282309-5067-4f41-809e-86bbcb36085a None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:28:53.247742 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-c3282309-5067-4f41-809e-86bbcb36085a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:28:53.314473 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 580/1163] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:28:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:28:53.337800 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997d12a8-ee74-418a-b611-b90b5e0e82b3 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:53.383407 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:53.444463 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997d12a8-ee74-418a-b611-b90b5e0e82b3 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:53.479044 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac3b4e3-78d1-4b49-a287-84bb6d3df816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:53.479610 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac3b4e3-78d1-4b49-a287-84bb6d3df816 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:53.480565 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac3b4e3-78d1-4b49-a287-84bb6d3df816 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:53.480865 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac3b4e3-78d1-4b49-a287-84bb6d3df816 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:53.554500 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac3b4e3-78d1-4b49-a287-84bb6d3df816 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:53.555971 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac3b4e3-78d1-4b49-a287-84bb6d3df816 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:53.601507 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:53.659201 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 584/1164] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Jul 11 14:28:53 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 11 14:28:53.665235 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3282309-5067-4f41-809e-86bbcb36085a None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:53.742508 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:53.765457 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3282309-5067-4f41-809e-86bbcb36085a None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:53.799443 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4aea3b-c796-4e45-8176-f6e82b4add37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:53.800262 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4aea3b-c796-4e45-8176-f6e82b4add37 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:53.800547 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4aea3b-c796-4e45-8176-f6e82b4add37 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:53.800821 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4aea3b-c796-4e45-8176-f6e82b4add37 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:53.807705 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4aea3b-c796-4e45-8176-f6e82b4add37 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:53.809498 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4aea3b-c796-4e45-8176-f6e82b4add37 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:53.823392 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application [None req-3d4aea3b-c796-4e45-8176-f6e82b4add37 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 11 14:28:53.823392 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:28:53.823392 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 11 14:28:53.823392 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 11 14:28:53.823392 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 14:28:53.823392 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 14:28:53.823392 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 14:28:53.823392 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 14:28:53.823392 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jul 11 14:28:53.823392 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Jul 11 14:28:53.823392 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 14:28:53.823392 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Jul 11 14:28:53.823392 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:28:53.823392 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:28:53.823392 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:28:53.823392 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:28:53.823392 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:28:53.825803 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:28:53.825803 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:28:53.825803 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:28:53.825803 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:28:53.825803 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:28:53.825803 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:28:53.825803 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:28:53.825803 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:28:53.825803 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:28:53.825803 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:28:53.825803 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:28:53.825803 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:28:53.825803 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:28:53.825803 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:28:53.825803 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:28:53.825803 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:28:53.836226 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:28:53.836226 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application with Lock( Jul 11 14:28:53.836226 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:28:53.836226 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:28:53.836226 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:28:53.836226 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:28:53.836226 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:28:53.836226 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:28:53.836226 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:28:53.836226 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:28:53.836226 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 11 14:28:53.836226 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:28:53.836226 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 11 14:28:53.836226 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Jul 11 14:28:53.836226 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 581/1165] 10.222.0.70 () {56 vars in 1117 bytes} [Mon Jul 11 14:28:53 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:28:53.837223 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac3b4e3-78d1-4b49-a287-84bb6d3df816 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:53.936570 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac3b4e3-78d1-4b49-a287-84bb6d3df816 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:53.970510 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abd3138-bb78-447a-9df2-11524277c5ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:53.971162 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abd3138-bb78-447a-9df2-11524277c5ff None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:53.971448 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abd3138-bb78-447a-9df2-11524277c5ff None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:53.971720 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abd3138-bb78-447a-9df2-11524277c5ff None admin] PATH_INFO: `/v3/domains` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:53.972459 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abd3138-bb78-447a-9df2-11524277c5ff None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:28:53.972763 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abd3138-bb78-447a-9df2-11524277c5ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:53.974130 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abd3138-bb78-447a-9df2-11524277c5ff None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:53.981462 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 585/1166] 10.222.0.70 () {56 vars in 1115 bytes} [Mon Jul 11 14:28:53 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:28:56.023724 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a58ce3f-72d4-4795-b453-b9ff667eebbf None None] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:56.024329 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a58ce3f-72d4-4795-b453-b9ff667eebbf None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:56.024329 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a58ce3f-72d4-4795-b453-b9ff667eebbf None None] PATH_INFO: `/` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:56.027493 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 582/1167] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:28:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:28:56.033794 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e4f039-0240-4a8e-8da6-f7fcb5c71eeb None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:56.034326 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e4f039-0240-4a8e-8da6-f7fcb5c71eeb None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:56.034326 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e4f039-0240-4a8e-8da6-f7fcb5c71eeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:56.046891 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:56.052734 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-99e4f039-0240-4a8e-8da6-f7fcb5c71eeb None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:28:56.054250 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-99e4f039-0240-4a8e-8da6-f7fcb5c71eeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:28:56.126421 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 586/1168] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:28:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:28:56.149958 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a58ce3f-72d4-4795-b453-b9ff667eebbf None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:56.258912 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a58ce3f-72d4-4795-b453-b9ff667eebbf None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:56.296794 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1417ee-e5d8-48b4-b324-36c86de14ad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:56.297363 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1417ee-e5d8-48b4-b324-36c86de14ad1 None admin] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:56.297643 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1417ee-e5d8-48b4-b324-36c86de14ad1 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:56.297916 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1417ee-e5d8-48b4-b324-36c86de14ad1 None admin] PATH_INFO: `/v3/domains` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:56.298648 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1417ee-e5d8-48b4-b324-36c86de14ad1 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:56.300006 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1417ee-e5d8-48b4-b324-36c86de14ad1 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:56.312342 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:56.320941 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 583/1169] 10.222.0.70 () {60 vars in 1138 bytes} [Mon Jul 11 14:28:56 2022] POST /identity/v3/domains => generated 267 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:28:58.407676 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc75b46-b984-4252-a83b-7ec498d5a139 None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:58.408255 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc75b46-b984-4252-a83b-7ec498d5a139 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:58.408255 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc75b46-b984-4252-a83b-7ec498d5a139 None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:58.409641 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 587/1170] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:28:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:28:58.414858 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7bb8fd-9d8d-46d5-8fff-ac10f4bee7a9 None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:58.415297 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7bb8fd-9d8d-46d5-8fff-ac10f4bee7a9 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:58.415518 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7bb8fd-9d8d-46d5-8fff-ac10f4bee7a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:58.434407 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-1f7bb8fd-9d8d-46d5-8fff-ac10f4bee7a9 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:28:58.435593 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-1f7bb8fd-9d8d-46d5-8fff-ac10f4bee7a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:28:58.502615 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 584/1171] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:28:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:28:58.526257 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc75b46-b984-4252-a83b-7ec498d5a139 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:58.633213 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc75b46-b984-4252-a83b-7ec498d5a139 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:58.666863 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ed24c2-9992-48ad-97fc-522b8dff22e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:58.668034 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ed24c2-9992-48ad-97fc-522b8dff22e6 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:58.668342 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ed24c2-9992-48ad-97fc-522b8dff22e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:58.668616 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ed24c2-9992-48ad-97fc-522b8dff22e6 None admin] PATH_INFO: `/v3/domains/c1507a7b6de24270abf5e087f0faab25` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:58.671287 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:58.679914 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ed24c2-9992-48ad-97fc-522b8dff22e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=c1507a7b6de24270abf5e087f0faab25)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:58.681465 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ed24c2-9992-48ad-97fc-522b8dff22e6 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:58.683798 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 588/1172] 10.222.0.70 () {56 vars in 1183 bytes} [Mon Jul 11 14:28:58 2022] GET /identity/v3/domains/c1507a7b6de24270abf5e087f0faab25 => generated 267 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:28:58.689881 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7bb8fd-9d8d-46d5-8fff-ac10f4bee7a9 None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:58.789020 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7bb8fd-9d8d-46d5-8fff-ac10f4bee7a9 None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:58.815926 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:58.825259 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4a0f73-5cc5-4224-a9a9-85f770bf7c18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:58.826048 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4a0f73-5cc5-4224-a9a9-85f770bf7c18 None admin] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:58.826407 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4a0f73-5cc5-4224-a9a9-85f770bf7c18 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:58.826686 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4a0f73-5cc5-4224-a9a9-85f770bf7c18 None admin] PATH_INFO: `/v3/projects` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:58.827455 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4a0f73-5cc5-4224-a9a9-85f770bf7c18 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:58.829192 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4a0f73-5cc5-4224-a9a9-85f770bf7c18 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:58.861192 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 585/1173] 10.222.0.70 () {60 vars in 1141 bytes} [Mon Jul 11 14:28:58 2022] POST /identity/v3/projects => generated 361 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:29:01.072064 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8057efae-60a9-46b0-bfde-c8d702e0c49a None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:01.072686 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8057efae-60a9-46b0-bfde-c8d702e0c49a None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:01.072686 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8057efae-60a9-46b0-bfde-c8d702e0c49a None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:01.074354 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 589/1174] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:29:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:29:01.080811 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97e6bd4-ee10-4177-af2c-a0b81f6a1925 None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:01.081342 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97e6bd4-ee10-4177-af2c-a0b81f6a1925 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:01.081342 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97e6bd4-ee10-4177-af2c-a0b81f6a1925 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:01.099801 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-f97e6bd4-ee10-4177-af2c-a0b81f6a1925 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:29:01.101027 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-f97e6bd4-ee10-4177-af2c-a0b81f6a1925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:29:01.175845 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 586/1175] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:29:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 14:29:01.203078 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8057efae-60a9-46b0-bfde-c8d702e0c49a None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:01.325560 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8057efae-60a9-46b0-bfde-c8d702e0c49a None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:01.362949 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25d75fb-0ff5-4c90-9c3b-4d867d4ab5fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:01.363811 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25d75fb-0ff5-4c90-9c3b-4d867d4ab5fb None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:01.364090 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25d75fb-0ff5-4c90-9c3b-4d867d4ab5fb None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:01.364397 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25d75fb-0ff5-4c90-9c3b-4d867d4ab5fb None admin] PATH_INFO: `/v3/domains/c1507a7b6de24270abf5e087f0faab25` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:01.365564 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25d75fb-0ff5-4c90-9c3b-4d867d4ab5fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=c1507a7b6de24270abf5e087f0faab25)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:01.367226 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25d75fb-0ff5-4c90-9c3b-4d867d4ab5fb None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:01.368914 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 590/1176] 10.222.0.70 () {56 vars in 1183 bytes} [Mon Jul 11 14:29:01 2022] GET /identity/v3/domains/c1507a7b6de24270abf5e087f0faab25 => generated 267 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:29:01.375780 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97e6bd4-ee10-4177-af2c-a0b81f6a1925 None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:01.482788 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97e6bd4-ee10-4177-af2c-a0b81f6a1925 None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:01.494031 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:01.520818 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a04e7c-9657-48b9-a339-4e094daf14ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:01.521632 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a04e7c-9657-48b9-a339-4e094daf14ac None admin] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:01.521916 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a04e7c-9657-48b9-a339-4e094daf14ac None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:01.522211 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a04e7c-9657-48b9-a339-4e094daf14ac None admin] PATH_INFO: `/v3/users` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:01.522913 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a04e7c-9657-48b9-a339-4e094daf14ac None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:01.524397 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a04e7c-9657-48b9-a339-4e094daf14ac None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:01.548987 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 587/1177] 10.222.0.70 () {60 vars in 1132 bytes} [Mon Jul 11 14:29:01 2022] POST /identity/v3/users => generated 311 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:29:03.708049 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8ab8db-4b64-4b77-9c06-7252d5c9d968 None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:03.708602 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8ab8db-4b64-4b77-9c06-7252d5c9d968 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:03.708602 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8ab8db-4b64-4b77-9c06-7252d5c9d968 None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:03.709988 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 591/1178] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:29:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:29:03.715302 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aac493-3dda-4a02-963c-185b719b0b72 None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:03.715749 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aac493-3dda-4a02-963c-185b719b0b72 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:03.715850 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aac493-3dda-4a02-963c-185b719b0b72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:03.733408 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-44aac493-3dda-4a02-963c-185b719b0b72 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:29:03.734606 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-44aac493-3dda-4a02-963c-185b719b0b72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:29:03.816422 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 588/1179] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:29:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:29:03.842150 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8ab8db-4b64-4b77-9c06-7252d5c9d968 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:03.904763 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:03.943079 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8ab8db-4b64-4b77-9c06-7252d5c9d968 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:03.977041 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74137aa3-057f-44c2-8e29-0e53f8d167cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:03.977829 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74137aa3-057f-44c2-8e29-0e53f8d167cc None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:03.978106 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74137aa3-057f-44c2-8e29-0e53f8d167cc None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:03.978374 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74137aa3-057f-44c2-8e29-0e53f8d167cc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:03.989111 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74137aa3-057f-44c2-8e29-0e53f8d167cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:29:03.997382 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-74137aa3-057f-44c2-8e29-0e53f8d167cc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:29:03.997382 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:29:03.997382 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:29:03.997382 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:29:03.997382 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:29:03.997382 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:29:03.997382 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:29:03.997382 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:29:03.997382 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:29:03.997382 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:29:03.997382 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:29:03.997382 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:29:03.997382 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:29:03.997382 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:29:03.997382 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:29:03.997382 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:29:03.998526 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:29:03.998526 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:29:03.998526 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:29:03.998526 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:29:03.998526 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:29:03.998526 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:29:03.998526 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:29:03.998526 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:29:03.998526 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:29:03.998526 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:29:03.998526 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:29:03.998526 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( Jul 11 14:29:03.998526 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:29:03.998526 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:29:03.998526 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:29:03.998526 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:29:03.999486 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:29:03.999486 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:29:03.999486 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:29:03.999486 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:29:03.999486 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:29:03.999486 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:29:03.999486 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:29:03.999486 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:29:03.999486 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:29:03.999486 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:29:03.999486 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:29:03.999486 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Jul 11 14:29:03.999486 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 592/1180] 10.222.0.70 () {56 vars in 1096 bytes} [Mon Jul 11 14:29:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:29:04.004687 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44aac493-3dda-4a02-963c-185b719b0b72 None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:04.098323 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:04.105005 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44aac493-3dda-4a02-963c-185b719b0b72 None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:04.141020 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a722d74f-bc8e-46e5-8fb6-15be3baa63ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:04.141693 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a722d74f-bc8e-46e5-8fb6-15be3baa63ba None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:04.141976 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a722d74f-bc8e-46e5-8fb6-15be3baa63ba None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:04.142244 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a722d74f-bc8e-46e5-8fb6-15be3baa63ba None admin] PATH_INFO: `/v3/roles` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:04.142990 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a722d74f-bc8e-46e5-8fb6-15be3baa63ba None admin] RBAC: Adding query filter params (name=admin) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:29:04.143293 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a722d74f-bc8e-46e5-8fb6-15be3baa63ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:04.144704 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a722d74f-bc8e-46e5-8fb6-15be3baa63ba None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:04.153904 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 589/1181] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Jul 11 14:29:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:29:04.159818 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74137aa3-057f-44c2-8e29-0e53f8d167cc None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:04.278329 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74137aa3-057f-44c2-8e29-0e53f8d167cc None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:04.309095 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:04.327210 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89eb5b3-165a-40c6-ad5d-000cbdbda2d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:04.328197 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89eb5b3-165a-40c6-ad5d-000cbdbda2d4 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:04.328506 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89eb5b3-165a-40c6-ad5d-000cbdbda2d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:04.328887 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89eb5b3-165a-40c6-ad5d-000cbdbda2d4 None admin] PATH_INFO: `/v3/users/9deca57db94747d98cc553ae8bc7f68b` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:04.346397 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89eb5b3-165a-40c6-ad5d-000cbdbda2d4 None admin] RBAC: Authorizing `identity:get_user(user_id=9deca57db94747d98cc553ae8bc7f68b)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:04.348659 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89eb5b3-165a-40c6-ad5d-000cbdbda2d4 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:04.350485 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 593/1182] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Jul 11 14:29:04 2022] GET /identity/v3/users/9deca57db94747d98cc553ae8bc7f68b => generated 311 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:29:04.358050 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a722d74f-bc8e-46e5-8fb6-15be3baa63ba None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:04.485850 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a722d74f-bc8e-46e5-8fb6-15be3baa63ba None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:04.523236 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8148fae1-75c3-4aa7-8751-f528fe8c7bce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:04.523890 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8148fae1-75c3-4aa7-8751-f528fe8c7bce None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:04.524170 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8148fae1-75c3-4aa7-8751-f528fe8c7bce None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:04.524468 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8148fae1-75c3-4aa7-8751-f528fe8c7bce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:04.555149 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:04.606676 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8148fae1-75c3-4aa7-8751-f528fe8c7bce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:04.608044 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8148fae1-75c3-4aa7-8751-f528fe8c7bce None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:04.721277 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 590/1183] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Jul 11 14:29:04 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 11 14:29:04.727273 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89eb5b3-165a-40c6-ad5d-000cbdbda2d4 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:04.835406 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89eb5b3-165a-40c6-ad5d-000cbdbda2d4 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:04.874285 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7cfaa6-bfa8-4a6d-9a4b-241760963359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:04.875121 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7cfaa6-bfa8-4a6d-9a4b-241760963359 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:04.875409 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7cfaa6-bfa8-4a6d-9a4b-241760963359 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:04.875727 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7cfaa6-bfa8-4a6d-9a4b-241760963359 None admin] PATH_INFO: `/v3/projects/e2f0c5d3de50453bbb365231d2bb7f23` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:04.876958 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7cfaa6-bfa8-4a6d-9a4b-241760963359 None admin] RBAC: Authorizing `identity:get_project(project_id=e2f0c5d3de50453bbb365231d2bb7f23)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:04.878457 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7cfaa6-bfa8-4a6d-9a4b-241760963359 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:04.880502 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 594/1184] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Jul 11 14:29:04 2022] GET /identity/v3/projects/e2f0c5d3de50453bbb365231d2bb7f23 => generated 361 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:29:04.887689 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8148fae1-75c3-4aa7-8751-f528fe8c7bce None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:04.961863 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:05.019341 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8148fae1-75c3-4aa7-8751-f528fe8c7bce None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:05.055792 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c47c9da-2477-4281-ae69-3fa17bbf4c33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:05.056457 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c47c9da-2477-4281-ae69-3fa17bbf4c33 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:05.056739 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c47c9da-2477-4281-ae69-3fa17bbf4c33 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:05.057862 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c47c9da-2477-4281-ae69-3fa17bbf4c33 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:05.058856 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c47c9da-2477-4281-ae69-3fa17bbf4c33 None admin] RBAC: Adding query filter params (role.id=b46df176b0fe479da63c318db225bed4, scope.project.id=e2f0c5d3de50453bbb365231d2bb7f23, user.id=9deca57db94747d98cc553ae8bc7f68b) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:29:05.059243 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c47c9da-2477-4281-ae69-3fa17bbf4c33 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:05.061030 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c47c9da-2477-4281-ae69-3fa17bbf4c33 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:05.067248 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 591/1185] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Jul 11 14:29:04 2022] GET /identity/v3/role_assignments?user.id=9deca57db94747d98cc553ae8bc7f68b&scope.project.id=e2f0c5d3de50453bbb365231d2bb7f23&role.id=b46df176b0fe479da63c318db225bed4 => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:29:07.223064 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a26ecff-069b-4800-94a1-a16696046a1b None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:07.223598 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a26ecff-069b-4800-94a1-a16696046a1b None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:07.223598 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a26ecff-069b-4800-94a1-a16696046a1b None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:07.225013 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 595/1186] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:29:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:29:07.230300 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994d3021-a704-45e7-a49d-a906c1c56242 None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:07.230719 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994d3021-a704-45e7-a49d-a906c1c56242 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:07.230849 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994d3021-a704-45e7-a49d-a906c1c56242 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:07.247871 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-994d3021-a704-45e7-a49d-a906c1c56242 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:29:07.249087 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-994d3021-a704-45e7-a49d-a906c1c56242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:29:07.314858 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 592/1187] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:29:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 14:29:07.337988 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a26ecff-069b-4800-94a1-a16696046a1b None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:07.393966 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:07.444690 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a26ecff-069b-4800-94a1-a16696046a1b None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:07.478453 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3fe920-5fda-414f-8002-9cf2614aff6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:07.479703 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3fe920-5fda-414f-8002-9cf2614aff6d None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:07.479980 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3fe920-5fda-414f-8002-9cf2614aff6d None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:07.480278 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3fe920-5fda-414f-8002-9cf2614aff6d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:07.490375 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3fe920-5fda-414f-8002-9cf2614aff6d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:29:07.498646 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-8f3fe920-5fda-414f-8002-9cf2614aff6d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:29:07.498646 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:29:07.498646 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:29:07.498646 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:29:07.498646 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:29:07.498646 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:29:07.498646 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:29:07.498646 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:29:07.498646 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:29:07.498646 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:29:07.498646 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:29:07.498646 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:29:07.498646 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:29:07.498646 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:29:07.498646 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:29:07.498646 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:29:07.499728 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:29:07.499728 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:29:07.499728 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:29:07.499728 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:29:07.499728 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:29:07.499728 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:29:07.499728 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:29:07.499728 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:29:07.499728 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:29:07.499728 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:29:07.499728 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:29:07.499728 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( Jul 11 14:29:07.499728 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:29:07.499728 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:29:07.499728 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:29:07.499728 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:29:07.500796 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:29:07.500796 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:29:07.500796 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:29:07.500796 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:29:07.500796 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:29:07.500796 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:29:07.500796 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:29:07.500796 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:29:07.500796 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:29:07.500796 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:29:07.500796 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:29:07.500796 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Jul 11 14:29:07.500796 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 596/1188] 10.222.0.70 () {56 vars in 1096 bytes} [Mon Jul 11 14:29:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:29:07.506269 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994d3021-a704-45e7-a49d-a906c1c56242 None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:07.561124 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:07.609104 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994d3021-a704-45e7-a49d-a906c1c56242 None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:07.644621 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15172be6-08da-41ed-bd68-52d0fd6e3716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:07.645290 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15172be6-08da-41ed-bd68-52d0fd6e3716 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:07.645575 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15172be6-08da-41ed-bd68-52d0fd6e3716 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:07.645854 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15172be6-08da-41ed-bd68-52d0fd6e3716 None admin] PATH_INFO: `/v3/roles` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:07.646599 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15172be6-08da-41ed-bd68-52d0fd6e3716 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:29:07.646907 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15172be6-08da-41ed-bd68-52d0fd6e3716 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:07.648289 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15172be6-08da-41ed-bd68-52d0fd6e3716 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:07.657112 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 593/1189] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Jul 11 14:29:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:29:07.662963 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3fe920-5fda-414f-8002-9cf2614aff6d None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:07.771987 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3fe920-5fda-414f-8002-9cf2614aff6d None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:07.783690 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:07.808867 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905537a7-cdbf-4a59-a733-5afc4129ed58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:07.809751 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905537a7-cdbf-4a59-a733-5afc4129ed58 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:07.810033 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905537a7-cdbf-4a59-a733-5afc4129ed58 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:07.810306 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905537a7-cdbf-4a59-a733-5afc4129ed58 None admin] PATH_INFO: `/v3/users/9deca57db94747d98cc553ae8bc7f68b` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:07.811541 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905537a7-cdbf-4a59-a733-5afc4129ed58 None admin] RBAC: Authorizing `identity:get_user(user_id=9deca57db94747d98cc553ae8bc7f68b)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:07.813009 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905537a7-cdbf-4a59-a733-5afc4129ed58 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:07.814665 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 597/1190] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Jul 11 14:29:07 2022] GET /identity/v3/users/9deca57db94747d98cc553ae8bc7f68b => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:29:07.820981 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15172be6-08da-41ed-bd68-52d0fd6e3716 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:07.940444 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15172be6-08da-41ed-bd68-52d0fd6e3716 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:07.954487 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:07.975435 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014c5bb0-b565-4ec9-ad26-7df71e914c1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:07.976334 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014c5bb0-b565-4ec9-ad26-7df71e914c1c None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:07.976621 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014c5bb0-b565-4ec9-ad26-7df71e914c1c None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:07.976897 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014c5bb0-b565-4ec9-ad26-7df71e914c1c None admin] PATH_INFO: `/v3/projects/e2f0c5d3de50453bbb365231d2bb7f23` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:07.978127 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014c5bb0-b565-4ec9-ad26-7df71e914c1c None admin] RBAC: Authorizing `identity:get_project(project_id=e2f0c5d3de50453bbb365231d2bb7f23)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:07.980138 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014c5bb0-b565-4ec9-ad26-7df71e914c1c None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:07.981897 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 594/1191] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Jul 11 14:29:07 2022] GET /identity/v3/projects/e2f0c5d3de50453bbb365231d2bb7f23 => generated 361 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:29:07.987825 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905537a7-cdbf-4a59-a733-5afc4129ed58 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:08.087824 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905537a7-cdbf-4a59-a733-5afc4129ed58 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:08.121151 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f8bb80-de04-4c4e-b989-3a674eaedfbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:08.122036 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f8bb80-de04-4c4e-b989-3a674eaedfbc None admin] REQUEST_METHOD: `PUT` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:08.122312 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f8bb80-de04-4c4e-b989-3a674eaedfbc None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:08.122581 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f8bb80-de04-4c4e-b989-3a674eaedfbc None admin] PATH_INFO: `/v3/projects/e2f0c5d3de50453bbb365231d2bb7f23/users/9deca57db94747d98cc553ae8bc7f68b/roles/b46df176b0fe479da63c318db225bed4` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:08.124551 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f8bb80-de04-4c4e-b989-3a674eaedfbc None admin] RBAC: Authorizing `identity:create_grant(project_id=e2f0c5d3de50453bbb365231d2bb7f23, user_id=9deca57db94747d98cc553ae8bc7f68b, role_id=b46df176b0fe479da63c318db225bed4)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:08.125981 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f8bb80-de04-4c4e-b989-3a674eaedfbc None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:08.139737 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 598/1192] 10.222.0.70 () {58 vars in 1439 bytes} [Mon Jul 11 14:29:07 2022] PUT /identity/v3/projects/e2f0c5d3de50453bbb365231d2bb7f23/users/9deca57db94747d98cc553ae8bc7f68b/roles/b46df176b0fe479da63c318db225bed4 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:29:10.224928 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b8fcbb-fc3a-4b2d-8c9e-147a9061b4a7 None None] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:10.225485 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b8fcbb-fc3a-4b2d-8c9e-147a9061b4a7 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:10.225485 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b8fcbb-fc3a-4b2d-8c9e-147a9061b4a7 None None] PATH_INFO: `/` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:10.226847 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 595/1193] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:29:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:29:10.232196 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c27b7f-4f08-4404-81c9-e67f0e10185b None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:10.232648 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c27b7f-4f08-4404-81c9-e67f0e10185b None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:10.232773 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c27b7f-4f08-4404-81c9-e67f0e10185b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:10.251096 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-45c27b7f-4f08-4404-81c9-e67f0e10185b None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:29:10.252336 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-45c27b7f-4f08-4404-81c9-e67f0e10185b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:29:10.282606 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:10.323183 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 599/1194] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:29:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:29:10.347007 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b8fcbb-fc3a-4b2d-8c9e-147a9061b4a7 None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:10.450735 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b8fcbb-fc3a-4b2d-8c9e-147a9061b4a7 None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:10.484787 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc6e24d-91ab-470c-aea8-2bc08c0733e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:10.485487 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc6e24d-91ab-470c-aea8-2bc08c0733e1 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:10.485765 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc6e24d-91ab-470c-aea8-2bc08c0733e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:10.486036 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc6e24d-91ab-470c-aea8-2bc08c0733e1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:10.496924 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc6e24d-91ab-470c-aea8-2bc08c0733e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:29:10.504488 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application [None req-edc6e24d-91ab-470c-aea8-2bc08c0733e1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:29:10.504488 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:29:10.504488 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:29:10.504488 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:29:10.504488 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:29:10.504488 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:29:10.504488 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:29:10.504488 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:29:10.504488 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:29:10.504488 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:29:10.504488 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:29:10.504488 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:29:10.504488 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:29:10.504488 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:29:10.504488 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:29:10.504488 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:29:10.505563 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:29:10.505563 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:29:10.505563 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:29:10.505563 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:29:10.505563 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:29:10.505563 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:29:10.505563 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:29:10.505563 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:29:10.505563 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:29:10.505563 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:29:10.505563 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:29:10.505563 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application with Lock( Jul 11 14:29:10.505563 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:29:10.505563 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:29:10.505563 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:29:10.505563 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:29:10.506434 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:29:10.506434 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:29:10.506434 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:29:10.506434 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:29:10.506434 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:29:10.506434 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:29:10.506434 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:29:10.506434 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:29:10.506434 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:29:10.506434 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:29:10.506434 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:29:10.506434 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Jul 11 14:29:10.506434 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 596/1195] 10.222.0.70 () {56 vars in 1096 bytes} [Mon Jul 11 14:29:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:29:10.511954 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c27b7f-4f08-4404-81c9-e67f0e10185b None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:10.616613 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c27b7f-4f08-4404-81c9-e67f0e10185b None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:10.651471 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca492511-7688-4a09-80c4-50e4dcc06e35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:10.652219 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca492511-7688-4a09-80c4-50e4dcc06e35 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:10.652516 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca492511-7688-4a09-80c4-50e4dcc06e35 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:10.652796 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca492511-7688-4a09-80c4-50e4dcc06e35 None admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:10.653547 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca492511-7688-4a09-80c4-50e4dcc06e35 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:29:10.653858 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca492511-7688-4a09-80c4-50e4dcc06e35 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:10.655261 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca492511-7688-4a09-80c4-50e4dcc06e35 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:10.663470 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 600/1196] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Jul 11 14:29:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:29:10.669853 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc6e24d-91ab-470c-aea8-2bc08c0733e1 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:10.712389 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:10.770457 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc6e24d-91ab-470c-aea8-2bc08c0733e1 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:10.804267 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9247bf1a-22d5-4a4a-b917-c722678ce07f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:10.805131 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9247bf1a-22d5-4a4a-b917-c722678ce07f None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:10.805412 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9247bf1a-22d5-4a4a-b917-c722678ce07f None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:10.805685 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9247bf1a-22d5-4a4a-b917-c722678ce07f None admin] PATH_INFO: `/v3/users/9deca57db94747d98cc553ae8bc7f68b` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:10.807354 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9247bf1a-22d5-4a4a-b917-c722678ce07f None admin] RBAC: Authorizing `identity:get_user(user_id=9deca57db94747d98cc553ae8bc7f68b)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:10.808815 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9247bf1a-22d5-4a4a-b917-c722678ce07f None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:10.810424 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 597/1197] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Jul 11 14:29:10 2022] GET /identity/v3/users/9deca57db94747d98cc553ae8bc7f68b => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:29:10.816423 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca492511-7688-4a09-80c4-50e4dcc06e35 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:10.849033 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:10.929972 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca492511-7688-4a09-80c4-50e4dcc06e35 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:10.965195 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5963827-b1c1-442b-9b1f-44f6f2a56942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:10.965845 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5963827-b1c1-442b-9b1f-44f6f2a56942 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:10.966132 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5963827-b1c1-442b-9b1f-44f6f2a56942 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:10.966410 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5963827-b1c1-442b-9b1f-44f6f2a56942 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:11.033545 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5963827-b1c1-442b-9b1f-44f6f2a56942 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:11.034917 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5963827-b1c1-442b-9b1f-44f6f2a56942 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:11.064858 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:11.139736 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 601/1198] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Jul 11 14:29:10 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 11 14:29:11.145734 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9247bf1a-22d5-4a4a-b917-c722678ce07f None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:11.248300 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9247bf1a-22d5-4a4a-b917-c722678ce07f None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:11.258624 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:11.282687 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626dce27-9325-4b52-9b2c-ce5f535346b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:11.283540 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626dce27-9325-4b52-9b2c-ce5f535346b5 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:11.283882 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626dce27-9325-4b52-9b2c-ce5f535346b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:11.284115 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626dce27-9325-4b52-9b2c-ce5f535346b5 None admin] PATH_INFO: `/v3/projects/e2f0c5d3de50453bbb365231d2bb7f23` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:11.285329 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626dce27-9325-4b52-9b2c-ce5f535346b5 None admin] RBAC: Authorizing `identity:get_project(project_id=e2f0c5d3de50453bbb365231d2bb7f23)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:11.286756 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626dce27-9325-4b52-9b2c-ce5f535346b5 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:11.288495 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 598/1199] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Jul 11 14:29:11 2022] GET /identity/v3/projects/e2f0c5d3de50453bbb365231d2bb7f23 => generated 361 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:29:11.295117 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5963827-b1c1-442b-9b1f-44f6f2a56942 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:11.392683 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5963827-b1c1-442b-9b1f-44f6f2a56942 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:11.420992 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:11.427016 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e8391a-74ac-4d86-a3c0-c8bbdfba0053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:11.427663 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e8391a-74ac-4d86-a3c0-c8bbdfba0053 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:11.428214 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e8391a-74ac-4d86-a3c0-c8bbdfba0053 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:11.428498 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e8391a-74ac-4d86-a3c0-c8bbdfba0053 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:11.429318 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e8391a-74ac-4d86-a3c0-c8bbdfba0053 None admin] RBAC: Adding query filter params (role.id=b46df176b0fe479da63c318db225bed4, scope.project.id=e2f0c5d3de50453bbb365231d2bb7f23, user.id=9deca57db94747d98cc553ae8bc7f68b) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:29:11.429626 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e8391a-74ac-4d86-a3c0-c8bbdfba0053 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:11.431052 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e8391a-74ac-4d86-a3c0-c8bbdfba0053 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:11.437109 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 602/1200] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Jul 11 14:29:11 2022] GET /identity/v3/role_assignments?user.id=9deca57db94747d98cc553ae8bc7f68b&scope.project.id=e2f0c5d3de50453bbb365231d2bb7f23&role.id=b46df176b0fe479da63c318db225bed4 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:29:21.278779 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=11 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:21.434398 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=3 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:12.633475 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9d4a78-5b05-4aa6-90a6-fe2c6260c9f1 None None] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:12.634077 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9d4a78-5b05-4aa6-90a6-fe2c6260c9f1 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:12.634077 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9d4a78-5b05-4aa6-90a6-fe2c6260c9f1 None None] PATH_INFO: `/` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:12.635686 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 599/1201] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:30:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:30:12.648252 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1418e6-cbc6-400e-802b-606ad4d0dc6f None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:12.649687 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1418e6-cbc6-400e-802b-606ad4d0dc6f None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:12.650441 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1418e6-cbc6-400e-802b-606ad4d0dc6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:12.672697 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-bd1418e6-cbc6-400e-802b-606ad4d0dc6f None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:30:12.673930 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-bd1418e6-cbc6-400e-802b-606ad4d0dc6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:30:12.795516 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 603/1202] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:30:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 14:30:12.827607 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9d4a78-5b05-4aa6-90a6-fe2c6260c9f1 None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:13.035756 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9d4a78-5b05-4aa6-90a6-fe2c6260c9f1 None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:13.108632 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe84ee16-2d45-40a5-8d48-bab5ada2d19c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:13.110186 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe84ee16-2d45-40a5-8d48-bab5ada2d19c None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:13.110733 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe84ee16-2d45-40a5-8d48-bab5ada2d19c None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:13.111204 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe84ee16-2d45-40a5-8d48-bab5ada2d19c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:13.131533 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe84ee16-2d45-40a5-8d48-bab5ada2d19c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:13.133093 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe84ee16-2d45-40a5-8d48-bab5ada2d19c None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:13.160987 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application [None req-fe84ee16-2d45-40a5-8d48-bab5ada2d19c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:30:13.160987 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:13.160987 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:30:13.160987 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:30:13.160987 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:30:13.160987 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:30:13.160987 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:30:13.160987 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:30:13.160987 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:30:13.160987 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:30:13.160987 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:30:13.160987 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:30:13.160987 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:30:13.160987 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:30:13.160987 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:30:13.162333 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:30:13.162333 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:30:13.162333 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:30:13.162333 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:30:13.162333 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:30:13.162333 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:30:13.162333 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:30:13.162333 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:30:13.162333 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application with Lock( Jul 11 14:30:13.162333 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:30:13.162333 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:30:13.162333 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:30:13.162333 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:30:13.162333 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:30:13.162333 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:30:13.162333 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:30:13.162333 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:30:13.163409 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:30:13.163409 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:30:13.163409 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:30:13.163409 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Jul 11 14:30:13.163668 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 600/1203] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 11 14:30:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:30:13.173425 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1418e6-cbc6-400e-802b-606ad4d0dc6f None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:13.346496 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1418e6-cbc6-400e-802b-606ad4d0dc6f None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:13.406731 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:13.427920 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ce98e4-8299-49b2-bcbb-f6a5c57b544d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:13.429045 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ce98e4-8299-49b2-bcbb-f6a5c57b544d None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:13.429623 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ce98e4-8299-49b2-bcbb-f6a5c57b544d None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:13.430084 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ce98e4-8299-49b2-bcbb-f6a5c57b544d None admin] PATH_INFO: `/v3/domains` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:13.431112 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ce98e4-8299-49b2-bcbb-f6a5c57b544d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:13.431437 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ce98e4-8299-49b2-bcbb-f6a5c57b544d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:13.433009 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ce98e4-8299-49b2-bcbb-f6a5c57b544d None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:13.454510 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 604/1204] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jul 11 14:30:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:13.461990 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe84ee16-2d45-40a5-8d48-bab5ada2d19c None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:13.615939 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:13.720311 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe84ee16-2d45-40a5-8d48-bab5ada2d19c None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:13.777721 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba69383-71b7-4d39-8852-4abd17e449b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:13.778559 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba69383-71b7-4d39-8852-4abd17e449b3 None admin] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:13.778912 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba69383-71b7-4d39-8852-4abd17e449b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:13.779186 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba69383-71b7-4d39-8852-4abd17e449b3 None admin] PATH_INFO: `/v3/users` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:13.780093 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba69383-71b7-4d39-8852-4abd17e449b3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:13.781980 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba69383-71b7-4d39-8852-4abd17e449b3 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:13.814031 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 601/1205] 10.222.0.70 () {60 vars in 1132 bytes} [Mon Jul 11 14:30:13 2022] POST /identity/v3/users => generated 251 bytes in 353 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:30:16.286734 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e57340-908e-40a9-b49d-1df4f1711618 None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:16.286734 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e57340-908e-40a9-b49d-1df4f1711618 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:16.286734 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e57340-908e-40a9-b49d-1df4f1711618 None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:16.288308 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 605/1206] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:30:16 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:30:16.295322 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4e744b-bf43-4060-ad57-48dd5ff4e5ca None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:16.296694 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4e744b-bf43-4060-ad57-48dd5ff4e5ca None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:16.297213 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4e744b-bf43-4060-ad57-48dd5ff4e5ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:16.321196 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-df4e744b-bf43-4060-ad57-48dd5ff4e5ca None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:30:16.322765 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-df4e744b-bf43-4060-ad57-48dd5ff4e5ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:30:16.440233 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 602/1207] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:30:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:30:16.472241 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e57340-908e-40a9-b49d-1df4f1711618 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:16.665401 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e57340-908e-40a9-b49d-1df4f1711618 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:16.730989 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674ca912-dd1e-407d-a8fe-e0b412d575d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:16.733176 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674ca912-dd1e-407d-a8fe-e0b412d575d0 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:16.733677 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674ca912-dd1e-407d-a8fe-e0b412d575d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:16.733789 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674ca912-dd1e-407d-a8fe-e0b412d575d0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:16.748339 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674ca912-dd1e-407d-a8fe-e0b412d575d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:30:16.759636 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-674ca912-dd1e-407d-a8fe-e0b412d575d0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:30:16.759636 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:16.759636 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:30:16.759636 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:30:16.759636 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:30:16.759636 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:30:16.759636 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:30:16.759636 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:30:16.759636 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:30:16.759636 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:30:16.759636 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:30:16.759636 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:30:16.759636 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:30:16.759636 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:30:16.759636 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:30:16.759636 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:30:16.760927 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:30:16.760927 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:30:16.760927 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:30:16.760927 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:30:16.760927 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:30:16.760927 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:30:16.760927 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:30:16.760927 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:30:16.760927 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:30:16.760927 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:30:16.760927 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:30:16.760927 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( Jul 11 14:30:16.760927 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:30:16.760927 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:30:16.760927 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:30:16.760927 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:30:16.761773 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:30:16.761773 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:30:16.761773 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:30:16.761773 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:30:16.761773 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:30:16.761773 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:30:16.761773 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:30:16.761773 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:30:16.761773 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:30:16.761773 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:30:16.761773 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:30:16.761773 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Jul 11 14:30:16.761773 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 606/1208] 10.222.0.70 () {56 vars in 1102 bytes} [Mon Jul 11 14:30:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:30:16.769108 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4e744b-bf43-4060-ad57-48dd5ff4e5ca None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:16.820172 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:16.926155 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4e744b-bf43-4060-ad57-48dd5ff4e5ca None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:16.977693 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdd7675-79f3-4ea0-87b1-21aa15df603c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:16.978585 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdd7675-79f3-4ea0-87b1-21aa15df603c None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:16.978876 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdd7675-79f3-4ea0-87b1-21aa15df603c None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:16.979234 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdd7675-79f3-4ea0-87b1-21aa15df603c None admin] PATH_INFO: `/v3/roles` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:16.980279 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdd7675-79f3-4ea0-87b1-21aa15df603c None admin] RBAC: Adding query filter params (name=service) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:16.980797 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdd7675-79f3-4ea0-87b1-21aa15df603c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:16.982606 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdd7675-79f3-4ea0-87b1-21aa15df603c None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:16.999241 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 603/1209] 10.222.0.70 () {56 vars in 1103 bytes} [Mon Jul 11 14:30:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:17.006104 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674ca912-dd1e-407d-a8fe-e0b412d575d0 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:17.068441 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:17.143615 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674ca912-dd1e-407d-a8fe-e0b412d575d0 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:17.207319 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087fe2f5-f0c1-46a0-8775-659cf4af8b85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:17.207319 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087fe2f5-f0c1-46a0-8775-659cf4af8b85 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:17.207319 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087fe2f5-f0c1-46a0-8775-659cf4af8b85 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:17.207880 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087fe2f5-f0c1-46a0-8775-659cf4af8b85 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:17.221766 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087fe2f5-f0c1-46a0-8775-659cf4af8b85 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:17.223879 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087fe2f5-f0c1-46a0-8775-659cf4af8b85 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:17.244459 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-087fe2f5-f0c1-46a0-8775-659cf4af8b85 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:30:17.244459 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:17.244459 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:30:17.244459 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:30:17.244459 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:30:17.244459 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:30:17.244459 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:30:17.244459 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:30:17.244459 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:30:17.244459 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:30:17.244459 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:30:17.244459 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:30:17.244459 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:30:17.244459 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:30:17.244459 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:30:17.245460 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:30:17.245460 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:30:17.245460 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:30:17.245460 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:30:17.245460 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:30:17.245460 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:30:17.245460 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:30:17.245460 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:30:17.245460 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( Jul 11 14:30:17.245460 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:30:17.245460 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:30:17.245460 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:30:17.245460 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:30:17.245460 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:30:17.245460 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:30:17.245460 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:30:17.245460 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:30:17.246365 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:30:17.246365 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:30:17.246365 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:30:17.246365 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Jul 11 14:30:17.246365 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 607/1210] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 11 14:30:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:30:17.253977 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdd7675-79f3-4ea0-87b1-21aa15df603c None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:17.417034 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:17.422300 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdd7675-79f3-4ea0-87b1-21aa15df603c None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:17.474850 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7800a905-0545-402a-a7bf-d2242a158ba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:17.475763 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7800a905-0545-402a-a7bf-d2242a158ba1 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:17.476179 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7800a905-0545-402a-a7bf-d2242a158ba1 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:17.476591 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7800a905-0545-402a-a7bf-d2242a158ba1 None admin] PATH_INFO: `/v3/domains` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:17.477401 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7800a905-0545-402a-a7bf-d2242a158ba1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:17.477775 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7800a905-0545-402a-a7bf-d2242a158ba1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:17.479445 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7800a905-0545-402a-a7bf-d2242a158ba1 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:17.500533 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 604/1211] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jul 11 14:30:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:17.505471 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087fe2f5-f0c1-46a0-8775-659cf4af8b85 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:17.658749 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087fe2f5-f0c1-46a0-8775-659cf4af8b85 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:17.660540 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:17.719788 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2b984f-50af-46a6-a83d-034bcc00c6ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:17.721220 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2b984f-50af-46a6-a83d-034bcc00c6ce None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:17.721702 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2b984f-50af-46a6-a83d-034bcc00c6ce None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:17.722162 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2b984f-50af-46a6-a83d-034bcc00c6ce None admin] PATH_INFO: `/v3/users/placement` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:17.736862 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2b984f-50af-46a6-a83d-034bcc00c6ce None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:17.740041 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2b984f-50af-46a6-a83d-034bcc00c6ce None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:17.761862 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-0f2b984f-50af-46a6-a83d-034bcc00c6ce None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 11 14:30:17.761862 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:17.761862 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:30:17.761862 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:30:17.761862 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:30:17.761862 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:30:17.761862 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:30:17.761862 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:30:17.761862 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:30:17.761862 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:30:17.761862 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:30:17.761862 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:30:17.761862 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 14:30:17.761862 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 14:30:17.761862 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 14:30:17.761862 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 14:30:17.762975 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:30:17.762975 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:30:17.762975 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 14:30:17.762975 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:30:17.762975 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 14:30:17.762975 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:30:17.762975 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:30:17.762975 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:30:17.762975 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:30:17.762975 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:30:17.762975 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:30:17.762975 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( Jul 11 14:30:17.762975 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:30:17.762975 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:30:17.762975 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:30:17.762975 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:30:17.762975 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:30:17.762975 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:30:17.763946 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:30:17.763946 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:30:17.763946 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 14:30:17.763946 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 14:30:17.763946 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 14:30:17.763946 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 14:30:17.763946 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 14:30:17.763946 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 14:30:17.763946 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 11 14:30:17.763946 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Jul 11 14:30:17.763946 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 608/1212] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 11 14:30:17 2022] GET /identity/v3/users/placement => generated 87 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:30:17.769924 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7800a905-0545-402a-a7bf-d2242a158ba1 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:17.930787 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7800a905-0545-402a-a7bf-d2242a158ba1 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:17.974951 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98bc231-eb5b-40a7-9904-eca6aa5fd871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:17.975778 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98bc231-eb5b-40a7-9904-eca6aa5fd871 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:17.976170 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98bc231-eb5b-40a7-9904-eca6aa5fd871 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:17.976616 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98bc231-eb5b-40a7-9904-eca6aa5fd871 None admin] PATH_INFO: `/v3/users` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:17.977638 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98bc231-eb5b-40a7-9904-eca6aa5fd871 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:17.978077 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98bc231-eb5b-40a7-9904-eca6aa5fd871 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:17.979763 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98bc231-eb5b-40a7-9904-eca6aa5fd871 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:18.002196 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 605/1213] 10.222.0.70 () {56 vars in 1143 bytes} [Mon Jul 11 14:30:17 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:18.007565 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2b984f-50af-46a6-a83d-034bcc00c6ce None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:18.131099 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2b984f-50af-46a6-a83d-034bcc00c6ce None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:18.176983 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44be765b-fc57-4f2a-9ce4-49702765dc55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:18.177960 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44be765b-fc57-4f2a-9ce4-49702765dc55 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:18.178444 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44be765b-fc57-4f2a-9ce4-49702765dc55 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:18.178751 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44be765b-fc57-4f2a-9ce4-49702765dc55 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:18.227222 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:18.281710 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44be765b-fc57-4f2a-9ce4-49702765dc55 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:18.283120 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44be765b-fc57-4f2a-9ce4-49702765dc55 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:18.427058 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 609/1214] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Jul 11 14:30:18 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 11 14:30:18.435550 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98bc231-eb5b-40a7-9904-eca6aa5fd871 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:18.460128 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:18.580569 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98bc231-eb5b-40a7-9904-eca6aa5fd871 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:18.627408 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0647d68-3c2d-42d6-a69e-b5c620be6010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:18.628822 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0647d68-3c2d-42d6-a69e-b5c620be6010 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:18.630008 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0647d68-3c2d-42d6-a69e-b5c620be6010 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:18.631096 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0647d68-3c2d-42d6-a69e-b5c620be6010 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:18.645176 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0647d68-3c2d-42d6-a69e-b5c620be6010 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:18.648396 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0647d68-3c2d-42d6-a69e-b5c620be6010 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:18.677040 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application [None req-b0647d68-3c2d-42d6-a69e-b5c620be6010 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:30:18.677040 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:18.677040 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:30:18.677040 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:30:18.677040 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:30:18.677040 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:30:18.677040 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:30:18.677040 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:30:18.677040 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:30:18.677040 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:30:18.677040 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:30:18.677040 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:30:18.677040 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:30:18.677040 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:30:18.677040 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:30:18.678372 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:30:18.678372 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:30:18.678372 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:30:18.678372 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:30:18.678372 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:30:18.678372 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:30:18.678372 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:30:18.678372 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:30:18.678372 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application with Lock( Jul 11 14:30:18.678372 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:30:18.678372 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:30:18.678372 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:30:18.678372 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:30:18.678372 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:30:18.678372 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:30:18.678372 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:30:18.678372 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:30:18.679537 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:30:18.679537 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:30:18.679537 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:30:18.679537 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Jul 11 14:30:18.680321 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 606/1215] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 11 14:30:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:30:18.686796 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44be765b-fc57-4f2a-9ce4-49702765dc55 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:18.780620 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:18.841041 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44be765b-fc57-4f2a-9ce4-49702765dc55 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:18.894988 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f659551a-5482-45b3-b7a8-6f0740a30cf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:18.895833 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f659551a-5482-45b3-b7a8-6f0740a30cf7 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:18.896322 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f659551a-5482-45b3-b7a8-6f0740a30cf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:18.896756 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f659551a-5482-45b3-b7a8-6f0740a30cf7 None admin] PATH_INFO: `/v3/domains` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:18.897858 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f659551a-5482-45b3-b7a8-6f0740a30cf7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:18.898347 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f659551a-5482-45b3-b7a8-6f0740a30cf7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:18.903379 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f659551a-5482-45b3-b7a8-6f0740a30cf7 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:18.928424 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 610/1216] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jul 11 14:30:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:30:18.934766 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0647d68-3c2d-42d6-a69e-b5c620be6010 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:19.035377 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:19.074791 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0647d68-3c2d-42d6-a69e-b5c620be6010 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:19.119261 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef1e496-cde0-4338-9bc3-1bd499398e9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:19.119668 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef1e496-cde0-4338-9bc3-1bd499398e9b None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:19.120008 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef1e496-cde0-4338-9bc3-1bd499398e9b None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:19.120462 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef1e496-cde0-4338-9bc3-1bd499398e9b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:19.129121 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef1e496-cde0-4338-9bc3-1bd499398e9b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:19.131098 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef1e496-cde0-4338-9bc3-1bd499398e9b None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:19.147867 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application [None req-6ef1e496-cde0-4338-9bc3-1bd499398e9b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:30:19.147867 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:19.147867 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:30:19.147867 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:30:19.147867 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:30:19.147867 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:30:19.147867 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:30:19.147867 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:30:19.147867 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:30:19.147867 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:30:19.147867 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:30:19.147867 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:30:19.147867 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 14:30:19.147867 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 14:30:19.147867 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 14:30:19.149202 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 14:30:19.149202 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:30:19.149202 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:30:19.149202 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:30:19.149202 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:30:19.149202 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:30:19.149202 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:30:19.149202 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:30:19.149202 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application with Lock( Jul 11 14:30:19.149202 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:30:19.149202 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:30:19.149202 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:30:19.149202 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:30:19.149202 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:30:19.149202 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:30:19.149202 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:30:19.149202 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:30:19.150375 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 14:30:19.150375 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 14:30:19.150375 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 14:30:19.150375 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 14:30:19.150375 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 14:30:19.150375 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 14:30:19.150375 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:30:19.150375 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Jul 11 14:30:19.156245 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 607/1217] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Jul 11 14:30:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:30:19.158588 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f659551a-5482-45b3-b7a8-6f0740a30cf7 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:19.293023 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f659551a-5482-45b3-b7a8-6f0740a30cf7 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:19.326958 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:19.346319 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4691660b-bc12-4ab6-8dff-d77b0971e806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:19.346319 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4691660b-bc12-4ab6-8dff-d77b0971e806 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:19.346319 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4691660b-bc12-4ab6-8dff-d77b0971e806 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:19.346698 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4691660b-bc12-4ab6-8dff-d77b0971e806 None admin] PATH_INFO: `/v3/projects` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:19.347445 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4691660b-bc12-4ab6-8dff-d77b0971e806 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:19.347810 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4691660b-bc12-4ab6-8dff-d77b0971e806 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:19.350525 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4691660b-bc12-4ab6-8dff-d77b0971e806 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:19.371106 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 611/1218] 10.222.0.70 () {56 vars in 1148 bytes} [Mon Jul 11 14:30:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:19.378504 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef1e496-cde0-4338-9bc3-1bd499398e9b None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:19.531945 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef1e496-cde0-4338-9bc3-1bd499398e9b None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:19.572419 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:19.584004 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203a59a4-8c62-4dbf-8a2a-9177244f69a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:19.585057 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203a59a4-8c62-4dbf-8a2a-9177244f69a9 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:19.585351 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203a59a4-8c62-4dbf-8a2a-9177244f69a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:19.585861 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203a59a4-8c62-4dbf-8a2a-9177244f69a9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:19.587189 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203a59a4-8c62-4dbf-8a2a-9177244f69a9 None admin] RBAC: Adding query filter params (role.id=c766eda9743248fa87df72ec905d271e, scope.project.id=ccd34295bf7b435a96b37487c8e89fc3, user.id=4bf25c7951dc4182996335ca1f0e56ce) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:19.587938 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203a59a4-8c62-4dbf-8a2a-9177244f69a9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:19.590047 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203a59a4-8c62-4dbf-8a2a-9177244f69a9 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:19.597778 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 608/1219] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Jul 11 14:30:19 2022] GET /identity/v3/role_assignments?user.id=4bf25c7951dc4182996335ca1f0e56ce&scope.project.id=ccd34295bf7b435a96b37487c8e89fc3&role.id=c766eda9743248fa87df72ec905d271e => generated 259 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:22.066392 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abefdea-7413-4b7a-a582-5762d4413a8d None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:22.067629 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abefdea-7413-4b7a-a582-5762d4413a8d None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:22.067629 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abefdea-7413-4b7a-a582-5762d4413a8d None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:22.068641 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 612/1220] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:30:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:30:22.074595 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8186de-f46b-4ba2-b39c-76225e91c325 None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:22.075051 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8186de-f46b-4ba2-b39c-76225e91c325 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:22.075213 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8186de-f46b-4ba2-b39c-76225e91c325 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:22.095357 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-2c8186de-f46b-4ba2-b39c-76225e91c325 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:30:22.096607 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-2c8186de-f46b-4ba2-b39c-76225e91c325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:30:22.172890 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 609/1221] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:30:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:30:22.196623 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abefdea-7413-4b7a-a582-5762d4413a8d None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:22.324304 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abefdea-7413-4b7a-a582-5762d4413a8d None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:22.370450 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e81139-f478-419b-b046-4c8ba55a90e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:22.371435 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e81139-f478-419b-b046-4c8ba55a90e5 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:22.371938 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e81139-f478-419b-b046-4c8ba55a90e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:22.372100 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e81139-f478-419b-b046-4c8ba55a90e5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:22.387989 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e81139-f478-419b-b046-4c8ba55a90e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:30:22.397479 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-a2e81139-f478-419b-b046-4c8ba55a90e5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:30:22.397479 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:22.397479 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:30:22.397479 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:30:22.397479 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:30:22.397479 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:30:22.397479 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:30:22.397479 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:30:22.397479 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:30:22.397479 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:30:22.397479 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:30:22.397479 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:30:22.397479 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:30:22.397479 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:30:22.397479 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:30:22.397479 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:30:22.398674 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:30:22.398674 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:30:22.398674 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:30:22.398674 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:30:22.398674 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:30:22.398674 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:30:22.398674 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:30:22.398674 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:30:22.398674 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:30:22.398674 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:30:22.398674 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:30:22.398674 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( Jul 11 14:30:22.398674 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:30:22.398674 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:30:22.398674 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:30:22.398674 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:30:22.399746 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:30:22.399746 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:30:22.399746 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:30:22.399746 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:30:22.399746 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:30:22.399746 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:30:22.399746 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:30:22.399746 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:30:22.399746 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:30:22.399746 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:30:22.399746 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:30:22.399746 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Jul 11 14:30:22.399746 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 613/1222] 10.222.0.70 () {56 vars in 1102 bytes} [Mon Jul 11 14:30:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:30:22.405241 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8186de-f46b-4ba2-b39c-76225e91c325 None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:22.518993 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8186de-f46b-4ba2-b39c-76225e91c325 None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:22.546566 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:22.559215 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f51979-908e-4f46-92af-e512f47eba54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:22.560001 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f51979-908e-4f46-92af-e512f47eba54 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:22.560338 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f51979-908e-4f46-92af-e512f47eba54 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:22.560634 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f51979-908e-4f46-92af-e512f47eba54 None admin] PATH_INFO: `/v3/roles` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:22.561577 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f51979-908e-4f46-92af-e512f47eba54 None admin] RBAC: Adding query filter params (name=service) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:22.561907 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f51979-908e-4f46-92af-e512f47eba54 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:22.563449 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f51979-908e-4f46-92af-e512f47eba54 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:22.574122 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 610/1223] 10.222.0.70 () {56 vars in 1103 bytes} [Mon Jul 11 14:30:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:30:22.579553 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e81139-f478-419b-b046-4c8ba55a90e5 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:22.633147 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:22.703383 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e81139-f478-419b-b046-4c8ba55a90e5 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:22.750142 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19866533-9f9e-4a11-af0d-fc1be3ba308f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:22.751339 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19866533-9f9e-4a11-af0d-fc1be3ba308f None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:22.751722 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19866533-9f9e-4a11-af0d-fc1be3ba308f None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:22.752063 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19866533-9f9e-4a11-af0d-fc1be3ba308f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:22.765592 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19866533-9f9e-4a11-af0d-fc1be3ba308f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:22.767709 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19866533-9f9e-4a11-af0d-fc1be3ba308f None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:22.793926 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-19866533-9f9e-4a11-af0d-fc1be3ba308f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:30:22.793926 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:22.793926 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:30:22.793926 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:30:22.793926 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:30:22.793926 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:30:22.793926 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:30:22.793926 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:30:22.793926 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:30:22.793926 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:30:22.793926 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:30:22.793926 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:30:22.793926 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:30:22.793926 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:30:22.793926 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:30:22.796880 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:30:22.796880 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:30:22.796880 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:30:22.796880 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:30:22.796880 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:30:22.796880 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:30:22.796880 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:30:22.796880 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:30:22.796880 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( Jul 11 14:30:22.796880 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:30:22.796880 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:30:22.796880 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:30:22.796880 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:30:22.796880 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:30:22.796880 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:30:22.796880 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:30:22.796880 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:30:22.797808 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:30:22.797808 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:30:22.797808 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:30:22.797808 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Jul 11 14:30:22.797808 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 614/1224] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 11 14:30:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:30:22.804908 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f51979-908e-4f46-92af-e512f47eba54 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:22.948749 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f51979-908e-4f46-92af-e512f47eba54 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:22.993252 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded09515-3ff9-407f-a3d5-c0a2cfc920bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:22.993930 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded09515-3ff9-407f-a3d5-c0a2cfc920bb None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:22.994236 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded09515-3ff9-407f-a3d5-c0a2cfc920bb None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:22.994509 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded09515-3ff9-407f-a3d5-c0a2cfc920bb None admin] PATH_INFO: `/v3/domains` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:22.995267 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded09515-3ff9-407f-a3d5-c0a2cfc920bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:22.995600 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded09515-3ff9-407f-a3d5-c0a2cfc920bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:22.997011 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded09515-3ff9-407f-a3d5-c0a2cfc920bb None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:23.011026 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 611/1225] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jul 11 14:30:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:23.016892 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19866533-9f9e-4a11-af0d-fc1be3ba308f None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:23.141104 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:23.151299 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19866533-9f9e-4a11-af0d-fc1be3ba308f None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:23.190951 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33bc07f-a67d-4737-ae8d-0baec5f2c014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:23.192309 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33bc07f-a67d-4737-ae8d-0baec5f2c014 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:23.192655 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33bc07f-a67d-4737-ae8d-0baec5f2c014 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:23.192936 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33bc07f-a67d-4737-ae8d-0baec5f2c014 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:23.201704 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33bc07f-a67d-4737-ae8d-0baec5f2c014 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:23.203053 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33bc07f-a67d-4737-ae8d-0baec5f2c014 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:23.221085 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-d33bc07f-a67d-4737-ae8d-0baec5f2c014 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 11 14:30:23.221085 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:23.221085 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:30:23.221085 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:30:23.221085 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:30:23.221085 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:30:23.221085 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:30:23.221085 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:30:23.221085 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:30:23.221085 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:30:23.221085 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:30:23.221085 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:30:23.221085 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 14:30:23.221085 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 14:30:23.221085 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 14:30:23.221085 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 14:30:23.222461 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:30:23.222461 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:30:23.222461 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 14:30:23.222461 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:30:23.222461 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 14:30:23.222461 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:30:23.222461 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:30:23.222461 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:30:23.222461 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:30:23.222461 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:30:23.222461 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:30:23.222461 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( Jul 11 14:30:23.222461 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:30:23.222461 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:30:23.222461 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:30:23.222461 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:30:23.222461 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:30:23.222461 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:30:23.224660 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:30:23.224660 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:30:23.224660 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 14:30:23.224660 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 14:30:23.224660 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 14:30:23.224660 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 14:30:23.224660 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 14:30:23.224660 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 14:30:23.224660 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 11 14:30:23.224660 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Jul 11 14:30:23.227282 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 615/1226] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 11 14:30:23 2022] GET /identity/v3/users/placement => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:30:23.228534 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded09515-3ff9-407f-a3d5-c0a2cfc920bb None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:23.287814 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:23.356602 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded09515-3ff9-407f-a3d5-c0a2cfc920bb None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:23.414901 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafbba56-b58d-4a45-8ffa-0c35deeca006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:23.415704 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafbba56-b58d-4a45-8ffa-0c35deeca006 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:23.415995 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafbba56-b58d-4a45-8ffa-0c35deeca006 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:23.416450 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafbba56-b58d-4a45-8ffa-0c35deeca006 None admin] PATH_INFO: `/v3/users` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:23.417514 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafbba56-b58d-4a45-8ffa-0c35deeca006 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:23.417821 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafbba56-b58d-4a45-8ffa-0c35deeca006 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:23.419598 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafbba56-b58d-4a45-8ffa-0c35deeca006 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:23.455377 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 612/1227] 10.222.0.70 () {56 vars in 1143 bytes} [Mon Jul 11 14:30:23 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:23.463717 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33bc07f-a67d-4737-ae8d-0baec5f2c014 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:23.603584 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33bc07f-a67d-4737-ae8d-0baec5f2c014 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:23.649173 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795f2340-025b-4d90-89f9-282c3f690789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:23.650893 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795f2340-025b-4d90-89f9-282c3f690789 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:23.651314 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795f2340-025b-4d90-89f9-282c3f690789 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:23.651751 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795f2340-025b-4d90-89f9-282c3f690789 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:23.672852 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795f2340-025b-4d90-89f9-282c3f690789 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:23.674558 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795f2340-025b-4d90-89f9-282c3f690789 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:23.699076 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-795f2340-025b-4d90-89f9-282c3f690789 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:30:23.699076 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:23.699076 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:30:23.699076 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:30:23.699076 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:30:23.699076 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:30:23.699076 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:30:23.699076 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:30:23.699076 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:30:23.699076 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:30:23.699076 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:30:23.699076 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:30:23.699076 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:30:23.699076 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:30:23.699076 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:30:23.700243 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:30:23.700243 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:30:23.700243 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:30:23.700243 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:30:23.700243 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:30:23.700243 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:30:23.700243 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:30:23.700243 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:30:23.700243 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( Jul 11 14:30:23.700243 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:30:23.700243 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:30:23.700243 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:30:23.700243 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:30:23.700243 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:30:23.700243 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:30:23.700243 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:30:23.700243 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:30:23.701154 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:30:23.701154 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:30:23.701154 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:30:23.701154 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Jul 11 14:30:23.701154 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 616/1228] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 11 14:30:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:30:23.709419 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafbba56-b58d-4a45-8ffa-0c35deeca006 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:23.847966 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafbba56-b58d-4a45-8ffa-0c35deeca006 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:23.852890 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:23.904471 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fab536-f4e1-4faa-8f3b-245c37896eff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:23.905193 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fab536-f4e1-4faa-8f3b-245c37896eff None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:23.905474 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fab536-f4e1-4faa-8f3b-245c37896eff None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:23.905795 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fab536-f4e1-4faa-8f3b-245c37896eff None admin] PATH_INFO: `/v3/domains` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:23.906734 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fab536-f4e1-4faa-8f3b-245c37896eff None admin] RBAC: Adding query filter params (name=Default) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:23.907106 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fab536-f4e1-4faa-8f3b-245c37896eff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:23.908684 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fab536-f4e1-4faa-8f3b-245c37896eff None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:23.931854 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 613/1229] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jul 11 14:30:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:23.938333 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795f2340-025b-4d90-89f9-282c3f690789 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:23.949656 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:24.060369 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795f2340-025b-4d90-89f9-282c3f690789 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:24.097262 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f3336e-3d22-4b9d-b1fa-280bf48e45f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:24.098619 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f3336e-3d22-4b9d-b1fa-280bf48e45f6 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:24.098901 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f3336e-3d22-4b9d-b1fa-280bf48e45f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:24.099255 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f3336e-3d22-4b9d-b1fa-280bf48e45f6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:24.106980 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f3336e-3d22-4b9d-b1fa-280bf48e45f6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:24.108584 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f3336e-3d22-4b9d-b1fa-280bf48e45f6 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:24.124826 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-91f3336e-3d22-4b9d-b1fa-280bf48e45f6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:30:24.124826 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:24.124826 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:30:24.124826 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:30:24.124826 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:30:24.124826 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:30:24.124826 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:30:24.124826 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:30:24.124826 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:30:24.124826 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:30:24.124826 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:30:24.124826 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:30:24.124826 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 14:30:24.124826 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 14:30:24.124826 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 14:30:24.125853 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 14:30:24.125853 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:30:24.125853 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:30:24.125853 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:30:24.125853 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:30:24.125853 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:30:24.125853 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:30:24.125853 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:30:24.125853 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( Jul 11 14:30:24.125853 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:30:24.125853 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:30:24.125853 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:30:24.125853 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:30:24.125853 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:30:24.125853 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:30:24.125853 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:30:24.125853 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:30:24.126813 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 14:30:24.126813 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 14:30:24.126813 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 14:30:24.126813 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 14:30:24.126813 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 14:30:24.126813 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 14:30:24.126813 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:30:24.126813 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Jul 11 14:30:24.126813 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 617/1230] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Jul 11 14:30:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:30:24.133905 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fab536-f4e1-4faa-8f3b-245c37896eff None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:24.282202 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fab536-f4e1-4faa-8f3b-245c37896eff None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:24.323955 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bd7eef-16c7-4926-b71d-55ddfb9ad260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:24.324642 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bd7eef-16c7-4926-b71d-55ddfb9ad260 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:24.324932 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bd7eef-16c7-4926-b71d-55ddfb9ad260 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:24.325206 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bd7eef-16c7-4926-b71d-55ddfb9ad260 None admin] PATH_INFO: `/v3/projects` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:24.326243 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bd7eef-16c7-4926-b71d-55ddfb9ad260 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:24.326599 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bd7eef-16c7-4926-b71d-55ddfb9ad260 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:24.328285 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bd7eef-16c7-4926-b71d-55ddfb9ad260 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:24.343273 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 614/1231] 10.222.0.70 () {56 vars in 1148 bytes} [Mon Jul 11 14:30:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:24.349905 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f3336e-3d22-4b9d-b1fa-280bf48e45f6 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:24.446812 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:24.497069 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f3336e-3d22-4b9d-b1fa-280bf48e45f6 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:24.541686 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53e1c19-ba45-4473-b115-df88491acb48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:24.542581 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53e1c19-ba45-4473-b115-df88491acb48 None admin] REQUEST_METHOD: `PUT` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:24.542857 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53e1c19-ba45-4473-b115-df88491acb48 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:24.543127 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53e1c19-ba45-4473-b115-df88491acb48 None admin] PATH_INFO: `/v3/projects/ccd34295bf7b435a96b37487c8e89fc3/users/4bf25c7951dc4182996335ca1f0e56ce/roles/c766eda9743248fa87df72ec905d271e` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:24.561659 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53e1c19-ba45-4473-b115-df88491acb48 None admin] RBAC: Authorizing `identity:create_grant(project_id=ccd34295bf7b435a96b37487c8e89fc3, user_id=4bf25c7951dc4182996335ca1f0e56ce, role_id=c766eda9743248fa87df72ec905d271e)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:24.564471 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53e1c19-ba45-4473-b115-df88491acb48 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:24.583106 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 618/1232] 10.222.0.70 () {58 vars in 1439 bytes} [Mon Jul 11 14:30:24 2022] PUT /identity/v3/projects/ccd34295bf7b435a96b37487c8e89fc3/users/4bf25c7951dc4182996335ca1f0e56ce/roles/c766eda9743248fa87df72ec905d271e => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:30:27.026693 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377a4257-fd86-4a98-b324-e58c58e90ed8 None None] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:27.027326 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377a4257-fd86-4a98-b324-e58c58e90ed8 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:27.027326 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377a4257-fd86-4a98-b324-e58c58e90ed8 None None] PATH_INFO: `/` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:27.028982 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 615/1233] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:30:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:30:27.038133 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635dca13-471c-4188-908f-38d267fe9237 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:27.038732 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635dca13-471c-4188-908f-38d267fe9237 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:27.039016 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635dca13-471c-4188-908f-38d267fe9237 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:27.057583 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-635dca13-471c-4188-908f-38d267fe9237 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:30:27.058955 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-635dca13-471c-4188-908f-38d267fe9237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:30:27.135845 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 619/1234] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:30:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:30:27.162512 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377a4257-fd86-4a98-b324-e58c58e90ed8 None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:27.195574 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:27.280139 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377a4257-fd86-4a98-b324-e58c58e90ed8 None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:27.323344 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc9c4d8-1655-4265-8779-2a12893c4f52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:27.324196 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc9c4d8-1655-4265-8779-2a12893c4f52 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:27.324536 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc9c4d8-1655-4265-8779-2a12893c4f52 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:27.324845 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc9c4d8-1655-4265-8779-2a12893c4f52 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:27.337173 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc9c4d8-1655-4265-8779-2a12893c4f52 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:30:27.345864 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application [None req-5cc9c4d8-1655-4265-8779-2a12893c4f52 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:30:27.345864 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:27.345864 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:30:27.345864 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:30:27.345864 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:30:27.345864 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:30:27.345864 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:30:27.345864 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:30:27.345864 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:30:27.345864 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:30:27.345864 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:30:27.345864 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:30:27.345864 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:30:27.345864 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:30:27.345864 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:30:27.345864 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:30:27.347094 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:30:27.347094 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:30:27.347094 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:30:27.347094 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:30:27.347094 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:30:27.347094 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:30:27.347094 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:30:27.347094 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:30:27.347094 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:30:27.347094 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:30:27.347094 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:30:27.347094 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application with Lock( Jul 11 14:30:27.347094 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:30:27.347094 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:30:27.347094 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:30:27.347094 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:30:27.348762 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:30:27.348762 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:30:27.348762 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:30:27.348762 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:30:27.348762 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:30:27.348762 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:30:27.348762 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:30:27.348762 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:30:27.348762 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:30:27.348762 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:30:27.348762 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:30:27.348762 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Jul 11 14:30:27.354007 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 616/1235] 10.222.0.70 () {56 vars in 1102 bytes} [Mon Jul 11 14:30:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:30:27.358658 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635dca13-471c-4188-908f-38d267fe9237 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:27.416005 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:27.474460 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635dca13-471c-4188-908f-38d267fe9237 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:27.516235 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b67f84b-7759-4d50-9513-d168f416184f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:27.517131 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b67f84b-7759-4d50-9513-d168f416184f None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:27.517488 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b67f84b-7759-4d50-9513-d168f416184f None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:27.517882 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b67f84b-7759-4d50-9513-d168f416184f None admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:27.518909 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b67f84b-7759-4d50-9513-d168f416184f None admin] RBAC: Adding query filter params (name=service) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:27.519269 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b67f84b-7759-4d50-9513-d168f416184f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:27.520686 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b67f84b-7759-4d50-9513-d168f416184f None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:27.529205 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 620/1236] 10.222.0.70 () {56 vars in 1103 bytes} [Mon Jul 11 14:30:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:27.534858 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc9c4d8-1655-4265-8779-2a12893c4f52 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:27.640413 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:27.667686 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc9c4d8-1655-4265-8779-2a12893c4f52 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:27.705738 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b78d3ad-01e7-4abd-8e9e-cec30590f092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:27.706587 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b78d3ad-01e7-4abd-8e9e-cec30590f092 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:27.707017 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b78d3ad-01e7-4abd-8e9e-cec30590f092 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:27.707482 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b78d3ad-01e7-4abd-8e9e-cec30590f092 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:27.719048 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b78d3ad-01e7-4abd-8e9e-cec30590f092 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:27.721034 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b78d3ad-01e7-4abd-8e9e-cec30590f092 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:27.743607 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application [None req-7b78d3ad-01e7-4abd-8e9e-cec30590f092 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:30:27.743607 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:27.743607 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:30:27.743607 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:30:27.743607 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:30:27.743607 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:30:27.743607 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:30:27.743607 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:30:27.743607 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:30:27.743607 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:30:27.743607 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:30:27.743607 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:30:27.743607 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:30:27.743607 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:30:27.743607 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:30:27.744684 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:30:27.744684 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:30:27.744684 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:30:27.744684 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:30:27.744684 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:30:27.744684 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:30:27.744684 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:30:27.744684 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:30:27.744684 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application with Lock( Jul 11 14:30:27.744684 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:30:27.744684 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:30:27.744684 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:30:27.744684 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:30:27.744684 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:30:27.744684 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:30:27.744684 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:30:27.744684 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:30:27.748194 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:30:27.748194 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:30:27.748194 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:30:27.748194 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Jul 11 14:30:27.748194 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 617/1237] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 11 14:30:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:30:27.750738 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b67f84b-7759-4d50-9513-d168f416184f None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:27.870319 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b67f84b-7759-4d50-9513-d168f416184f None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:27.882365 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:27.914166 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e0402e-179c-4a7e-9d33-4983af273dd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:27.914852 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e0402e-179c-4a7e-9d33-4983af273dd5 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:27.915143 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e0402e-179c-4a7e-9d33-4983af273dd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:27.915424 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e0402e-179c-4a7e-9d33-4983af273dd5 None admin] PATH_INFO: `/v3/domains` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:27.916157 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e0402e-179c-4a7e-9d33-4983af273dd5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:27.916507 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e0402e-179c-4a7e-9d33-4983af273dd5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:27.917911 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e0402e-179c-4a7e-9d33-4983af273dd5 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:27.931904 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 621/1238] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jul 11 14:30:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:27.938110 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b78d3ad-01e7-4abd-8e9e-cec30590f092 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:28.065753 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b78d3ad-01e7-4abd-8e9e-cec30590f092 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:28.103317 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9716f6b0-f940-4ef9-85a0-b3f2d74d756a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:28.104131 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9716f6b0-f940-4ef9-85a0-b3f2d74d756a None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:28.104458 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9716f6b0-f940-4ef9-85a0-b3f2d74d756a None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:28.104717 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9716f6b0-f940-4ef9-85a0-b3f2d74d756a None admin] PATH_INFO: `/v3/users/placement` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:28.107751 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:28.114495 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9716f6b0-f940-4ef9-85a0-b3f2d74d756a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:28.116518 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9716f6b0-f940-4ef9-85a0-b3f2d74d756a None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:28.132364 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application [None req-9716f6b0-f940-4ef9-85a0-b3f2d74d756a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 11 14:30:28.132364 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:28.132364 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:30:28.132364 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:30:28.132364 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:30:28.132364 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:30:28.132364 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:30:28.132364 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:30:28.132364 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:30:28.132364 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:30:28.132364 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:30:28.132364 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:30:28.132364 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 14:30:28.132364 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 14:30:28.132364 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 14:30:28.132364 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 14:30:28.133572 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:30:28.133572 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:30:28.133572 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 14:30:28.133572 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:30:28.133572 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 14:30:28.133572 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:30:28.133572 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:30:28.133572 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:30:28.133572 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:30:28.133572 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:30:28.133572 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:30:28.133572 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application with Lock( Jul 11 14:30:28.133572 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:30:28.133572 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:30:28.133572 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:30:28.133572 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:30:28.133572 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:30:28.133572 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:30:28.134636 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:30:28.134636 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:30:28.134636 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 14:30:28.134636 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 14:30:28.134636 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 14:30:28.134636 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 14:30:28.134636 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 14:30:28.134636 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 14:30:28.134636 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 11 14:30:28.134636 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Jul 11 14:30:28.134636 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 618/1239] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 11 14:30:27 2022] GET /identity/v3/users/placement => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:30:28.139972 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e0402e-179c-4a7e-9d33-4983af273dd5 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:28.261768 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e0402e-179c-4a7e-9d33-4983af273dd5 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:28.304954 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d87491-06e1-41ab-9785-ad52f7c15e46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:28.305859 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d87491-06e1-41ab-9785-ad52f7c15e46 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:28.306202 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d87491-06e1-41ab-9785-ad52f7c15e46 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:28.306555 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d87491-06e1-41ab-9785-ad52f7c15e46 None admin] PATH_INFO: `/v3/users` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:28.307560 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d87491-06e1-41ab-9785-ad52f7c15e46 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:28.307916 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d87491-06e1-41ab-9785-ad52f7c15e46 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:28.309694 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d87491-06e1-41ab-9785-ad52f7c15e46 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:28.335387 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 622/1240] 10.222.0.70 () {56 vars in 1143 bytes} [Mon Jul 11 14:30:28 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:28.344627 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9716f6b0-f940-4ef9-85a0-b3f2d74d756a None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:28.489425 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9716f6b0-f940-4ef9-85a0-b3f2d74d756a None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:28.529014 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215043cc-15a5-4684-bb2d-4f3fea1b0c5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:28.529702 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215043cc-15a5-4684-bb2d-4f3fea1b0c5f None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:28.530027 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215043cc-15a5-4684-bb2d-4f3fea1b0c5f None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:28.530434 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215043cc-15a5-4684-bb2d-4f3fea1b0c5f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:28.623517 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:28.632694 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215043cc-15a5-4684-bb2d-4f3fea1b0c5f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:28.634160 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215043cc-15a5-4684-bb2d-4f3fea1b0c5f None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:28.779319 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 619/1241] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Jul 11 14:30:28 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 11 14:30:28.785827 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d87491-06e1-41ab-9785-ad52f7c15e46 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:28.820468 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:28.920895 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d87491-06e1-41ab-9785-ad52f7c15e46 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:28.966369 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecef5c71-2806-45ab-9a48-138f27fbd127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:28.967390 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecef5c71-2806-45ab-9a48-138f27fbd127 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:28.967840 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecef5c71-2806-45ab-9a48-138f27fbd127 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:28.968259 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecef5c71-2806-45ab-9a48-138f27fbd127 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:28.986609 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecef5c71-2806-45ab-9a48-138f27fbd127 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:28.988403 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecef5c71-2806-45ab-9a48-138f27fbd127 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:29.010104 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-ecef5c71-2806-45ab-9a48-138f27fbd127 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:30:29.010104 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:29.010104 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:30:29.010104 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:30:29.010104 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:30:29.010104 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:30:29.010104 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:30:29.010104 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:30:29.010104 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:30:29.010104 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:30:29.010104 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:30:29.010104 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:30:29.010104 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:30:29.010104 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:30:29.010104 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:30:29.011287 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:30:29.011287 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:30:29.011287 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:30:29.011287 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:30:29.011287 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:30:29.011287 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:30:29.011287 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:30:29.011287 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:30:29.011287 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( Jul 11 14:30:29.011287 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:30:29.011287 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:30:29.011287 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:30:29.011287 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:30:29.011287 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:30:29.011287 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:30:29.011287 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:30:29.011287 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:30:29.012300 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:30:29.012300 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:30:29.012300 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:30:29.012300 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Jul 11 14:30:29.012300 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 623/1242] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 11 14:30:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:30:29.017909 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215043cc-15a5-4684-bb2d-4f3fea1b0c5f None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:29.145427 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:29.151960 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215043cc-15a5-4684-bb2d-4f3fea1b0c5f None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:29.189810 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ff35b8-e78f-42be-bb09-c5c777983977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:29.190482 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ff35b8-e78f-42be-bb09-c5c777983977 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:29.190765 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ff35b8-e78f-42be-bb09-c5c777983977 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:29.191549 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ff35b8-e78f-42be-bb09-c5c777983977 None admin] PATH_INFO: `/v3/domains` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:29.192305 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ff35b8-e78f-42be-bb09-c5c777983977 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:29.192613 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ff35b8-e78f-42be-bb09-c5c777983977 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:29.193991 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ff35b8-e78f-42be-bb09-c5c777983977 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:29.211766 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 620/1243] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jul 11 14:30:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:29.213243 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecef5c71-2806-45ab-9a48-138f27fbd127 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:29.311588 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:29.338493 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecef5c71-2806-45ab-9a48-138f27fbd127 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:29.380138 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5114ce-53e1-4444-b198-feb6110015c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:29.381180 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5114ce-53e1-4444-b198-feb6110015c9 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:29.381558 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5114ce-53e1-4444-b198-feb6110015c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:29.381861 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5114ce-53e1-4444-b198-feb6110015c9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:29.389946 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5114ce-53e1-4444-b198-feb6110015c9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:29.391570 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5114ce-53e1-4444-b198-feb6110015c9 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:29.411257 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-9e5114ce-53e1-4444-b198-feb6110015c9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:30:29.411257 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:29.411257 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:30:29.411257 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:30:29.411257 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:30:29.411257 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:30:29.411257 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:30:29.411257 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:30:29.411257 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:30:29.411257 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:30:29.411257 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:30:29.411257 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:30:29.411257 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 14:30:29.411257 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 14:30:29.411257 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 14:30:29.412601 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 14:30:29.412601 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:30:29.412601 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:30:29.412601 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:30:29.412601 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:30:29.412601 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:30:29.412601 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:30:29.412601 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:30:29.412601 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( Jul 11 14:30:29.412601 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:30:29.412601 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:30:29.412601 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:30:29.412601 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:30:29.412601 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:30:29.412601 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:30:29.412601 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:30:29.412601 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:30:29.413522 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 14:30:29.413522 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 14:30:29.413522 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 14:30:29.413522 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 14:30:29.413522 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 14:30:29.413522 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 14:30:29.413522 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:30:29.413522 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Jul 11 14:30:29.413522 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 624/1244] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Jul 11 14:30:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:30:29.418614 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ff35b8-e78f-42be-bb09-c5c777983977 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:29.549482 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ff35b8-e78f-42be-bb09-c5c777983977 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:29.591535 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327787ea-a59c-45ba-b37d-14f8db2ebf4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:29.592344 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327787ea-a59c-45ba-b37d-14f8db2ebf4d None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:29.592701 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327787ea-a59c-45ba-b37d-14f8db2ebf4d None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:29.593011 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327787ea-a59c-45ba-b37d-14f8db2ebf4d None admin] PATH_INFO: `/v3/projects` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:29.594034 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327787ea-a59c-45ba-b37d-14f8db2ebf4d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:29.594354 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327787ea-a59c-45ba-b37d-14f8db2ebf4d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:29.596033 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327787ea-a59c-45ba-b37d-14f8db2ebf4d None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:29.610096 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 621/1245] 10.222.0.70 () {56 vars in 1148 bytes} [Mon Jul 11 14:30:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:29.617364 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5114ce-53e1-4444-b198-feb6110015c9 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:29.739488 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5114ce-53e1-4444-b198-feb6110015c9 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:29.787859 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c062fce8-4dd8-4ab8-9a35-e39dec8af564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:29.788789 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c062fce8-4dd8-4ab8-9a35-e39dec8af564 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:29.789123 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c062fce8-4dd8-4ab8-9a35-e39dec8af564 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:29.790357 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c062fce8-4dd8-4ab8-9a35-e39dec8af564 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:29.790459 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c062fce8-4dd8-4ab8-9a35-e39dec8af564 None admin] RBAC: Adding query filter params (role.id=c766eda9743248fa87df72ec905d271e, scope.project.id=ccd34295bf7b435a96b37487c8e89fc3, user.id=4bf25c7951dc4182996335ca1f0e56ce) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:29.790766 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c062fce8-4dd8-4ab8-9a35-e39dec8af564 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:29.792555 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c062fce8-4dd8-4ab8-9a35-e39dec8af564 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:29.799054 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 625/1246] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Jul 11 14:30:29 2022] GET /identity/v3/role_assignments?user.id=4bf25c7951dc4182996335ca1f0e56ce&scope.project.id=ccd34295bf7b435a96b37487c8e89fc3&role.id=c766eda9743248fa87df72ec905d271e => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:32.170623 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484e2b63-72fc-4278-959b-2eff9734d856 None None] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:32.171154 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484e2b63-72fc-4278-959b-2eff9734d856 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:32.171154 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484e2b63-72fc-4278-959b-2eff9734d856 None None] PATH_INFO: `/` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:32.173023 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 622/1247] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:30:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:30:32.179329 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0a7796-3bbe-44fa-a570-8614e9a0b742 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:32.179875 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0a7796-3bbe-44fa-a570-8614e9a0b742 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:32.179875 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0a7796-3bbe-44fa-a570-8614e9a0b742 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:32.185601 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:32.202654 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-2b0a7796-3bbe-44fa-a570-8614e9a0b742 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:30:32.204348 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-2b0a7796-3bbe-44fa-a570-8614e9a0b742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:30:32.289576 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 626/1248] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:30:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:30:32.317228 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484e2b63-72fc-4278-959b-2eff9734d856 None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:32.340597 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:32.449985 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484e2b63-72fc-4278-959b-2eff9734d856 None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:32.493559 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab0b12b-e715-4672-8e33-c951c7c6aa79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:32.495498 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab0b12b-e715-4672-8e33-c951c7c6aa79 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:32.495498 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab0b12b-e715-4672-8e33-c951c7c6aa79 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:32.495498 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab0b12b-e715-4672-8e33-c951c7c6aa79 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:32.508286 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab0b12b-e715-4672-8e33-c951c7c6aa79 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:30:32.516766 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application [None req-3ab0b12b-e715-4672-8e33-c951c7c6aa79 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:30:32.516766 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:32.516766 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:30:32.516766 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:30:32.516766 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:30:32.516766 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:30:32.516766 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:30:32.516766 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:30:32.516766 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:30:32.516766 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:30:32.516766 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:30:32.516766 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:30:32.516766 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:30:32.516766 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:30:32.516766 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:30:32.516766 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:30:32.517940 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:30:32.517940 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:30:32.517940 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:30:32.517940 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:30:32.517940 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:30:32.517940 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:30:32.517940 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:30:32.517940 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:30:32.517940 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:30:32.517940 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:30:32.517940 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:30:32.517940 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application with Lock( Jul 11 14:30:32.517940 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:30:32.517940 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:30:32.517940 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:30:32.517940 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:30:32.519638 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:30:32.519638 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:30:32.519638 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:30:32.519638 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:30:32.519638 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:30:32.519638 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:30:32.519638 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:30:32.519638 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:30:32.519638 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:30:32.519638 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:30:32.519638 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:30:32.519638 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Jul 11 14:30:32.524242 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 623/1249] 10.222.0.70 () {56 vars in 1096 bytes} [Mon Jul 11 14:30:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:30:32.524977 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0a7796-3bbe-44fa-a570-8614e9a0b742 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:32.660285 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0a7796-3bbe-44fa-a570-8614e9a0b742 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:32.706032 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:32.714945 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918f78e7-cc2f-439e-9486-e2ee4a416bfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:32.715699 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918f78e7-cc2f-439e-9486-e2ee4a416bfe None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:32.716100 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918f78e7-cc2f-439e-9486-e2ee4a416bfe None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:32.716630 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918f78e7-cc2f-439e-9486-e2ee4a416bfe None admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:32.717402 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918f78e7-cc2f-439e-9486-e2ee4a416bfe None admin] RBAC: Adding query filter params (name=admin) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:32.717795 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918f78e7-cc2f-439e-9486-e2ee4a416bfe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:32.719444 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918f78e7-cc2f-439e-9486-e2ee4a416bfe None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:32.729593 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 627/1250] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Jul 11 14:30:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:32.735981 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab0b12b-e715-4672-8e33-c951c7c6aa79 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:32.849843 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:32.891774 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab0b12b-e715-4672-8e33-c951c7c6aa79 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:32.941445 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa7a29c-d584-460c-a74f-6fb129644978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:32.942493 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa7a29c-d584-460c-a74f-6fb129644978 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:32.942860 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa7a29c-d584-460c-a74f-6fb129644978 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:32.943144 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa7a29c-d584-460c-a74f-6fb129644978 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:32.959434 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa7a29c-d584-460c-a74f-6fb129644978 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:32.961197 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa7a29c-d584-460c-a74f-6fb129644978 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:32.982476 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application [None req-1fa7a29c-d584-460c-a74f-6fb129644978 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:30:32.982476 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:32.982476 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:30:32.982476 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:30:32.982476 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:30:32.982476 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:30:32.982476 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:30:32.982476 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:30:32.982476 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:30:32.982476 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:30:32.982476 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:30:32.982476 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:30:32.982476 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:30:32.982476 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:30:32.982476 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:30:32.983876 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:30:32.983876 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:30:32.983876 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:30:32.983876 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:30:32.983876 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:30:32.983876 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:30:32.983876 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:30:32.983876 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:30:32.983876 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application with Lock( Jul 11 14:30:32.983876 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:30:32.983876 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:30:32.983876 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:30:32.983876 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:30:32.983876 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:30:32.983876 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:30:32.983876 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:30:32.983876 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:30:32.985004 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:30:32.985004 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:30:32.985004 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:30:32.985004 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Jul 11 14:30:32.985004 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 624/1251] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 11 14:30:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:30:32.992328 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918f78e7-cc2f-439e-9486-e2ee4a416bfe None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:33.134290 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918f78e7-cc2f-439e-9486-e2ee4a416bfe None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:33.179353 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbadd534-3b06-4a87-9568-def6f18214ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:33.180180 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbadd534-3b06-4a87-9568-def6f18214ca None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:33.180573 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbadd534-3b06-4a87-9568-def6f18214ca None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:33.180924 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbadd534-3b06-4a87-9568-def6f18214ca None admin] PATH_INFO: `/v3/domains` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:33.181776 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbadd534-3b06-4a87-9568-def6f18214ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:33.182058 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbadd534-3b06-4a87-9568-def6f18214ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:33.183703 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbadd534-3b06-4a87-9568-def6f18214ca None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:33.202004 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 628/1252] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jul 11 14:30:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:33.208008 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa7a29c-d584-460c-a74f-6fb129644978 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:33.367122 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa7a29c-d584-460c-a74f-6fb129644978 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:33.408780 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:33.421231 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7b2d0d-a709-449a-aba6-8ede4e4b94ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:33.422072 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7b2d0d-a709-449a-aba6-8ede4e4b94ac None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:33.422317 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7b2d0d-a709-449a-aba6-8ede4e4b94ac None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:33.422588 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7b2d0d-a709-449a-aba6-8ede4e4b94ac None admin] PATH_INFO: `/v3/users/placement` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:33.437165 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7b2d0d-a709-449a-aba6-8ede4e4b94ac None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:33.437853 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7b2d0d-a709-449a-aba6-8ede4e4b94ac None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:33.466378 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application [None req-9d7b2d0d-a709-449a-aba6-8ede4e4b94ac None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 11 14:30:33.466378 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:33.466378 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:30:33.466378 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:30:33.466378 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:30:33.466378 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:30:33.466378 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:30:33.466378 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:30:33.466378 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:30:33.466378 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:30:33.466378 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:30:33.466378 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:30:33.466378 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 14:30:33.466378 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 14:30:33.466378 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 14:30:33.466378 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 14:30:33.468388 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:30:33.468388 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:30:33.468388 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 14:30:33.468388 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:30:33.468388 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 14:30:33.468388 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:30:33.468388 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:30:33.468388 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:30:33.468388 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:30:33.468388 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:30:33.468388 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:30:33.468388 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application with Lock( Jul 11 14:30:33.468388 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:30:33.468388 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:30:33.468388 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:30:33.468388 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:30:33.468388 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:30:33.468388 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:30:33.470037 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:30:33.470037 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:30:33.470037 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 14:30:33.470037 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 14:30:33.470037 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 14:30:33.470037 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 14:30:33.470037 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 14:30:33.470037 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 14:30:33.470037 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 11 14:30:33.470037 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Jul 11 14:30:33.470037 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 625/1253] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 11 14:30:33 2022] GET /identity/v3/users/placement => generated 87 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:30:33.477975 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbadd534-3b06-4a87-9568-def6f18214ca None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:33.573701 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:33.649059 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbadd534-3b06-4a87-9568-def6f18214ca None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:33.711022 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6b771a-8bf5-4b0a-96b4-e50b93cba6d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:33.711722 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6b771a-8bf5-4b0a-96b4-e50b93cba6d6 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:33.712010 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6b771a-8bf5-4b0a-96b4-e50b93cba6d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:33.712329 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6b771a-8bf5-4b0a-96b4-e50b93cba6d6 None admin] PATH_INFO: `/v3/users` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:33.713182 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6b771a-8bf5-4b0a-96b4-e50b93cba6d6 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:33.713524 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6b771a-8bf5-4b0a-96b4-e50b93cba6d6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:33.714983 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6b771a-8bf5-4b0a-96b4-e50b93cba6d6 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:33.748254 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 629/1254] 10.222.0.70 () {56 vars in 1143 bytes} [Mon Jul 11 14:30:33 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:33.755688 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7b2d0d-a709-449a-aba6-8ede4e4b94ac None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:33.926579 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7b2d0d-a709-449a-aba6-8ede4e4b94ac None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:33.982052 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d448ecde-3388-404d-ae3d-289d25a42cd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:33.982826 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d448ecde-3388-404d-ae3d-289d25a42cd7 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:33.983276 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d448ecde-3388-404d-ae3d-289d25a42cd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:33.983570 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d448ecde-3388-404d-ae3d-289d25a42cd7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:34.079958 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:34.102523 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d448ecde-3388-404d-ae3d-289d25a42cd7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:34.104184 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d448ecde-3388-404d-ae3d-289d25a42cd7 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:34.287579 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 626/1255] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Jul 11 14:30:33 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 532 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 11 14:30:34.293863 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6b771a-8bf5-4b0a-96b4-e50b93cba6d6 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:34.470929 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6b771a-8bf5-4b0a-96b4-e50b93cba6d6 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:34.487218 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:34.520072 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c531ef8b-bd86-4dcc-9e2d-c4cc52174bee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:34.521020 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c531ef8b-bd86-4dcc-9e2d-c4cc52174bee None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:34.521349 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c531ef8b-bd86-4dcc-9e2d-c4cc52174bee None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:34.521670 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c531ef8b-bd86-4dcc-9e2d-c4cc52174bee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:34.540310 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c531ef8b-bd86-4dcc-9e2d-c4cc52174bee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:34.542817 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c531ef8b-bd86-4dcc-9e2d-c4cc52174bee None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:34.565091 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-c531ef8b-bd86-4dcc-9e2d-c4cc52174bee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:30:34.565091 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:34.565091 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:30:34.565091 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:30:34.565091 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:30:34.565091 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:30:34.565091 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:30:34.565091 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:30:34.565091 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:30:34.565091 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:30:34.565091 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:30:34.565091 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:30:34.565091 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:30:34.565091 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:30:34.565091 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:30:34.567437 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:30:34.567437 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:30:34.567437 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:30:34.567437 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:30:34.567437 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:30:34.567437 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:30:34.567437 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:30:34.567437 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:30:34.567437 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( Jul 11 14:30:34.567437 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:30:34.567437 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:30:34.567437 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:30:34.567437 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:30:34.567437 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:30:34.567437 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:30:34.567437 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:30:34.567437 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:30:34.573257 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:30:34.573257 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:30:34.573257 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:30:34.573257 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Jul 11 14:30:34.573257 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 630/1256] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 11 14:30:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:30:34.579421 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d448ecde-3388-404d-ae3d-289d25a42cd7 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:34.730184 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:34.753734 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d448ecde-3388-404d-ae3d-289d25a42cd7 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:34.801243 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6049f8f-f88b-4e00-8759-900e28cd49c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:34.803923 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6049f8f-f88b-4e00-8759-900e28cd49c1 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:34.803923 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6049f8f-f88b-4e00-8759-900e28cd49c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:34.803923 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6049f8f-f88b-4e00-8759-900e28cd49c1 None admin] PATH_INFO: `/v3/domains` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:34.804504 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6049f8f-f88b-4e00-8759-900e28cd49c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:34.804947 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6049f8f-f88b-4e00-8759-900e28cd49c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:34.806415 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6049f8f-f88b-4e00-8759-900e28cd49c1 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:34.822324 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 627/1257] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jul 11 14:30:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:34.831817 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c531ef8b-bd86-4dcc-9e2d-c4cc52174bee None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:34.998296 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c531ef8b-bd86-4dcc-9e2d-c4cc52174bee None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:35.051110 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b88ffbb-b07a-414c-8085-36fa7b660587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:35.051399 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b88ffbb-b07a-414c-8085-36fa7b660587 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:35.051505 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b88ffbb-b07a-414c-8085-36fa7b660587 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:35.051803 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b88ffbb-b07a-414c-8085-36fa7b660587 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:35.062842 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b88ffbb-b07a-414c-8085-36fa7b660587 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:35.064613 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b88ffbb-b07a-414c-8085-36fa7b660587 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:35.085026 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-7b88ffbb-b07a-414c-8085-36fa7b660587 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:30:35.085026 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:35.085026 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:30:35.085026 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:30:35.085026 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:30:35.085026 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:30:35.085026 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:30:35.085026 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:30:35.085026 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:30:35.085026 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:30:35.085026 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:30:35.085026 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:30:35.085026 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 14:30:35.085026 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 14:30:35.085026 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 14:30:35.086091 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 14:30:35.086091 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:30:35.086091 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:30:35.086091 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:30:35.086091 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:30:35.086091 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:30:35.086091 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:30:35.086091 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:30:35.086091 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( Jul 11 14:30:35.086091 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:30:35.086091 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:30:35.086091 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:30:35.086091 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:30:35.086091 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:30:35.086091 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:30:35.086091 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:30:35.086091 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:30:35.093722 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 14:30:35.093722 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 14:30:35.093722 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 14:30:35.093722 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 14:30:35.093722 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 14:30:35.093722 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 14:30:35.093722 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:30:35.093722 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Jul 11 14:30:35.093722 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 631/1258] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Jul 11 14:30:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:30:35.094758 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6049f8f-f88b-4e00-8759-900e28cd49c1 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:35.264684 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6049f8f-f88b-4e00-8759-900e28cd49c1 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:35.313663 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5856813e-c58a-42e0-9bd1-b9b3743a9331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:35.314613 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5856813e-c58a-42e0-9bd1-b9b3743a9331 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:35.315032 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5856813e-c58a-42e0-9bd1-b9b3743a9331 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:35.315436 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5856813e-c58a-42e0-9bd1-b9b3743a9331 None admin] PATH_INFO: `/v3/projects` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:35.318964 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5856813e-c58a-42e0-9bd1-b9b3743a9331 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:35.318964 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5856813e-c58a-42e0-9bd1-b9b3743a9331 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:35.318964 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5856813e-c58a-42e0-9bd1-b9b3743a9331 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:35.333458 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 628/1259] 10.222.0.70 () {56 vars in 1148 bytes} [Mon Jul 11 14:30:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:35.339916 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b88ffbb-b07a-414c-8085-36fa7b660587 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:35.376393 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:35.486598 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b88ffbb-b07a-414c-8085-36fa7b660587 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:35.536721 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713928a8-1e06-4640-8eda-cb2516b83f56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:35.537411 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713928a8-1e06-4640-8eda-cb2516b83f56 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:35.537796 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713928a8-1e06-4640-8eda-cb2516b83f56 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:35.538133 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713928a8-1e06-4640-8eda-cb2516b83f56 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:35.539284 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713928a8-1e06-4640-8eda-cb2516b83f56 None admin] RBAC: Adding query filter params (role.id=b46df176b0fe479da63c318db225bed4, scope.project.id=ccd34295bf7b435a96b37487c8e89fc3, user.id=4bf25c7951dc4182996335ca1f0e56ce) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:35.539642 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713928a8-1e06-4640-8eda-cb2516b83f56 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:35.541757 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713928a8-1e06-4640-8eda-cb2516b83f56 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:35.550541 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 632/1260] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Jul 11 14:30:35 2022] GET /identity/v3/role_assignments?user.id=4bf25c7951dc4182996335ca1f0e56ce&scope.project.id=ccd34295bf7b435a96b37487c8e89fc3&role.id=b46df176b0fe479da63c318db225bed4 => generated 259 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:37.796329 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb52cc0-6388-4863-8926-952af1d1098a None None] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:37.796840 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb52cc0-6388-4863-8926-952af1d1098a None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:37.796955 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb52cc0-6388-4863-8926-952af1d1098a None None] PATH_INFO: `/` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:37.798572 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 629/1261] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:30:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:30:37.805172 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a157de00-bef7-45bd-b7f1-ea168a683566 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:37.805691 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a157de00-bef7-45bd-b7f1-ea168a683566 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:37.805691 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a157de00-bef7-45bd-b7f1-ea168a683566 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:37.823917 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-a157de00-bef7-45bd-b7f1-ea168a683566 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:30:37.825185 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-a157de00-bef7-45bd-b7f1-ea168a683566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:30:37.928793 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 633/1262] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:30:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:30:37.952295 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb52cc0-6388-4863-8926-952af1d1098a None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:37.964951 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:38.087256 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb52cc0-6388-4863-8926-952af1d1098a None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:38.133058 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33267970-b57e-475e-9035-1591b5094eaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:38.133878 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33267970-b57e-475e-9035-1591b5094eaa None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:38.134165 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33267970-b57e-475e-9035-1591b5094eaa None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:38.134438 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33267970-b57e-475e-9035-1591b5094eaa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:38.148676 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33267970-b57e-475e-9035-1591b5094eaa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:30:38.157250 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application [None req-33267970-b57e-475e-9035-1591b5094eaa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:30:38.157250 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:38.157250 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:30:38.157250 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:30:38.157250 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:30:38.157250 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:30:38.157250 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:30:38.157250 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:30:38.157250 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:30:38.157250 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:30:38.157250 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:30:38.157250 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:30:38.157250 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:30:38.157250 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:30:38.157250 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:30:38.157250 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:30:38.158515 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:30:38.158515 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:30:38.158515 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:30:38.158515 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:30:38.158515 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:30:38.158515 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:30:38.158515 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:30:38.158515 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:30:38.158515 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:30:38.158515 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:30:38.158515 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:30:38.158515 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application with Lock( Jul 11 14:30:38.158515 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:30:38.158515 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:30:38.158515 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:30:38.158515 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:30:38.160018 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:30:38.160018 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:30:38.160018 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:30:38.160018 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:30:38.160018 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:30:38.160018 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:30:38.160018 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:30:38.160018 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:30:38.160018 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:30:38.160018 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:30:38.160018 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:30:38.160018 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Jul 11 14:30:38.160018 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 630/1263] 10.222.0.70 () {56 vars in 1096 bytes} [Mon Jul 11 14:30:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:30:38.166321 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a157de00-bef7-45bd-b7f1-ea168a683566 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:38.191451 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:38.317669 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a157de00-bef7-45bd-b7f1-ea168a683566 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:38.366311 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2b4312-09b9-4c79-81b0-ed6af63af3f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:38.366906 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2b4312-09b9-4c79-81b0-ed6af63af3f0 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:38.367197 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2b4312-09b9-4c79-81b0-ed6af63af3f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:38.367474 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2b4312-09b9-4c79-81b0-ed6af63af3f0 None admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:38.368273 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2b4312-09b9-4c79-81b0-ed6af63af3f0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:38.368571 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2b4312-09b9-4c79-81b0-ed6af63af3f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:38.369957 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2b4312-09b9-4c79-81b0-ed6af63af3f0 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:38.382488 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 634/1264] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Jul 11 14:30:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:38.388930 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33267970-b57e-475e-9035-1591b5094eaa None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:38.470564 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:38.510644 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33267970-b57e-475e-9035-1591b5094eaa None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:38.558345 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9455cdca-0c87-4e6c-af5b-1df2d3703bdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:38.559169 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9455cdca-0c87-4e6c-af5b-1df2d3703bdb None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:38.559446 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9455cdca-0c87-4e6c-af5b-1df2d3703bdb None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:38.560064 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9455cdca-0c87-4e6c-af5b-1df2d3703bdb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:38.572825 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9455cdca-0c87-4e6c-af5b-1df2d3703bdb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:38.574463 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9455cdca-0c87-4e6c-af5b-1df2d3703bdb None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:38.596982 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application [None req-9455cdca-0c87-4e6c-af5b-1df2d3703bdb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:30:38.596982 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:38.596982 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:30:38.596982 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:30:38.596982 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:30:38.596982 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:30:38.596982 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:30:38.596982 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:30:38.596982 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:30:38.596982 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:30:38.596982 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:30:38.596982 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:30:38.596982 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:30:38.596982 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:30:38.596982 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:30:38.598159 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:30:38.598159 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:30:38.598159 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:30:38.598159 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:30:38.598159 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:30:38.598159 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:30:38.598159 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:30:38.598159 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:30:38.598159 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application with Lock( Jul 11 14:30:38.598159 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:30:38.598159 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:30:38.598159 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:30:38.598159 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:30:38.598159 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:30:38.598159 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:30:38.598159 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:30:38.598159 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:30:38.599283 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:30:38.599283 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:30:38.599283 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:30:38.599283 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Jul 11 14:30:38.603735 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 631/1265] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 11 14:30:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:30:38.605093 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2b4312-09b9-4c79-81b0-ed6af63af3f0 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:38.715928 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:38.739808 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2b4312-09b9-4c79-81b0-ed6af63af3f0 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:38.786570 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2289d9-c9e1-4f5d-8686-fe9bc0810752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:38.787522 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2289d9-c9e1-4f5d-8686-fe9bc0810752 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:38.787916 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2289d9-c9e1-4f5d-8686-fe9bc0810752 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:38.788372 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2289d9-c9e1-4f5d-8686-fe9bc0810752 None admin] PATH_INFO: `/v3/domains` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:38.789393 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2289d9-c9e1-4f5d-8686-fe9bc0810752 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:38.789906 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2289d9-c9e1-4f5d-8686-fe9bc0810752 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:38.791966 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2289d9-c9e1-4f5d-8686-fe9bc0810752 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:38.806393 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 635/1266] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jul 11 14:30:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:38.813973 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9455cdca-0c87-4e6c-af5b-1df2d3703bdb None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:38.953925 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9455cdca-0c87-4e6c-af5b-1df2d3703bdb None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:38.976714 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:38.994485 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96adf382-6799-48cf-a69a-bd9e835d2f34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:38.995561 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96adf382-6799-48cf-a69a-bd9e835d2f34 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:38.996138 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96adf382-6799-48cf-a69a-bd9e835d2f34 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:38.996785 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96adf382-6799-48cf-a69a-bd9e835d2f34 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:39.006910 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96adf382-6799-48cf-a69a-bd9e835d2f34 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:39.008444 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96adf382-6799-48cf-a69a-bd9e835d2f34 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:39.029808 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application [None req-96adf382-6799-48cf-a69a-bd9e835d2f34 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 11 14:30:39.029808 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:39.029808 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:30:39.029808 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:30:39.029808 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:30:39.029808 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:30:39.029808 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:30:39.029808 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:30:39.029808 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:30:39.029808 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:30:39.029808 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:30:39.029808 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:30:39.029808 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 14:30:39.029808 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 14:30:39.029808 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 14:30:39.029808 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 14:30:39.032826 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:30:39.032826 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:30:39.032826 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 14:30:39.032826 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:30:39.032826 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 14:30:39.032826 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:30:39.032826 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:30:39.032826 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:30:39.032826 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:30:39.032826 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:30:39.032826 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:30:39.032826 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application with Lock( Jul 11 14:30:39.032826 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:30:39.032826 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:30:39.032826 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:30:39.032826 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:30:39.032826 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:30:39.032826 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:30:39.035190 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:30:39.035190 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:30:39.035190 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 14:30:39.035190 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 14:30:39.035190 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 14:30:39.035190 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 14:30:39.035190 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 14:30:39.035190 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 14:30:39.035190 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 11 14:30:39.035190 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Jul 11 14:30:39.035190 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 632/1267] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 11 14:30:38 2022] GET /identity/v3/users/placement => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:30:39.036940 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2289d9-c9e1-4f5d-8686-fe9bc0810752 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:39.163858 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2289d9-c9e1-4f5d-8686-fe9bc0810752 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:39.213379 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c5d162-769a-480a-a0be-233b223f6547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:39.214068 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c5d162-769a-480a-a0be-233b223f6547 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:39.214348 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c5d162-769a-480a-a0be-233b223f6547 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:39.214625 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c5d162-769a-480a-a0be-233b223f6547 None admin] PATH_INFO: `/v3/users` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:39.215474 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c5d162-769a-480a-a0be-233b223f6547 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:39.215782 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c5d162-769a-480a-a0be-233b223f6547 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:39.217392 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c5d162-769a-480a-a0be-233b223f6547 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:39.230599 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:39.245697 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 636/1268] 10.222.0.70 () {56 vars in 1143 bytes} [Mon Jul 11 14:30:39 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:39.251382 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96adf382-6799-48cf-a69a-bd9e835d2f34 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:39.399595 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96adf382-6799-48cf-a69a-bd9e835d2f34 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:39.447104 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675ba016-3b09-40b7-be62-6da03a9ee053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:39.447908 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675ba016-3b09-40b7-be62-6da03a9ee053 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:39.448189 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675ba016-3b09-40b7-be62-6da03a9ee053 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:39.448488 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675ba016-3b09-40b7-be62-6da03a9ee053 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:39.461836 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675ba016-3b09-40b7-be62-6da03a9ee053 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:39.463304 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675ba016-3b09-40b7-be62-6da03a9ee053 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:39.483887 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application [None req-675ba016-3b09-40b7-be62-6da03a9ee053 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:30:39.483887 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:39.483887 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:30:39.483887 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:30:39.483887 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:30:39.483887 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:30:39.483887 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:30:39.483887 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:30:39.483887 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:30:39.483887 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:30:39.483887 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:30:39.483887 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:30:39.483887 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:30:39.483887 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:30:39.483887 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:30:39.485799 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:30:39.485799 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:30:39.485799 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:30:39.485799 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:30:39.485799 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:30:39.485799 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:30:39.485799 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:30:39.485799 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:30:39.485799 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application with Lock( Jul 11 14:30:39.485799 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:30:39.485799 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:30:39.485799 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:30:39.485799 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:30:39.485799 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:30:39.485799 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:30:39.485799 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:30:39.485799 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:30:39.488787 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:30:39.488787 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:30:39.488787 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:30:39.488787 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Jul 11 14:30:39.488787 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 633/1269] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 11 14:30:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:30:39.494123 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c5d162-769a-480a-a0be-233b223f6547 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:39.624700 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c5d162-769a-480a-a0be-233b223f6547 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:39.671315 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67ef54e-4e8f-4c00-85f3-6efe0fd92c82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:39.672314 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67ef54e-4e8f-4c00-85f3-6efe0fd92c82 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:39.672705 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67ef54e-4e8f-4c00-85f3-6efe0fd92c82 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:39.673088 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67ef54e-4e8f-4c00-85f3-6efe0fd92c82 None admin] PATH_INFO: `/v3/domains` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:39.674513 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67ef54e-4e8f-4c00-85f3-6efe0fd92c82 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:39.675109 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67ef54e-4e8f-4c00-85f3-6efe0fd92c82 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:39.677203 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67ef54e-4e8f-4c00-85f3-6efe0fd92c82 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:39.699019 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 637/1270] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jul 11 14:30:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:39.700356 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675ba016-3b09-40b7-be62-6da03a9ee053 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:39.745712 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:39.858274 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675ba016-3b09-40b7-be62-6da03a9ee053 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:39.923256 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddedbbc-0eb4-42f7-bcc9-d5af58b647fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:39.925314 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddedbbc-0eb4-42f7-bcc9-d5af58b647fc None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:39.925688 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddedbbc-0eb4-42f7-bcc9-d5af58b647fc None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:39.926155 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddedbbc-0eb4-42f7-bcc9-d5af58b647fc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:39.936105 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddedbbc-0eb4-42f7-bcc9-d5af58b647fc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:39.937769 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddedbbc-0eb4-42f7-bcc9-d5af58b647fc None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:39.960005 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application [None req-5ddedbbc-0eb4-42f7-bcc9-d5af58b647fc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:30:39.960005 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:39.960005 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:30:39.960005 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:30:39.960005 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:30:39.960005 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:30:39.960005 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:30:39.960005 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:30:39.960005 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:30:39.960005 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:30:39.960005 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:30:39.960005 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:30:39.960005 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 14:30:39.960005 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 14:30:39.960005 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 14:30:39.961807 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 14:30:39.961807 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:30:39.961807 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:30:39.961807 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:30:39.961807 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:30:39.961807 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:30:39.961807 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:30:39.961807 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:30:39.961807 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application with Lock( Jul 11 14:30:39.961807 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:30:39.961807 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:30:39.961807 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:30:39.961807 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:30:39.961807 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:30:39.961807 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:30:39.961807 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:30:39.961807 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:30:39.962697 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 14:30:39.962697 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 14:30:39.962697 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 14:30:39.962697 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 14:30:39.962697 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 14:30:39.962697 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 14:30:39.962697 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:30:39.962697 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Jul 11 14:30:39.962697 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 634/1271] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Jul 11 14:30:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:30:39.970892 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67ef54e-4e8f-4c00-85f3-6efe0fd92c82 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:40.052378 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:40.102863 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67ef54e-4e8f-4c00-85f3-6efe0fd92c82 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:40.153457 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ced2ece-847b-41ba-bdcf-3af259046dbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:40.154181 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ced2ece-847b-41ba-bdcf-3af259046dbb None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:40.154458 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ced2ece-847b-41ba-bdcf-3af259046dbb None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:40.154740 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ced2ece-847b-41ba-bdcf-3af259046dbb None admin] PATH_INFO: `/v3/projects` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:40.155537 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ced2ece-847b-41ba-bdcf-3af259046dbb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:40.155827 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ced2ece-847b-41ba-bdcf-3af259046dbb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:40.157704 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ced2ece-847b-41ba-bdcf-3af259046dbb None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:40.171544 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 638/1272] 10.222.0.70 () {56 vars in 1148 bytes} [Mon Jul 11 14:30:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:30:40.178784 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddedbbc-0eb4-42f7-bcc9-d5af58b647fc None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:40.309049 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:40.316620 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddedbbc-0eb4-42f7-bcc9-d5af58b647fc None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:40.359480 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ffab71-7695-4746-be06-2efa7cfd2cdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:40.361029 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ffab71-7695-4746-be06-2efa7cfd2cdd None admin] REQUEST_METHOD: `PUT` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:40.361474 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ffab71-7695-4746-be06-2efa7cfd2cdd None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:40.361940 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ffab71-7695-4746-be06-2efa7cfd2cdd None admin] PATH_INFO: `/v3/projects/ccd34295bf7b435a96b37487c8e89fc3/users/4bf25c7951dc4182996335ca1f0e56ce/roles/b46df176b0fe479da63c318db225bed4` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:40.366032 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ffab71-7695-4746-be06-2efa7cfd2cdd None admin] RBAC: Authorizing `identity:create_grant(project_id=ccd34295bf7b435a96b37487c8e89fc3, user_id=4bf25c7951dc4182996335ca1f0e56ce, role_id=b46df176b0fe479da63c318db225bed4)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:40.368690 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ffab71-7695-4746-be06-2efa7cfd2cdd None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:40.392275 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 635/1273] 10.222.0.70 () {58 vars in 1439 bytes} [Mon Jul 11 14:30:40 2022] PUT /identity/v3/projects/ccd34295bf7b435a96b37487c8e89fc3/users/4bf25c7951dc4182996335ca1f0e56ce/roles/b46df176b0fe479da63c318db225bed4 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:30:42.524135 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d996755d-d13e-4a94-8067-f52dc0ec2b15 None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:42.524748 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d996755d-d13e-4a94-8067-f52dc0ec2b15 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:42.524748 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d996755d-d13e-4a94-8067-f52dc0ec2b15 None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:42.526071 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 639/1274] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:30:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:30:42.531309 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e76271f-4804-4062-bfe4-6f69f3c177f0 None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:42.531779 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e76271f-4804-4062-bfe4-6f69f3c177f0 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:42.531900 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e76271f-4804-4062-bfe4-6f69f3c177f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:42.551697 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-2e76271f-4804-4062-bfe4-6f69f3c177f0 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:30:42.552934 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-2e76271f-4804-4062-bfe4-6f69f3c177f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:30:42.623515 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 636/1275] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:30:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:30:42.647763 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d996755d-d13e-4a94-8067-f52dc0ec2b15 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:42.757385 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d996755d-d13e-4a94-8067-f52dc0ec2b15 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:42.775733 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:42.793294 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e939201-b60e-48b2-9841-e77afbb6c93c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:42.794092 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e939201-b60e-48b2-9841-e77afbb6c93c None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:42.794375 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e939201-b60e-48b2-9841-e77afbb6c93c None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:42.794647 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e939201-b60e-48b2-9841-e77afbb6c93c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:42.805381 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e939201-b60e-48b2-9841-e77afbb6c93c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:30:42.813162 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-6e939201-b60e-48b2-9841-e77afbb6c93c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:30:42.813162 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:42.813162 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:30:42.813162 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:30:42.813162 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:30:42.813162 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:30:42.813162 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:30:42.813162 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:30:42.813162 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:30:42.813162 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:30:42.813162 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:30:42.813162 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:30:42.813162 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:30:42.813162 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:30:42.813162 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:30:42.813162 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:30:42.814889 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:30:42.814889 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:30:42.814889 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:30:42.814889 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:30:42.814889 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:30:42.814889 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:30:42.814889 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:30:42.814889 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:30:42.814889 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:30:42.814889 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:30:42.814889 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:30:42.814889 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( Jul 11 14:30:42.814889 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:30:42.814889 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:30:42.814889 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:30:42.814889 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:30:42.817169 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:30:42.817169 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:30:42.817169 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:30:42.817169 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:30:42.817169 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:30:42.817169 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:30:42.817169 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:30:42.817169 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:30:42.817169 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:30:42.817169 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:30:42.817169 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:30:42.817169 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Jul 11 14:30:42.817169 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 640/1276] 10.222.0.70 () {56 vars in 1096 bytes} [Mon Jul 11 14:30:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:30:42.821203 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e76271f-4804-4062-bfe4-6f69f3c177f0 None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:42.936313 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:42.965687 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e76271f-4804-4062-bfe4-6f69f3c177f0 None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:43.003798 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d52c322-b3ec-4ad8-a7d8-07b3957fed51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:43.004529 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d52c322-b3ec-4ad8-a7d8-07b3957fed51 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:43.004815 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d52c322-b3ec-4ad8-a7d8-07b3957fed51 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:43.005089 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d52c322-b3ec-4ad8-a7d8-07b3957fed51 None admin] PATH_INFO: `/v3/roles` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:43.005856 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d52c322-b3ec-4ad8-a7d8-07b3957fed51 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:43.006163 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d52c322-b3ec-4ad8-a7d8-07b3957fed51 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:43.007559 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d52c322-b3ec-4ad8-a7d8-07b3957fed51 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:43.017003 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 637/1277] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Jul 11 14:30:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:43.026792 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e939201-b60e-48b2-9841-e77afbb6c93c None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:43.174021 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e939201-b60e-48b2-9841-e77afbb6c93c None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:43.216701 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8660793-c25b-4524-ab9d-dbed614e5d02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:43.217549 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8660793-c25b-4524-ab9d-dbed614e5d02 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:43.217833 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8660793-c25b-4524-ab9d-dbed614e5d02 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:43.218111 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8660793-c25b-4524-ab9d-dbed614e5d02 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:43.230460 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8660793-c25b-4524-ab9d-dbed614e5d02 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:43.231930 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8660793-c25b-4524-ab9d-dbed614e5d02 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:43.250872 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-e8660793-c25b-4524-ab9d-dbed614e5d02 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:30:43.250872 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:43.250872 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:30:43.250872 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:30:43.250872 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:30:43.250872 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:30:43.250872 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:30:43.250872 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:30:43.250872 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:30:43.250872 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:30:43.250872 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:30:43.250872 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:30:43.250872 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:30:43.250872 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:30:43.250872 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:30:43.252010 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:30:43.252010 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:30:43.252010 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:30:43.252010 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:30:43.252010 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:30:43.252010 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:30:43.252010 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:30:43.252010 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:30:43.252010 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( Jul 11 14:30:43.252010 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:30:43.252010 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:30:43.252010 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:30:43.252010 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:30:43.252010 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:30:43.252010 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:30:43.252010 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:30:43.252010 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:30:43.253559 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:30:43.253559 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:30:43.253559 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:30:43.253559 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Jul 11 14:30:43.253559 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 641/1278] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 11 14:30:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:30:43.258821 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d52c322-b3ec-4ad8-a7d8-07b3957fed51 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:43.389808 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d52c322-b3ec-4ad8-a7d8-07b3957fed51 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:43.433523 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34c13e4-6431-4296-9848-63b744da6e6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:43.434269 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34c13e4-6431-4296-9848-63b744da6e6e None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:43.434588 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34c13e4-6431-4296-9848-63b744da6e6e None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:43.434926 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34c13e4-6431-4296-9848-63b744da6e6e None admin] PATH_INFO: `/v3/domains` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:43.435749 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34c13e4-6431-4296-9848-63b744da6e6e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:43.436098 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34c13e4-6431-4296-9848-63b744da6e6e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:43.437807 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34c13e4-6431-4296-9848-63b744da6e6e None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:43.453453 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 638/1279] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jul 11 14:30:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:43.459705 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8660793-c25b-4524-ab9d-dbed614e5d02 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:43.497219 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:43.571465 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8660793-c25b-4524-ab9d-dbed614e5d02 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:43.606093 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4bca7d-5597-4932-a77f-c4d561ce675d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:43.606891 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4bca7d-5597-4932-a77f-c4d561ce675d None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:43.607171 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4bca7d-5597-4932-a77f-c4d561ce675d None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:43.607443 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4bca7d-5597-4932-a77f-c4d561ce675d None admin] PATH_INFO: `/v3/users/placement` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:43.616703 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4bca7d-5597-4932-a77f-c4d561ce675d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:43.618138 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4bca7d-5597-4932-a77f-c4d561ce675d None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:43.632353 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-ab4bca7d-5597-4932-a77f-c4d561ce675d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 11 14:30:43.632353 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:43.632353 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:30:43.632353 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:30:43.632353 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:30:43.632353 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:30:43.632353 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:30:43.632353 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:30:43.632353 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:30:43.632353 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:30:43.632353 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:30:43.632353 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:30:43.632353 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 14:30:43.632353 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 14:30:43.632353 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 14:30:43.632353 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 14:30:43.633520 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:30:43.633520 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:30:43.633520 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 14:30:43.633520 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:30:43.633520 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 14:30:43.633520 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:30:43.633520 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:30:43.633520 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:30:43.633520 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:30:43.633520 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:30:43.633520 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:30:43.633520 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( Jul 11 14:30:43.633520 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:30:43.633520 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:30:43.633520 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:30:43.633520 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:30:43.633520 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:30:43.633520 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:30:43.634707 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:30:43.634707 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:30:43.634707 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 14:30:43.634707 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 14:30:43.634707 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 14:30:43.634707 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 14:30:43.634707 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 14:30:43.634707 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 14:30:43.634707 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 11 14:30:43.634707 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Jul 11 14:30:43.634707 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 642/1280] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 11 14:30:43 2022] GET /identity/v3/users/placement => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:30:43.640342 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34c13e4-6431-4296-9848-63b744da6e6e None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:43.645227 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:43.747013 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34c13e4-6431-4296-9848-63b744da6e6e None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:43.781657 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daab4ca2-d024-4165-8484-c92eed7d7568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:43.782322 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daab4ca2-d024-4165-8484-c92eed7d7568 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:43.782607 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daab4ca2-d024-4165-8484-c92eed7d7568 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:43.782884 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daab4ca2-d024-4165-8484-c92eed7d7568 None admin] PATH_INFO: `/v3/users` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:43.783786 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daab4ca2-d024-4165-8484-c92eed7d7568 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:43.784689 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daab4ca2-d024-4165-8484-c92eed7d7568 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:43.786211 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daab4ca2-d024-4165-8484-c92eed7d7568 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:43.804616 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 639/1281] 10.222.0.70 () {56 vars in 1143 bytes} [Mon Jul 11 14:30:43 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:43.810436 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4bca7d-5597-4932-a77f-c4d561ce675d None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:43.912979 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:43.925669 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4bca7d-5597-4932-a77f-c4d561ce675d None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:43.963539 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a692933e-23a9-4307-93e1-2ad0bd9a1bff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:43.964189 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a692933e-23a9-4307-93e1-2ad0bd9a1bff None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:43.964502 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a692933e-23a9-4307-93e1-2ad0bd9a1bff None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:43.964826 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a692933e-23a9-4307-93e1-2ad0bd9a1bff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:44.047203 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a692933e-23a9-4307-93e1-2ad0bd9a1bff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:44.048837 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a692933e-23a9-4307-93e1-2ad0bd9a1bff None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:44.161359 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:44.173689 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 643/1282] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Jul 11 14:30:43 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 11 14:30:44.180261 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daab4ca2-d024-4165-8484-c92eed7d7568 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:44.276080 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:44.322802 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daab4ca2-d024-4165-8484-c92eed7d7568 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:44.363203 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db7108f-33d1-416d-a775-9ae8851ab333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:44.364028 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db7108f-33d1-416d-a775-9ae8851ab333 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:44.364312 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db7108f-33d1-416d-a775-9ae8851ab333 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:44.364606 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db7108f-33d1-416d-a775-9ae8851ab333 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:44.376362 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db7108f-33d1-416d-a775-9ae8851ab333 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:44.379061 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db7108f-33d1-416d-a775-9ae8851ab333 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:44.399181 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application [None req-9db7108f-33d1-416d-a775-9ae8851ab333 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:30:44.399181 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:44.399181 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:30:44.399181 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:30:44.399181 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:30:44.399181 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:30:44.399181 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:30:44.399181 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:30:44.399181 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:30:44.399181 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:30:44.399181 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:30:44.399181 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:30:44.399181 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:30:44.399181 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:30:44.399181 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:30:44.400365 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:30:44.400365 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:30:44.400365 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:30:44.400365 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:30:44.400365 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:30:44.400365 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:30:44.400365 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:30:44.400365 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:30:44.400365 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application with Lock( Jul 11 14:30:44.400365 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:30:44.400365 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:30:44.400365 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:30:44.400365 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:30:44.400365 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:30:44.400365 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:30:44.400365 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:30:44.400365 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:30:44.401447 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:30:44.401447 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:30:44.401447 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:30:44.401447 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Jul 11 14:30:44.401447 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 640/1283] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 11 14:30:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:30:44.409543 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a692933e-23a9-4307-93e1-2ad0bd9a1bff None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:44.535306 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a692933e-23a9-4307-93e1-2ad0bd9a1bff None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:44.583746 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8072a740-36a7-47ad-8f35-dcfe73be6d54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:44.584554 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8072a740-36a7-47ad-8f35-dcfe73be6d54 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:44.584827 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8072a740-36a7-47ad-8f35-dcfe73be6d54 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:44.585158 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8072a740-36a7-47ad-8f35-dcfe73be6d54 None admin] PATH_INFO: `/v3/domains` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:44.586053 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8072a740-36a7-47ad-8f35-dcfe73be6d54 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:44.586412 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8072a740-36a7-47ad-8f35-dcfe73be6d54 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:44.588006 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8072a740-36a7-47ad-8f35-dcfe73be6d54 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:44.602341 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 644/1284] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jul 11 14:30:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:30:44.609892 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db7108f-33d1-416d-a775-9ae8851ab333 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:44.728319 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db7108f-33d1-416d-a775-9ae8851ab333 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:44.748037 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:44.779839 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8cdf96-5bfc-419a-8aa4-45cdcb9cbb86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:44.780702 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8cdf96-5bfc-419a-8aa4-45cdcb9cbb86 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:44.780984 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8cdf96-5bfc-419a-8aa4-45cdcb9cbb86 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:44.781263 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8cdf96-5bfc-419a-8aa4-45cdcb9cbb86 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:44.789271 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8cdf96-5bfc-419a-8aa4-45cdcb9cbb86 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:44.790611 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8cdf96-5bfc-419a-8aa4-45cdcb9cbb86 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:44.805481 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application [None req-fa8cdf96-5bfc-419a-8aa4-45cdcb9cbb86 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:30:44.805481 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:44.805481 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:30:44.805481 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:30:44.805481 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:30:44.805481 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:30:44.805481 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:30:44.805481 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:30:44.805481 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:30:44.805481 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:30:44.805481 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:30:44.805481 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:30:44.805481 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 14:30:44.805481 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 14:30:44.805481 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 14:30:44.807381 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 14:30:44.807381 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:30:44.807381 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:30:44.807381 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:30:44.807381 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:30:44.807381 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:30:44.807381 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:30:44.807381 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:30:44.807381 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application with Lock( Jul 11 14:30:44.807381 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:30:44.807381 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:30:44.807381 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:30:44.807381 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:30:44.807381 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:30:44.807381 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:30:44.807381 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:30:44.807381 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:30:44.809212 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 14:30:44.809212 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 14:30:44.809212 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 14:30:44.809212 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 14:30:44.809212 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 14:30:44.809212 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 14:30:44.809212 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:30:44.809212 dv-cinder-master-3-smb devstack@keystone.service[80534]: ERROR keystone.server.flask.application Jul 11 14:30:44.809212 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 641/1285] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Jul 11 14:30:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:30:44.813214 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8072a740-36a7-47ad-8f35-dcfe73be6d54 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:44.885040 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:44.950248 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8072a740-36a7-47ad-8f35-dcfe73be6d54 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:44.992718 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddaa85a-0904-4759-9acb-682f6e2d7f64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:44.993376 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddaa85a-0904-4759-9acb-682f6e2d7f64 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:44.993673 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddaa85a-0904-4759-9acb-682f6e2d7f64 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:44.993947 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddaa85a-0904-4759-9acb-682f6e2d7f64 None admin] PATH_INFO: `/v3/projects` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:44.994728 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddaa85a-0904-4759-9acb-682f6e2d7f64 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:44.995034 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddaa85a-0904-4759-9acb-682f6e2d7f64 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:44.996497 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddaa85a-0904-4759-9acb-682f6e2d7f64 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:45.010031 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 645/1286] 10.222.0.70 () {56 vars in 1148 bytes} [Mon Jul 11 14:30:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:45.016604 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8cdf96-5bfc-419a-8aa4-45cdcb9cbb86 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:45.146502 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8cdf96-5bfc-419a-8aa4-45cdcb9cbb86 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:45.186821 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008aea37-edfc-4250-b60a-42222f298a68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:45.187587 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008aea37-edfc-4250-b60a-42222f298a68 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:45.187974 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008aea37-edfc-4250-b60a-42222f298a68 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:45.188332 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008aea37-edfc-4250-b60a-42222f298a68 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:45.189397 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008aea37-edfc-4250-b60a-42222f298a68 None admin] RBAC: Adding query filter params (role.id=b46df176b0fe479da63c318db225bed4, scope.project.id=ccd34295bf7b435a96b37487c8e89fc3, user.id=4bf25c7951dc4182996335ca1f0e56ce) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:45.190323 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008aea37-edfc-4250-b60a-42222f298a68 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:45.192132 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008aea37-edfc-4250-b60a-42222f298a68 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:45.199351 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 642/1287] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Jul 11 14:30:45 2022] GET /identity/v3/role_assignments?user.id=4bf25c7951dc4182996335ca1f0e56ce&scope.project.id=ccd34295bf7b435a96b37487c8e89fc3&role.id=b46df176b0fe479da63c318db225bed4 => generated 608 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:47.589953 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe64993-67bc-4222-b658-8a5268672a86 None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:47.590515 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe64993-67bc-4222-b658-8a5268672a86 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:47.590515 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe64993-67bc-4222-b658-8a5268672a86 None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:47.591892 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 646/1288] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:30:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:30:47.597738 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe12b3af-8d03-49db-ac89-a17f489cd73a None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:47.598252 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe12b3af-8d03-49db-ac89-a17f489cd73a None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:47.598252 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe12b3af-8d03-49db-ac89-a17f489cd73a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:47.615850 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-fe12b3af-8d03-49db-ac89-a17f489cd73a None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:30:47.617177 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-fe12b3af-8d03-49db-ac89-a17f489cd73a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:30:47.650623 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:47.693007 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 643/1289] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:30:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:30:47.716098 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe64993-67bc-4222-b658-8a5268672a86 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:47.825121 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe64993-67bc-4222-b658-8a5268672a86 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:47.838191 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:47.870879 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5d6f2a-f6c8-40a6-a5fb-bfccf81260a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:47.871960 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5d6f2a-f6c8-40a6-a5fb-bfccf81260a3 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:47.872337 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5d6f2a-f6c8-40a6-a5fb-bfccf81260a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:47.872742 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5d6f2a-f6c8-40a6-a5fb-bfccf81260a3 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:47.873386 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5d6f2a-f6c8-40a6-a5fb-bfccf81260a3 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:47.876156 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5d6f2a-f6c8-40a6-a5fb-bfccf81260a3 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:47.894880 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-3c5d6f2a-f6c8-40a6-a5fb-bfccf81260a3 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 11 14:30:47.894880 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:47.894880 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 14:30:47.894880 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 14:30:47.894880 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 14:30:47.894880 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 14:30:47.894880 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 14:30:47.894880 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:30:47.894880 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 11 14:30:47.894880 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Jul 11 14:30:47.894880 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 14:30:47.894880 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Jul 11 14:30:47.894880 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:47.894880 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:30:47.894880 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:30:47.894880 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:30:47.894880 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:30:47.896183 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:30:47.896183 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:30:47.896183 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:30:47.896183 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:30:47.896183 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:30:47.896183 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:30:47.896183 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 14:30:47.896183 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 14:30:47.896183 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 14:30:47.896183 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 14:30:47.896183 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:30:47.896183 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:30:47.896183 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:30:47.896183 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:30:47.896183 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:30:47.896183 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:30:47.897227 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:30:47.897227 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( Jul 11 14:30:47.897227 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:30:47.897227 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:30:47.897227 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:30:47.897227 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:30:47.897227 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:30:47.897227 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:30:47.897227 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:30:47.897227 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:30:47.897227 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 14:30:47.897227 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:30:47.897227 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 11 14:30:47.897227 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Jul 11 14:30:47.897227 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 647/1290] 10.222.0.70 () {56 vars in 1117 bytes} [Mon Jul 11 14:30:47 2022] GET /identity/v3/services/placement => generated 90 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:30:47.903139 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe12b3af-8d03-49db-ac89-a17f489cd73a None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:48.050425 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe12b3af-8d03-49db-ac89-a17f489cd73a None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:48.106556 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a5e70f-ae36-44e1-a44f-e075a0d618a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:48.107185 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a5e70f-ae36-44e1-a44f-e075a0d618a6 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:48.107597 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a5e70f-ae36-44e1-a44f-e075a0d618a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:48.107981 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a5e70f-ae36-44e1-a44f-e075a0d618a6 None admin] PATH_INFO: `/v3/services` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:48.109026 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a5e70f-ae36-44e1-a44f-e075a0d618a6 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:48.109454 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a5e70f-ae36-44e1-a44f-e075a0d618a6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:48.111252 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a5e70f-ae36-44e1-a44f-e075a0d618a6 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:48.117708 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 644/1291] 10.222.0.70 () {56 vars in 1116 bytes} [Mon Jul 11 14:30:47 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:48.123512 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5d6f2a-f6c8-40a6-a5fb-bfccf81260a3 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:48.238754 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5d6f2a-f6c8-40a6-a5fb-bfccf81260a3 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:48.278237 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5fdcc3-09dc-4cf1-ae88-a01010af9530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:48.279021 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5fdcc3-09dc-4cf1-ae88-a01010af9530 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:48.279340 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5fdcc3-09dc-4cf1-ae88-a01010af9530 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:48.279668 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5fdcc3-09dc-4cf1-ae88-a01010af9530 None admin] PATH_INFO: `/v3/services` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:48.280598 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5fdcc3-09dc-4cf1-ae88-a01010af9530 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:48.280931 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5fdcc3-09dc-4cf1-ae88-a01010af9530 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:48.282334 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5fdcc3-09dc-4cf1-ae88-a01010af9530 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:48.288443 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 648/1292] 10.222.0.70 () {56 vars in 1116 bytes} [Mon Jul 11 14:30:48 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:50.580755 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9f6efa-2410-4302-b4c8-9f8676ec4c37 None None] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:50.581295 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9f6efa-2410-4302-b4c8-9f8676ec4c37 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:50.581469 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9f6efa-2410-4302-b4c8-9f8676ec4c37 None None] PATH_INFO: `/` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:50.583117 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 645/1293] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:30:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:30:50.589649 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ce1b32-d38c-405f-b2fd-4d238e3f7cf8 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:50.590183 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ce1b32-d38c-405f-b2fd-4d238e3f7cf8 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:50.590183 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ce1b32-d38c-405f-b2fd-4d238e3f7cf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:50.608463 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-80ce1b32-d38c-405f-b2fd-4d238e3f7cf8 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:30:50.609547 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-80ce1b32-d38c-405f-b2fd-4d238e3f7cf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:30:50.646243 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:50.695183 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 649/1294] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:30:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:30:50.719803 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9f6efa-2410-4302-b4c8-9f8676ec4c37 None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:50.753937 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:50.865872 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9f6efa-2410-4302-b4c8-9f8676ec4c37 None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:50.928234 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5ea7d6-a078-467b-ae1e-7c0da80cd944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:50.929094 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5ea7d6-a078-467b-ae1e-7c0da80cd944 None admin] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:50.929595 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5ea7d6-a078-467b-ae1e-7c0da80cd944 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:50.930196 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5ea7d6-a078-467b-ae1e-7c0da80cd944 None admin] PATH_INFO: `/v3/services` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:50.931320 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5ea7d6-a078-467b-ae1e-7c0da80cd944 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:50.933289 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5ea7d6-a078-467b-ae1e-7c0da80cd944 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:50.954173 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 646/1295] 10.222.0.70 () {60 vars in 1141 bytes} [Mon Jul 11 14:30:50 2022] POST /identity/v3/services => generated 246 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:30:53.111527 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dca1544-b0ea-4621-adc2-d0224ddd6a78 None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:53.112108 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dca1544-b0ea-4621-adc2-d0224ddd6a78 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:53.112108 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dca1544-b0ea-4621-adc2-d0224ddd6a78 None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:53.113528 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 650/1296] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:30:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:30:53.118764 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dc8059-1300-4c77-8727-73a4d9c49a5d None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:53.119228 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dc8059-1300-4c77-8727-73a4d9c49a5d None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:53.119335 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dc8059-1300-4c77-8727-73a4d9c49a5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:53.136638 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-43dc8059-1300-4c77-8727-73a4d9c49a5d None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:30:53.137837 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-43dc8059-1300-4c77-8727-73a4d9c49a5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:30:53.221594 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 647/1297] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:30:53 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:30:53.244329 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dca1544-b0ea-4621-adc2-d0224ddd6a78 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:53.345970 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dca1544-b0ea-4621-adc2-d0224ddd6a78 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:53.381695 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846f5980-1c06-4ae8-af9f-a7459c5b76f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:53.382317 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846f5980-1c06-4ae8-af9f-a7459c5b76f3 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:53.382587 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846f5980-1c06-4ae8-af9f-a7459c5b76f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:53.382853 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846f5980-1c06-4ae8-af9f-a7459c5b76f3 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:53.383504 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846f5980-1c06-4ae8-af9f-a7459c5b76f3 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:53.384898 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846f5980-1c06-4ae8-af9f-a7459c5b76f3 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:53.399102 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-846f5980-1c06-4ae8-af9f-a7459c5b76f3 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 11 14:30:53.399102 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:53.399102 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 14:30:53.399102 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 14:30:53.399102 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 14:30:53.399102 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 14:30:53.399102 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 14:30:53.399102 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:30:53.399102 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 11 14:30:53.399102 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Jul 11 14:30:53.399102 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 14:30:53.399102 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Jul 11 14:30:53.399102 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:53.399102 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:30:53.399102 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:30:53.399102 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:30:53.399102 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:30:53.400464 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:30:53.400464 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:30:53.400464 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:30:53.400464 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:30:53.400464 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:30:53.400464 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:30:53.400464 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 14:30:53.400464 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 14:30:53.400464 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 14:30:53.400464 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 14:30:53.400464 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:30:53.400464 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:30:53.400464 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:30:53.400464 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:30:53.400464 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:30:53.400464 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:30:53.401445 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:30:53.401445 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( Jul 11 14:30:53.401445 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:30:53.401445 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:30:53.401445 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:30:53.401445 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:30:53.401445 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:30:53.401445 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:30:53.401445 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:30:53.401445 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:30:53.401445 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 14:30:53.401445 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:30:53.401445 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 11 14:30:53.401445 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Jul 11 14:30:53.401445 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 651/1298] 10.222.0.70 () {56 vars in 1117 bytes} [Mon Jul 11 14:30:53 2022] GET /identity/v3/services/placement => generated 90 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:30:53.406676 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dc8059-1300-4c77-8727-73a4d9c49a5d None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:53.428815 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:53.511766 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dc8059-1300-4c77-8727-73a4d9c49a5d None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:53.546231 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5455f37-0039-4c94-9b04-3e04c2f2f9a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:53.546926 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5455f37-0039-4c94-9b04-3e04c2f2f9a3 None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:53.547213 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5455f37-0039-4c94-9b04-3e04c2f2f9a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:53.547497 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5455f37-0039-4c94-9b04-3e04c2f2f9a3 None admin] PATH_INFO: `/v3/services` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:53.548266 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5455f37-0039-4c94-9b04-3e04c2f2f9a3 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:53.549179 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5455f37-0039-4c94-9b04-3e04c2f2f9a3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:53.551282 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5455f37-0039-4c94-9b04-3e04c2f2f9a3 None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:53.557468 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 648/1299] 10.222.0.70 () {56 vars in 1116 bytes} [Mon Jul 11 14:30:53 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:53.563358 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846f5980-1c06-4ae8-af9f-a7459c5b76f3 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:53.595012 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:53.665259 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846f5980-1c06-4ae8-af9f-a7459c5b76f3 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:53.698884 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c713ff-ae14-47f2-ac7a-9f52d86809fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:53.699520 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c713ff-ae14-47f2-ac7a-9f52d86809fc None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:53.699804 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c713ff-ae14-47f2-ac7a-9f52d86809fc None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:53.700080 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c713ff-ae14-47f2-ac7a-9f52d86809fc None admin] PATH_INFO: `/v3/endpoints` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:53.700897 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c713ff-ae14-47f2-ac7a-9f52d86809fc None admin] RBAC: Adding query filter params (interface=public, service_id=fc321cc6698d439b9d809859fe7f974f, region_id=RegionOne) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:53.701215 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c713ff-ae14-47f2-ac7a-9f52d86809fc None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:53.702576 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c713ff-ae14-47f2-ac7a-9f52d86809fc None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:53.707718 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 652/1300] 10.222.0.70 () {56 vars in 1251 bytes} [Mon Jul 11 14:30:53 2022] GET /identity/v3/endpoints?service_id=fc321cc6698d439b9d809859fe7f974f&interface=public®ion_id=RegionOne => generated 194 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:53.713361 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5455f37-0039-4c94-9b04-3e04c2f2f9a3 None admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:53.794646 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:53.813101 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5455f37-0039-4c94-9b04-3e04c2f2f9a3 None admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:53.847128 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca246c08-c48f-4569-9f33-c9827190ed1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:53.847787 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca246c08-c48f-4569-9f33-c9827190ed1e None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:53.848067 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca246c08-c48f-4569-9f33-c9827190ed1e None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:53.848497 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca246c08-c48f-4569-9f33-c9827190ed1e None admin] PATH_INFO: `/v3/services` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:53.849170 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca246c08-c48f-4569-9f33-c9827190ed1e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:53.850518 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca246c08-c48f-4569-9f33-c9827190ed1e None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:53.858656 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 649/1301] 10.222.0.70 () {56 vars in 1087 bytes} [Mon Jul 11 14:30:53 2022] GET /identity/v3/services => generated 2191 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:30:55.895910 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e56277-ccf3-4b20-b7b0-ab222faf3a1e None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:55.896476 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e56277-ccf3-4b20-b7b0-ab222faf3a1e None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:55.896476 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e56277-ccf3-4b20-b7b0-ab222faf3a1e None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:55.897826 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 653/1302] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:30:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:30:55.903232 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a030ad-63d5-4245-9eb7-d80731bca8a9 None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:55.903689 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a030ad-63d5-4245-9eb7-d80731bca8a9 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:55.903786 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a030ad-63d5-4245-9eb7-d80731bca8a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:55.921484 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-e0a030ad-63d5-4245-9eb7-d80731bca8a9 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:30:55.922678 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-e0a030ad-63d5-4245-9eb7-d80731bca8a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:30:55.991894 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 650/1303] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:30:55 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:30:56.015514 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e56277-ccf3-4b20-b7b0-ab222faf3a1e None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:56.109887 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:56.117210 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e56277-ccf3-4b20-b7b0-ab222faf3a1e None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:56.152105 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147a9aba-7169-41e7-acb5-085e395325a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:56.152928 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147a9aba-7169-41e7-acb5-085e395325a6 None admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:56.153208 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147a9aba-7169-41e7-acb5-085e395325a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:56.153483 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147a9aba-7169-41e7-acb5-085e395325a6 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:56.154126 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147a9aba-7169-41e7-acb5-085e395325a6 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:56.155481 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147a9aba-7169-41e7-acb5-085e395325a6 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:56.167500 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application [None req-147a9aba-7169-41e7-acb5-085e395325a6 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 11 14:30:56.167500 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:56.167500 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 14:30:56.167500 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 14:30:56.167500 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 14:30:56.167500 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 14:30:56.167500 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 14:30:56.167500 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:30:56.167500 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 11 14:30:56.167500 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Jul 11 14:30:56.167500 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 14:30:56.167500 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Jul 11 14:30:56.167500 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:30:56.167500 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:30:56.167500 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:30:56.167500 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:30:56.167500 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:30:56.168616 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:30:56.168616 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:30:56.168616 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:30:56.168616 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:30:56.168616 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:30:56.168616 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:30:56.168616 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 14:30:56.168616 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 14:30:56.168616 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 14:30:56.168616 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 14:30:56.168616 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:30:56.168616 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:30:56.168616 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:30:56.168616 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:30:56.168616 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:30:56.168616 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:30:56.169487 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:30:56.169487 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application with Lock( Jul 11 14:30:56.169487 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:30:56.169487 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:30:56.169487 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:30:56.169487 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:30:56.169487 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:30:56.169487 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:30:56.169487 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:30:56.169487 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:30:56.169487 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 14:30:56.169487 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:30:56.169487 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 11 14:30:56.169487 dv-cinder-master-3-smb devstack@keystone.service[80535]: ERROR keystone.server.flask.application Jul 11 14:30:56.169487 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 654/1304] 10.222.0.70 () {56 vars in 1117 bytes} [Mon Jul 11 14:30:56 2022] GET /identity/v3/services/placement => generated 90 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:30:56.175328 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a030ad-63d5-4245-9eb7-d80731bca8a9 None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:56.253607 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:56.277959 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a030ad-63d5-4245-9eb7-d80731bca8a9 None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:56.312343 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a440800-5417-4f13-893a-86c0d2b1042c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:56.313005 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a440800-5417-4f13-893a-86c0d2b1042c None admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:56.313288 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a440800-5417-4f13-893a-86c0d2b1042c None admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:56.313562 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a440800-5417-4f13-893a-86c0d2b1042c None admin] PATH_INFO: `/v3/services` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:56.315452 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a440800-5417-4f13-893a-86c0d2b1042c None admin] RBAC: Adding query filter params (name=placement) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:30:56.315756 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a440800-5417-4f13-893a-86c0d2b1042c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:56.317150 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a440800-5417-4f13-893a-86c0d2b1042c None admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:56.322357 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 651/1305] 10.222.0.70 () {56 vars in 1116 bytes} [Mon Jul 11 14:30:56 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:30:56.328335 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147a9aba-7169-41e7-acb5-085e395325a6 None admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:56.437994 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147a9aba-7169-41e7-acb5-085e395325a6 None admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:56.473525 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f3239f-b962-40e8-af73-1802284c5911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:56.474183 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f3239f-b962-40e8-af73-1802284c5911 None admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:56.474470 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f3239f-b962-40e8-af73-1802284c5911 None admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:56.474748 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f3239f-b962-40e8-af73-1802284c5911 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:56.475487 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f3239f-b962-40e8-af73-1802284c5911 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:56.477030 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f3239f-b962-40e8-af73-1802284c5911 None admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:56.496472 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 655/1306] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Jul 11 14:30:56 2022] POST /identity/v3/endpoints => generated 331 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:31:06.319301 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=30 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:31:06.491562 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:03.259202 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec8c318-5706-4c7a-a518-9c1bf5599539 None None] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:03.260332 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec8c318-5706-4c7a-a518-9c1bf5599539 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:03.260822 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec8c318-5706-4c7a-a518-9c1bf5599539 None None] PATH_INFO: `/` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:03.263152 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 652/1307] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:32:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:32:03.269578 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae0efdb-b06a-4c70-81e0-fd812398f083 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:03.270080 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae0efdb-b06a-4c70-81e0-fd812398f083 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:03.270080 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae0efdb-b06a-4c70-81e0-fd812398f083 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:03.419255 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-6ae0efdb-b06a-4c70-81e0-fd812398f083 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:32:03.420977 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-6ae0efdb-b06a-4c70-81e0-fd812398f083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:32:03.666827 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 656/1308] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:32:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 398 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:32:03.749213 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c289d9-5f24-4b0f-8421-ff413c921e5d None None] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:03.749768 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c289d9-5f24-4b0f-8421-ff413c921e5d None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:03.750248 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c289d9-5f24-4b0f-8421-ff413c921e5d None None] PATH_INFO: `/` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:03.751845 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 653/1309] 10.222.0.70 () {54 vars in 964 bytes} [Mon Jul 11 14:32:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:32:03.758622 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c178f56-cf37-4016-89b8-01ed18617987 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:03.758928 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c178f56-cf37-4016-89b8-01ed18617987 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:03.759214 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c178f56-cf37-4016-89b8-01ed18617987 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:03.939813 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-7c178f56-cf37-4016-89b8-01ed18617987 None None] MFA Rules not processed for user `20eede5ccd834862b00123310b5c3975`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:32:03.945435 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-7c178f56-cf37-4016-89b8-01ed18617987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:32:03.996981 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:04.077878 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 657/1310] 10.222.0.70 () {58 vars in 1061 bytes} [Mon Jul 11 14:32:03 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:32:04.087625 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c289d9-5f24-4b0f-8421-ff413c921e5d None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:04.089424 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-b5c289d9-5f24-4b0f-8421-ff413c921e5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:32:04.363657 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c289d9-5f24-4b0f-8421-ff413c921e5d None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:04.507961 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8ecf65-cf0b-4bc0-b210-d72279c30d9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20eede5ccd834862b00123310b5c3975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:04.509084 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8ecf65-cf0b-4bc0-b210-d72279c30d9d service neutron] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:04.509709 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8ecf65-cf0b-4bc0-b210-d72279c30d9d service neutron] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:04.510143 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8ecf65-cf0b-4bc0-b210-d72279c30d9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:04.512128 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-6b8ecf65-cf0b-4bc0-b210-d72279c30d9d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:32:04.592142 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:04.673794 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8ecf65-cf0b-4bc0-b210-d72279c30d9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:04.675607 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8ecf65-cf0b-4bc0-b210-d72279c30d9d service neutron] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:04.699565 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 654/1311] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:32:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 612 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:32:07.464136 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0ef2b3-bee2-4cbd-8bf6-309e406e670e None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:07.464779 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0ef2b3-bee2-4cbd-8bf6-309e406e670e None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:07.464779 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0ef2b3-bee2-4cbd-8bf6-309e406e670e None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:07.467574 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 658/1312] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:32:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:32:07.473564 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f625e1-23d8-4cb8-bc35-faf8793a3d78 None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:07.474110 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f625e1-23d8-4cb8-bc35-faf8793a3d78 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:07.474110 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f625e1-23d8-4cb8-bc35-faf8793a3d78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:07.575923 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-21f625e1-23d8-4cb8-bc35-faf8793a3d78 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:32:07.576708 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-21f625e1-23d8-4cb8-bc35-faf8793a3d78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:32:07.693954 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 655/1313] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:32:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:32:07.734283 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0ef2b3-bee2-4cbd-8bf6-309e406e670e None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:07.735932 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-df0ef2b3-bee2-4cbd-8bf6-309e406e670e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:32:07.883008 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0ef2b3-bee2-4cbd-8bf6-309e406e670e None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:07.969350 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:07.972447 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab07392-c5b4-43e3-9d17-0456066e0de2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20eede5ccd834862b00123310b5c3975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:07.973301 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab07392-c5b4-43e3-9d17-0456066e0de2 service neutron] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:07.973650 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab07392-c5b4-43e3-9d17-0456066e0de2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:07.973937 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab07392-c5b4-43e3-9d17-0456066e0de2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:07.976276 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-bab07392-c5b4-43e3-9d17-0456066e0de2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:32:08.105954 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab07392-c5b4-43e3-9d17-0456066e0de2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:08.107745 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab07392-c5b4-43e3-9d17-0456066e0de2 service neutron] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:08.127470 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 659/1314] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:32:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:32:10.594698 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c268fa-70c0-417d-94c2-5b1bf1f93e7e None None] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:10.595264 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c268fa-70c0-417d-94c2-5b1bf1f93e7e None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:10.595264 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c268fa-70c0-417d-94c2-5b1bf1f93e7e None None] PATH_INFO: `/` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:10.596697 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 656/1315] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:32:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:32:10.602467 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e28c8af-1d77-419d-9de5-6fffc4997905 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:10.602960 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e28c8af-1d77-419d-9de5-6fffc4997905 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:10.603047 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e28c8af-1d77-419d-9de5-6fffc4997905 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:10.676554 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-1e28c8af-1d77-419d-9de5-6fffc4997905 None None] MFA Rules not processed for user `9196d98d4897499d92e1ce81c2f9bdf8`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:32:10.677796 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-1e28c8af-1d77-419d-9de5-6fffc4997905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:32:10.734260 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:10.781636 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 660/1316] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:32:10 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:32:10.821897 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c268fa-70c0-417d-94c2-5b1bf1f93e7e None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:10.823786 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-25c268fa-70c0-417d-94c2-5b1bf1f93e7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:32:10.834688 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:10.930586 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c268fa-70c0-417d-94c2-5b1bf1f93e7e None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:11.005560 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028c15a6-44f9-40e1-a183-80eb6021a34b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20eede5ccd834862b00123310b5c3975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:11.006215 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028c15a6-44f9-40e1-a183-80eb6021a34b service neutron] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:11.006500 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028c15a6-44f9-40e1-a183-80eb6021a34b service neutron] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:11.006794 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028c15a6-44f9-40e1-a183-80eb6021a34b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:11.008820 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-028c15a6-44f9-40e1-a183-80eb6021a34b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:32:11.085320 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:11.133487 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028c15a6-44f9-40e1-a183-80eb6021a34b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:11.134938 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028c15a6-44f9-40e1-a183-80eb6021a34b service neutron] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:11.154826 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 657/1317] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:32:10 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:32:13.826586 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1276d81-2da1-40f4-8bf2-28b227d66676 None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:13.827095 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1276d81-2da1-40f4-8bf2-28b227d66676 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:13.827095 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1276d81-2da1-40f4-8bf2-28b227d66676 None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:13.828482 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 661/1318] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:32:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:32:13.833905 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95ea0f5-7add-4cb2-a305-2ccceb26c132 None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:13.834331 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95ea0f5-7add-4cb2-a305-2ccceb26c132 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:13.834426 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95ea0f5-7add-4cb2-a305-2ccceb26c132 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:13.909265 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-b95ea0f5-7add-4cb2-a305-2ccceb26c132 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:32:13.910504 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-b95ea0f5-7add-4cb2-a305-2ccceb26c132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:32:14.008033 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 658/1319] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:32:13 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:32:14.060759 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4690fb-7fcd-4644-ac66-abdb6631ad4b None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:14.061158 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4690fb-7fcd-4644-ac66-abdb6631ad4b None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:14.061442 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4690fb-7fcd-4644-ac66-abdb6631ad4b None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:14.062858 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 662/1320] 10.222.0.70 () {54 vars in 964 bytes} [Mon Jul 11 14:32:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:32:14.068813 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a84421-a60d-4084-929d-82672219f653 None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:14.069109 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a84421-a60d-4084-929d-82672219f653 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:14.069425 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a84421-a60d-4084-929d-82672219f653 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:14.090624 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:14.148064 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-31a84421-a60d-4084-929d-82672219f653 None None] MFA Rules not processed for user `20eede5ccd834862b00123310b5c3975`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:32:14.149230 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-31a84421-a60d-4084-929d-82672219f653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:32:14.226852 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 659/1321] 10.222.0.70 () {58 vars in 1061 bytes} [Mon Jul 11 14:32:14 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:32:14.236356 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4690fb-7fcd-4644-ac66-abdb6631ad4b None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:14.237900 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-6a4690fb-7fcd-4644-ac66-abdb6631ad4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:32:14.343860 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4690fb-7fcd-4644-ac66-abdb6631ad4b None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:14.418189 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08a1f46-c777-47ae-9c0d-01c2210e3975 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20eede5ccd834862b00123310b5c3975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:14.419338 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08a1f46-c777-47ae-9c0d-01c2210e3975 service neutron] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:14.419629 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08a1f46-c777-47ae-9c0d-01c2210e3975 service neutron] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:14.419902 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08a1f46-c777-47ae-9c0d-01c2210e3975 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:14.421593 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-e08a1f46-c777-47ae-9c0d-01c2210e3975 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:32:14.430353 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:14.532227 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08a1f46-c777-47ae-9c0d-01c2210e3975 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:14.533686 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08a1f46-c777-47ae-9c0d-01c2210e3975 service neutron] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:14.552682 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 663/1322] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:32:14 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:32:17.870278 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7e1a52-233d-420b-b7e2-63e08dedae97 None None] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:17.870931 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7e1a52-233d-420b-b7e2-63e08dedae97 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:17.871038 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7e1a52-233d-420b-b7e2-63e08dedae97 None None] PATH_INFO: `/` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:17.873177 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 660/1323] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:32:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:32:17.880652 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f2e526-4311-42d4-8451-7464ef2ab793 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:17.882728 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f2e526-4311-42d4-8451-7464ef2ab793 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:17.882728 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f2e526-4311-42d4-8451-7464ef2ab793 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:17.961246 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-81f2e526-4311-42d4-8451-7464ef2ab793 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:32:17.962482 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-81f2e526-4311-42d4-8451-7464ef2ab793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:32:18.027239 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:18.089997 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 664/1324] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:32:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:32:18.129477 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7e1a52-233d-420b-b7e2-63e08dedae97 None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:18.131057 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-1e7e1a52-233d-420b-b7e2-63e08dedae97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:32:18.266427 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7e1a52-233d-420b-b7e2-63e08dedae97 None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:18.281345 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:18.358047 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3a8912-07f0-47c7-abc6-8d69c91b54d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20eede5ccd834862b00123310b5c3975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:18.358864 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3a8912-07f0-47c7-abc6-8d69c91b54d0 service neutron] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:18.359359 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3a8912-07f0-47c7-abc6-8d69c91b54d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:18.359857 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3a8912-07f0-47c7-abc6-8d69c91b54d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:18.362915 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-ea3a8912-07f0-47c7-abc6-8d69c91b54d0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:32:18.493358 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3a8912-07f0-47c7-abc6-8d69c91b54d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:18.494761 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3a8912-07f0-47c7-abc6-8d69c91b54d0 service neutron] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:18.518186 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 661/1325] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:32:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:32:20.741536 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af298c30-ec01-4ff1-b7e3-c613827b55ae None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:20.742142 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af298c30-ec01-4ff1-b7e3-c613827b55ae None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:20.742304 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af298c30-ec01-4ff1-b7e3-c613827b55ae None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:20.744465 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 665/1326] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:32:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:32:20.753126 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3a4a96-92d7-4167-a6fa-3ba007a4b0c8 None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:20.753664 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3a4a96-92d7-4167-a6fa-3ba007a4b0c8 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:20.753821 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3a4a96-92d7-4167-a6fa-3ba007a4b0c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:20.805587 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:20.826055 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-8a3a4a96-92d7-4167-a6fa-3ba007a4b0c8 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:32:20.827469 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-8a3a4a96-92d7-4167-a6fa-3ba007a4b0c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:32:20.937752 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 662/1327] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:32:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:32:20.975211 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af298c30-ec01-4ff1-b7e3-c613827b55ae None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:20.975211 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-af298c30-ec01-4ff1-b7e3-c613827b55ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:32:21.096954 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af298c30-ec01-4ff1-b7e3-c613827b55ae None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:21.199243 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9acb58-f2a8-40cf-a55b-0c845dd2b7cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20eede5ccd834862b00123310b5c3975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:21.199908 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9acb58-f2a8-40cf-a55b-0c845dd2b7cf service neutron] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:21.200188 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9acb58-f2a8-40cf-a55b-0c845dd2b7cf service neutron] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:21.200497 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9acb58-f2a8-40cf-a55b-0c845dd2b7cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:21.202711 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-ad9acb58-f2a8-40cf-a55b-0c845dd2b7cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:32:21.221451 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:21.347928 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9acb58-f2a8-40cf-a55b-0c845dd2b7cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:21.349521 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9acb58-f2a8-40cf-a55b-0c845dd2b7cf service neutron] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:21.371592 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 666/1328] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:32:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:32:23.595645 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac93cb7-6fac-4068-ba1c-8c22194e1ad4 None None] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:23.596263 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac93cb7-6fac-4068-ba1c-8c22194e1ad4 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:23.596263 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac93cb7-6fac-4068-ba1c-8c22194e1ad4 None None] PATH_INFO: `/` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:23.597614 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 663/1329] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:32:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:32:23.603290 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac7aef2-188c-4c99-8d10-4c223a300b5f None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:23.603763 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac7aef2-188c-4c99-8d10-4c223a300b5f None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:23.603858 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac7aef2-188c-4c99-8d10-4c223a300b5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:23.676352 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-2ac7aef2-188c-4c99-8d10-4c223a300b5f None None] MFA Rules not processed for user `9196d98d4897499d92e1ce81c2f9bdf8`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:32:23.677648 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-2ac7aef2-188c-4c99-8d10-4c223a300b5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:32:23.755514 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:23.792016 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 667/1330] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:32:23 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:32:23.830080 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac93cb7-6fac-4068-ba1c-8c22194e1ad4 None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:23.831682 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-cac93cb7-6fac-4068-ba1c-8c22194e1ad4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:32:23.946978 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac93cb7-6fac-4068-ba1c-8c22194e1ad4 None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:23.968578 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:24.026322 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70a2876-8541-474c-8406-aeb7c80f95cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20eede5ccd834862b00123310b5c3975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:24.026981 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70a2876-8541-474c-8406-aeb7c80f95cc service neutron] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:24.027268 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70a2876-8541-474c-8406-aeb7c80f95cc service neutron] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:24.027547 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70a2876-8541-474c-8406-aeb7c80f95cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:24.029796 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-c70a2876-8541-474c-8406-aeb7c80f95cc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:32:24.214914 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70a2876-8541-474c-8406-aeb7c80f95cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:24.216551 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70a2876-8541-474c-8406-aeb7c80f95cc service neutron] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:24.238845 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 664/1331] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:32:23 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:32:26.716518 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fbe96e-e534-44a0-a524-4971e9119428 None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:26.717094 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fbe96e-e534-44a0-a524-4971e9119428 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:26.717094 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fbe96e-e534-44a0-a524-4971e9119428 None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:26.718467 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 668/1332] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:32:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:32:26.725598 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce93ce5-e6ce-42e4-bfaf-89d47728936a None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:26.726095 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce93ce5-e6ce-42e4-bfaf-89d47728936a None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:26.726194 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce93ce5-e6ce-42e4-bfaf-89d47728936a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:26.797317 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:26.801489 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-fce93ce5-e6ce-42e4-bfaf-89d47728936a None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:32:26.802959 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-fce93ce5-e6ce-42e4-bfaf-89d47728936a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:32:26.946549 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 665/1333] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:32:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:32:26.984821 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fbe96e-e534-44a0-a524-4971e9119428 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:26.986424 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-a8fbe96e-e534-44a0-a524-4971e9119428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:32:27.112310 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fbe96e-e534-44a0-a524-4971e9119428 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:27.204731 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91885a64-fc6d-4c5a-977d-c0e5af36703e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20eede5ccd834862b00123310b5c3975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:27.205543 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91885a64-fc6d-4c5a-977d-c0e5af36703e service neutron] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:27.205890 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91885a64-fc6d-4c5a-977d-c0e5af36703e service neutron] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:27.206349 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91885a64-fc6d-4c5a-977d-c0e5af36703e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:27.208172 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-91885a64-fc6d-4c5a-977d-c0e5af36703e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:32:27.241324 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:27.342979 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91885a64-fc6d-4c5a-977d-c0e5af36703e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:27.344485 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91885a64-fc6d-4c5a-977d-c0e5af36703e service neutron] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:27.364712 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 669/1334] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:32:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:32:29.541801 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6292ba30-a6a2-41f1-9c21-fdee357b098a None None] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:29.542397 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6292ba30-a6a2-41f1-9c21-fdee357b098a None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:29.542397 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6292ba30-a6a2-41f1-9c21-fdee357b098a None None] PATH_INFO: `/` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:29.543783 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 666/1335] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:32:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:32:29.552020 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6f8c19-8579-457f-98ae-85177425c31f None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:29.552623 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6f8c19-8579-457f-98ae-85177425c31f None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:29.552623 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6f8c19-8579-457f-98ae-85177425c31f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:29.629512 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-0f6f8c19-8579-457f-98ae-85177425c31f None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:32:29.630760 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-0f6f8c19-8579-457f-98ae-85177425c31f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:32:29.718025 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:29.744415 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 670/1336] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:32:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:32:29.792394 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6292ba30-a6a2-41f1-9c21-fdee357b098a None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:29.793858 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-6292ba30-a6a2-41f1-9c21-fdee357b098a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:32:29.920865 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6292ba30-a6a2-41f1-9c21-fdee357b098a None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:29.952721 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:30.005493 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c2638e-54f1-4e93-807b-8155897f648d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20eede5ccd834862b00123310b5c3975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:30.006148 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c2638e-54f1-4e93-807b-8155897f648d service neutron] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:30.006426 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c2638e-54f1-4e93-807b-8155897f648d service neutron] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:30.006698 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c2638e-54f1-4e93-807b-8155897f648d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:30.008405 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-b9c2638e-54f1-4e93-807b-8155897f648d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:32:30.141630 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c2638e-54f1-4e93-807b-8155897f648d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:30.143130 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c2638e-54f1-4e93-807b-8155897f648d service neutron] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:30.165932 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 667/1337] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:32:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:32:32.697272 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de524c2-81bc-454e-abd4-522eba904531 None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:32.697848 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de524c2-81bc-454e-abd4-522eba904531 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:32.697848 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de524c2-81bc-454e-abd4-522eba904531 None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:32.699293 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 671/1338] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:32:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:32:32.706475 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb6005d-87d8-46cc-a10b-3c0f35d63f4c None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:32.707048 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb6005d-87d8-46cc-a10b-3c0f35d63f4c None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:32.707048 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb6005d-87d8-46cc-a10b-3c0f35d63f4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:32.781012 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-bcb6005d-87d8-46cc-a10b-3c0f35d63f4c None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:32:32.782233 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-bcb6005d-87d8-46cc-a10b-3c0f35d63f4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:32:32.790748 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:32.893261 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 668/1339] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:32:32 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:32:32.933957 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de524c2-81bc-454e-abd4-522eba904531 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:32.935479 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-7de524c2-81bc-454e-abd4-522eba904531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:32:33.040891 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de524c2-81bc-454e-abd4-522eba904531 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:33.114754 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed098a51-358d-40c4-bbeb-576fb0247c27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20eede5ccd834862b00123310b5c3975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:33.115407 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed098a51-358d-40c4-bbeb-576fb0247c27 service neutron] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:33.115695 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed098a51-358d-40c4-bbeb-576fb0247c27 service neutron] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:33.115979 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed098a51-358d-40c4-bbeb-576fb0247c27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:33.117682 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-ed098a51-358d-40c4-bbeb-576fb0247c27 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:32:33.155048 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:33.231050 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed098a51-358d-40c4-bbeb-576fb0247c27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:33.232515 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed098a51-358d-40c4-bbeb-576fb0247c27 service neutron] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:33.257514 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 672/1340] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:32:32 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:32:37.929705 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c08358-46bb-46bf-9e6b-9a0f6e13c3a1 None None] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:37.930452 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c08358-46bb-46bf-9e6b-9a0f6e13c3a1 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:37.930452 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c08358-46bb-46bf-9e6b-9a0f6e13c3a1 None None] PATH_INFO: `/` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:37.931904 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 669/1341] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:32:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 14:32:37.938696 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f51a3a0-c5a2-452a-9891-ff1c2ec89dfa None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:37.939263 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f51a3a0-c5a2-452a-9891-ff1c2ec89dfa None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:37.939821 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f51a3a0-c5a2-452a-9891-ff1c2ec89dfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:38.050759 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-0f51a3a0-c5a2-452a-9891-ff1c2ec89dfa None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:32:38.052108 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-0f51a3a0-c5a2-452a-9891-ff1c2ec89dfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:32:38.206290 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:38.230080 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 673/1342] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:32:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:32:38.297033 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c08358-46bb-46bf-9e6b-9a0f6e13c3a1 None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:38.298593 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-b1c08358-46bb-46bf-9e6b-9a0f6e13c3a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:32:38.482346 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c08358-46bb-46bf-9e6b-9a0f6e13c3a1 None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:38.546544 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:38.597715 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1062bfba-a594-4432-a108-a8fc314046a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20eede5ccd834862b00123310b5c3975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:38.598375 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1062bfba-a594-4432-a108-a8fc314046a3 service neutron] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:38.598659 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1062bfba-a594-4432-a108-a8fc314046a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:38.598940 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1062bfba-a594-4432-a108-a8fc314046a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:38.600693 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-1062bfba-a594-4432-a108-a8fc314046a3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:32:38.736886 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1062bfba-a594-4432-a108-a8fc314046a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:38.738267 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1062bfba-a594-4432-a108-a8fc314046a3 service neutron] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:38.765455 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 670/1343] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:32:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:32:41.644676 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66037565-8a5f-4f84-9b69-8b570a86f0ed None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:41.645214 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66037565-8a5f-4f84-9b69-8b570a86f0ed None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:41.645214 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66037565-8a5f-4f84-9b69-8b570a86f0ed None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:41.646634 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 674/1344] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:32:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:32:41.652532 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d302ce62-27fc-4c61-ab0e-1b289573633c None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:41.652983 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d302ce62-27fc-4c61-ab0e-1b289573633c None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:41.653093 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d302ce62-27fc-4c61-ab0e-1b289573633c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:41.723246 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-d302ce62-27fc-4c61-ab0e-1b289573633c None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:32:41.724509 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-d302ce62-27fc-4c61-ab0e-1b289573633c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:32:41.744073 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:41.834376 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 671/1345] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:32:41 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:32:41.875468 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66037565-8a5f-4f84-9b69-8b570a86f0ed None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:41.877490 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-66037565-8a5f-4f84-9b69-8b570a86f0ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:32:42.018203 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66037565-8a5f-4f84-9b69-8b570a86f0ed None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:42.103267 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ccea0b-a6aa-4344-b33d-cc438875804b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20eede5ccd834862b00123310b5c3975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:42.103821 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ccea0b-a6aa-4344-b33d-cc438875804b service neutron] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:42.104104 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ccea0b-a6aa-4344-b33d-cc438875804b service neutron] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:42.104406 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ccea0b-a6aa-4344-b33d-cc438875804b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:42.106087 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-44ccea0b-a6aa-4344-b33d-cc438875804b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:32:42.156663 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:42.240924 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ccea0b-a6aa-4344-b33d-cc438875804b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:42.242379 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ccea0b-a6aa-4344-b33d-cc438875804b service neutron] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:42.262450 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 675/1346] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:32:41 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:32:47.189043 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db19b587-b89b-49ea-bae1-d22cc6f02d57 None None] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:47.189635 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db19b587-b89b-49ea-bae1-d22cc6f02d57 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:47.189635 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db19b587-b89b-49ea-bae1-d22cc6f02d57 None None] PATH_INFO: `/` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:47.191343 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 672/1347] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:32:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:32:47.197986 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97efae18-39bc-45a1-a6b1-1c61d0351395 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:47.198769 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97efae18-39bc-45a1-a6b1-1c61d0351395 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:47.198769 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97efae18-39bc-45a1-a6b1-1c61d0351395 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:47.284098 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-97efae18-39bc-45a1-a6b1-1c61d0351395 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:32:47.285871 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-97efae18-39bc-45a1-a6b1-1c61d0351395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:32:47.413923 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:47.420532 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 676/1348] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:32:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:32:47.465658 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db19b587-b89b-49ea-bae1-d22cc6f02d57 None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:47.467607 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-db19b587-b89b-49ea-bae1-d22cc6f02d57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:32:47.607207 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db19b587-b89b-49ea-bae1-d22cc6f02d57 None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:47.668852 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:47.706217 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0afc9e-7aa5-4eed-947b-16a202e865b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20eede5ccd834862b00123310b5c3975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:47.706974 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0afc9e-7aa5-4eed-947b-16a202e865b0 service neutron] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:47.707337 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0afc9e-7aa5-4eed-947b-16a202e865b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:47.707628 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0afc9e-7aa5-4eed-947b-16a202e865b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:47.709505 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-6c0afc9e-7aa5-4eed-947b-16a202e865b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:32:47.871019 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0afc9e-7aa5-4eed-947b-16a202e865b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:47.872950 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0afc9e-7aa5-4eed-947b-16a202e865b0 service neutron] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:47.896857 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 673/1349] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:32:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:32:53.615931 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c638f7c-918a-4bcd-bf07-aaf2f8defccc None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:53.616491 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c638f7c-918a-4bcd-bf07-aaf2f8defccc None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:53.618008 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c638f7c-918a-4bcd-bf07-aaf2f8defccc None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:53.620193 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 677/1350] 10.222.0.70 () {54 vars in 921 bytes} [Mon Jul 11 14:32:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:32:53.627373 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10da76d1-e072-404b-8835-19e37940ad94 None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:53.630381 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10da76d1-e072-404b-8835-19e37940ad94 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:53.630894 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10da76d1-e072-404b-8835-19e37940ad94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:53.831807 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-10da76d1-e072-404b-8835-19e37940ad94 None None] MFA Rules not processed for user `4bf25c7951dc4182996335ca1f0e56ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:32:53.833706 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-10da76d1-e072-404b-8835-19e37940ad94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:32:53.883331 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:54.076343 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 674/1351] 10.222.0.70 () {58 vars in 1018 bytes} [Mon Jul 11 14:32:53 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 451 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:32:58.875270 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69e9aa8-01fc-44be-af71-69deed1db0e0 None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:58.877334 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69e9aa8-01fc-44be-af71-69deed1db0e0 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:58.877849 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69e9aa8-01fc-44be-af71-69deed1db0e0 None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:58.881341 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 678/1352] 10.222.0.70 () {54 vars in 921 bytes} [Mon Jul 11 14:32:58 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:32:58.888265 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbab4b6-54e4-4fad-9e14-ab04e4b6066f None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:58.889926 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbab4b6-54e4-4fad-9e14-ab04e4b6066f None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:58.890278 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbab4b6-54e4-4fad-9e14-ab04e4b6066f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:58.978883 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-6cbab4b6-54e4-4fad-9e14-ab04e4b6066f None None] MFA Rules not processed for user `4bf25c7951dc4182996335ca1f0e56ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:32:58.980098 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-6cbab4b6-54e4-4fad-9e14-ab04e4b6066f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:32:59.067618 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:59.111853 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 675/1353] 10.222.0.70 () {58 vars in 1018 bytes} [Mon Jul 11 14:32:58 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:33:00.596880 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d4f764-06ea-4889-a16d-e36752defa0e None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:00.597831 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d4f764-06ea-4889-a16d-e36752defa0e None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:00.598119 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d4f764-06ea-4889-a16d-e36752defa0e None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:00.600106 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 679/1354] 10.222.0.70 () {54 vars in 921 bytes} [Mon Jul 11 14:33:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:33:00.605690 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc014a4-a01b-48ac-b65d-98c834fc21c3 None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:00.606225 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc014a4-a01b-48ac-b65d-98c834fc21c3 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:00.606225 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc014a4-a01b-48ac-b65d-98c834fc21c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:00.695518 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-9fc014a4-a01b-48ac-b65d-98c834fc21c3 None None] MFA Rules not processed for user `4bf25c7951dc4182996335ca1f0e56ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:33:00.696805 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-9fc014a4-a01b-48ac-b65d-98c834fc21c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:33:00.818409 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 676/1355] 10.222.0.70 () {58 vars in 1018 bytes} [Mon Jul 11 14:33:00 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:33:04.590765 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e26c6ef-ad14-41a9-b8e2-bbd0ba3ec6ac None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:04.591558 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e26c6ef-ad14-41a9-b8e2-bbd0ba3ec6ac None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:04.591558 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e26c6ef-ad14-41a9-b8e2-bbd0ba3ec6ac None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:04.593468 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 680/1356] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:33:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 14:33:04.603377 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e7e041-6e70-4a37-98c7-97351bed19ae None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:04.603989 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e7e041-6e70-4a37-98c7-97351bed19ae None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:04.604391 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e7e041-6e70-4a37-98c7-97351bed19ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:04.677751 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:04.752804 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-e2e7e041-6e70-4a37-98c7-97351bed19ae None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:33:04.755384 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-e2e7e041-6e70-4a37-98c7-97351bed19ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:33:04.941769 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 677/1357] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:33:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 340 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:33:05.003268 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d8a478-55ee-4076-a0cf-9a517470706e None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:05.003741 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d8a478-55ee-4076-a0cf-9a517470706e None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:05.004449 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d8a478-55ee-4076-a0cf-9a517470706e None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:05.008178 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 681/1358] 10.222.0.70 () {54 vars in 961 bytes} [Mon Jul 11 14:33:04 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:33:05.017708 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d26fd3-362a-4bd0-aeed-798b4cd0ce50 None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:05.019103 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d26fd3-362a-4bd0-aeed-798b4cd0ce50 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:05.019624 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d26fd3-362a-4bd0-aeed-798b4cd0ce50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:05.123357 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-b9d26fd3-362a-4bd0-aeed-798b4cd0ce50 None None] MFA Rules not processed for user `f4f8c0d696af4bd5a205ca8e9110b8cc`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:33:05.124777 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-b9d26fd3-362a-4bd0-aeed-798b4cd0ce50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:33:05.182981 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:05.276605 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 678/1359] 10.222.0.70 () {58 vars in 1058 bytes} [Mon Jul 11 14:33:05 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:33:05.284667 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d8a478-55ee-4076-a0cf-9a517470706e None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:05.286685 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-c8d8a478-55ee-4076-a0cf-9a517470706e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:33:05.454012 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d8a478-55ee-4076-a0cf-9a517470706e None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:05.533767 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:05.578533 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2571a4-ca8f-4f86-8d41-962b870e1c31 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4f8c0d696af4bd5a205ca8e9110b8cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:05.579508 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2571a4-ca8f-4f86-8d41-962b870e1c31 service nova] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:05.579826 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2571a4-ca8f-4f86-8d41-962b870e1c31 service nova] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:05.580062 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2571a4-ca8f-4f86-8d41-962b870e1c31 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:05.581751 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-ef2571a4-ca8f-4f86-8d41-962b870e1c31 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:33:05.679849 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2571a4-ca8f-4f86-8d41-962b870e1c31 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:05.681552 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2571a4-ca8f-4f86-8d41-962b870e1c31 service nova] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:05.716310 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 682/1360] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:33:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:33:08.140687 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f7f31f-98f0-431e-9db9-4608b4dc9a7c None None] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:08.141244 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f7f31f-98f0-431e-9db9-4608b4dc9a7c None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:08.141244 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f7f31f-98f0-431e-9db9-4608b4dc9a7c None None] PATH_INFO: `/` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:08.142785 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 679/1361] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:33:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:33:08.148060 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5ab461-43a6-4766-8c47-4d62a24265cb None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:08.148642 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5ab461-43a6-4766-8c47-4d62a24265cb None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:08.148642 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5ab461-43a6-4766-8c47-4d62a24265cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:08.230800 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-bb5ab461-43a6-4766-8c47-4d62a24265cb None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:33:08.232344 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-bb5ab461-43a6-4766-8c47-4d62a24265cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:33:08.287987 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:08.366164 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 683/1362] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:33:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:33:08.413641 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f7f31f-98f0-431e-9db9-4608b4dc9a7c None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:08.415176 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-88f7f31f-98f0-431e-9db9-4608b4dc9a7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:33:08.637983 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f7f31f-98f0-431e-9db9-4608b4dc9a7c None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:08.648890 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:08.779745 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b73d4e8-ccd5-4c3e-97a1-7b57e143c4bd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4f8c0d696af4bd5a205ca8e9110b8cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:08.780831 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b73d4e8-ccd5-4c3e-97a1-7b57e143c4bd service nova] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:08.781265 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b73d4e8-ccd5-4c3e-97a1-7b57e143c4bd service nova] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:08.781669 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b73d4e8-ccd5-4c3e-97a1-7b57e143c4bd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:08.785426 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-2b73d4e8-ccd5-4c3e-97a1-7b57e143c4bd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:33:08.919003 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b73d4e8-ccd5-4c3e-97a1-7b57e143c4bd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:08.920817 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b73d4e8-ccd5-4c3e-97a1-7b57e143c4bd service nova] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:08.949686 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 680/1363] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:33:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 536 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:33:11.531552 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e38710-09ff-4bf9-a02e-3effb01b1c1e None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:11.532142 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e38710-09ff-4bf9-a02e-3effb01b1c1e None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:11.532626 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e38710-09ff-4bf9-a02e-3effb01b1c1e None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:11.535222 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 684/1364] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:33:11 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:33:11.544647 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839e8230-5bcf-4aef-b97e-b7d8e9eaae30 None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:11.545395 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839e8230-5bcf-4aef-b97e-b7d8e9eaae30 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:11.545581 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839e8230-5bcf-4aef-b97e-b7d8e9eaae30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:11.572264 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:11.652515 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-839e8230-5bcf-4aef-b97e-b7d8e9eaae30 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:33:11.654766 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-839e8230-5bcf-4aef-b97e-b7d8e9eaae30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:33:11.805645 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 681/1365] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:33:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:33:11.855178 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760d4b13-dd86-4fd6-ad1a-ed4248b15011 None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:11.855581 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760d4b13-dd86-4fd6-ad1a-ed4248b15011 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:11.855791 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760d4b13-dd86-4fd6-ad1a-ed4248b15011 None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:11.857520 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 685/1366] 10.222.0.70 () {54 vars in 961 bytes} [Mon Jul 11 14:33:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:33:11.864611 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386df9cd-6972-4af7-a6c2-89cba409b0a0 None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:11.865048 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386df9cd-6972-4af7-a6c2-89cba409b0a0 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:11.865426 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386df9cd-6972-4af7-a6c2-89cba409b0a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:11.971951 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-386df9cd-6972-4af7-a6c2-89cba409b0a0 None None] MFA Rules not processed for user `f4f8c0d696af4bd5a205ca8e9110b8cc`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:33:11.973224 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-386df9cd-6972-4af7-a6c2-89cba409b0a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:33:12.020366 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:12.124330 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 682/1367] 10.222.0.70 () {58 vars in 1058 bytes} [Mon Jul 11 14:33:11 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:33:12.132675 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760d4b13-dd86-4fd6-ad1a-ed4248b15011 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:12.134326 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-760d4b13-dd86-4fd6-ad1a-ed4248b15011 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:33:12.317063 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760d4b13-dd86-4fd6-ad1a-ed4248b15011 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:12.343748 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:12.464262 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daf5646-a2c1-4b32-8193-a22fadd021de service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4f8c0d696af4bd5a205ca8e9110b8cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:12.465120 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daf5646-a2c1-4b32-8193-a22fadd021de service nova] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:12.465498 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daf5646-a2c1-4b32-8193-a22fadd021de service nova] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:12.465893 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daf5646-a2c1-4b32-8193-a22fadd021de service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:12.467689 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-4daf5646-a2c1-4b32-8193-a22fadd021de service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:33:12.571382 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4daf5646-a2c1-4b32-8193-a22fadd021de service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:12.573754 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4daf5646-a2c1-4b32-8193-a22fadd021de service nova] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:12.595188 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 686/1368] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:33:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:33:14.010142 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2428e3-b938-4493-8949-c12e26f5a48d None None] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:14.010678 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2428e3-b938-4493-8949-c12e26f5a48d None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:14.010832 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2428e3-b938-4493-8949-c12e26f5a48d None None] PATH_INFO: `/` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:14.012259 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 683/1369] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:33:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:33:14.018817 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2774f5-f317-40fb-9a7b-1152776e0641 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:14.019361 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2774f5-f317-40fb-9a7b-1152776e0641 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:14.019643 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2774f5-f317-40fb-9a7b-1152776e0641 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:14.056966 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:14.116902 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-fd2774f5-f317-40fb-9a7b-1152776e0641 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:33:14.118525 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-fd2774f5-f317-40fb-9a7b-1152776e0641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:33:14.247830 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 687/1370] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:33:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:33:14.677092 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce266c4-e4e6-47bd-be06-c439a7762d13 None None] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:14.677528 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce266c4-e4e6-47bd-be06-c439a7762d13 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:14.677906 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce266c4-e4e6-47bd-be06-c439a7762d13 None None] PATH_INFO: `/` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:14.680679 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 684/1371] 10.222.0.70 () {54 vars in 963 bytes} [Mon Jul 11 14:33:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:33:14.686491 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235bcedb-7353-48e3-a7a8-d015c27ac1ab None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:14.686909 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235bcedb-7353-48e3-a7a8-d015c27ac1ab None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:14.687403 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235bcedb-7353-48e3-a7a8-d015c27ac1ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:14.826448 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-235bcedb-7353-48e3-a7a8-d015c27ac1ab None None] MFA Rules not processed for user `868e7c2dec264512b972c8736d659c34`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:33:14.827699 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-235bcedb-7353-48e3-a7a8-d015c27ac1ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:33:14.844959 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a690546d-f182-4f66-a82f-474581947098 None None] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:14.845420 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a690546d-f182-4f66-a82f-474581947098 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:14.845815 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a690546d-f182-4f66-a82f-474581947098 None None] PATH_INFO: `/` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:14.849802 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 685/1372] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:33:14 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:33:14.858769 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79cc68e-d631-4ae6-b5b0-cc264f03a209 None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:14.859462 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79cc68e-d631-4ae6-b5b0-cc264f03a209 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:14.859862 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79cc68e-d631-4ae6-b5b0-cc264f03a209 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:14.902245 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:14.947923 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 688/1373] 10.222.0.70 () {58 vars in 1060 bytes} [Mon Jul 11 14:33:14 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:33:14.956944 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235bcedb-7353-48e3-a7a8-d015c27ac1ab None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:14.960749 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-a79cc68e-d631-4ae6-b5b0-cc264f03a209 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:33:14.962206 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-a79cc68e-d631-4ae6-b5b0-cc264f03a209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:33:14.965488 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235bcedb-7353-48e3-a7a8-d015c27ac1ab None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:15.071849 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:15.072763 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa96255a-991c-46c3-a4b9-606d1f735dea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '868e7c2dec264512b972c8736d659c34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:15.073734 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa96255a-991c-46c3-a4b9-606d1f735dea service cinder] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:15.074203 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa96255a-991c-46c3-a4b9-606d1f735dea service cinder] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:15.074685 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa96255a-991c-46c3-a4b9-606d1f735dea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:15.077605 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-aa96255a-991c-46c3-a4b9-606d1f735dea service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:33:15.082825 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 686/1374] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:33:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:33:15.137557 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79cc68e-d631-4ae6-b5b0-cc264f03a209 None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:15.138786 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-a79cc68e-d631-4ae6-b5b0-cc264f03a209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:33:15.281270 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa96255a-991c-46c3-a4b9-606d1f735dea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:15.282965 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa96255a-991c-46c3-a4b9-606d1f735dea service cinder] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:15.296290 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:15.310205 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 689/1375] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:33:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:33:15.371905 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79cc68e-d631-4ae6-b5b0-cc264f03a209 None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:15.583601 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:15.598256 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c9b270-4a88-438d-b337-f75495594b40 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4f8c0d696af4bd5a205ca8e9110b8cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:15.598964 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c9b270-4a88-438d-b337-f75495594b40 service nova] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:15.599266 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c9b270-4a88-438d-b337-f75495594b40 service nova] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:15.599568 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c9b270-4a88-438d-b337-f75495594b40 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:15.601370 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-05c9b270-4a88-438d-b337-f75495594b40 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:33:15.707378 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c9b270-4a88-438d-b337-f75495594b40 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:15.710565 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c9b270-4a88-438d-b337-f75495594b40 service nova] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:15.735678 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 687/1376] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:33:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 599 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:33:18.285016 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fc1893-da77-454e-8635-928c3a6f4d83 None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:18.285576 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fc1893-da77-454e-8635-928c3a6f4d83 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:18.285980 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fc1893-da77-454e-8635-928c3a6f4d83 None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:18.288792 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 690/1377] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:33:18 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:33:18.294454 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f1978e-e062-4b80-9399-173ee1d7be8d None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:18.295210 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f1978e-e062-4b80-9399-173ee1d7be8d None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:18.295210 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f1978e-e062-4b80-9399-173ee1d7be8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:18.395613 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-b5f1978e-e062-4b80-9399-173ee1d7be8d None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:33:18.397031 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-b5f1978e-e062-4b80-9399-173ee1d7be8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:33:18.480185 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:18.528934 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 688/1378] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:33:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:33:18.582561 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fc1893-da77-454e-8635-928c3a6f4d83 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:18.586082 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-29fc1893-da77-454e-8635-928c3a6f4d83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:33:18.823653 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fc1893-da77-454e-8635-928c3a6f4d83 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:18.900826 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:18.951826 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d8ec0a-9ec4-46dc-b74d-733699d470bc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4f8c0d696af4bd5a205ca8e9110b8cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:18.952532 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d8ec0a-9ec4-46dc-b74d-733699d470bc service nova] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:18.952811 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d8ec0a-9ec4-46dc-b74d-733699d470bc service nova] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:18.953081 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d8ec0a-9ec4-46dc-b74d-733699d470bc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:18.955270 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-78d8ec0a-9ec4-46dc-b74d-733699d470bc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:33:19.078202 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d8ec0a-9ec4-46dc-b74d-733699d470bc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:19.080245 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d8ec0a-9ec4-46dc-b74d-733699d470bc service nova] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:19.117891 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 691/1379] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:33:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 536 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:33:21.576181 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5439857-e155-4184-a1ee-b4ad3ccca1ad None None] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:21.576952 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5439857-e155-4184-a1ee-b4ad3ccca1ad None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:21.576952 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5439857-e155-4184-a1ee-b4ad3ccca1ad None None] PATH_INFO: `/` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:21.578194 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 689/1380] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:33:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:33:21.584552 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0652778e-db5c-46fe-9d16-dcb8bd665bb0 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:21.585410 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0652778e-db5c-46fe-9d16-dcb8bd665bb0 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:21.585410 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0652778e-db5c-46fe-9d16-dcb8bd665bb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:21.675546 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-0652778e-db5c-46fe-9d16-dcb8bd665bb0 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:33:21.677631 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-0652778e-db5c-46fe-9d16-dcb8bd665bb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:33:21.757756 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:21.888241 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 692/1381] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:33:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:33:21.961112 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5439857-e155-4184-a1ee-b4ad3ccca1ad None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:21.962652 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-a5439857-e155-4184-a1ee-b4ad3ccca1ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:33:22.179477 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5439857-e155-4184-a1ee-b4ad3ccca1ad None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:22.260608 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:22.372237 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f89f25a-9e25-4819-b546-4b2cf92540f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4f8c0d696af4bd5a205ca8e9110b8cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:22.373434 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f89f25a-9e25-4819-b546-4b2cf92540f7 service nova] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:22.373961 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f89f25a-9e25-4819-b546-4b2cf92540f7 service nova] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:22.374486 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f89f25a-9e25-4819-b546-4b2cf92540f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:22.379498 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-3f89f25a-9e25-4819-b546-4b2cf92540f7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:33:22.506912 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f89f25a-9e25-4819-b546-4b2cf92540f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:22.508582 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f89f25a-9e25-4819-b546-4b2cf92540f7 service nova] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:22.530103 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 690/1382] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:33:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 569 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:33:25.083475 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5f5a9e-29fb-45f1-936a-979a3c61e00d None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:25.084192 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5f5a9e-29fb-45f1-936a-979a3c61e00d None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:25.084192 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5f5a9e-29fb-45f1-936a-979a3c61e00d None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:25.085555 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 693/1383] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:33:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:33:25.092079 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f9381a-0932-438f-99d2-9aad8636e5b8 None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:25.092664 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f9381a-0932-438f-99d2-9aad8636e5b8 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:25.092909 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f9381a-0932-438f-99d2-9aad8636e5b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:25.188612 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-38f9381a-0932-438f-99d2-9aad8636e5b8 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:33:25.191849 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-38f9381a-0932-438f-99d2-9aad8636e5b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:33:25.194760 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:25.332714 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 691/1384] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:33:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:33:25.387255 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5f5a9e-29fb-45f1-936a-979a3c61e00d None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:25.390201 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-0d5f5a9e-29fb-45f1-936a-979a3c61e00d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:33:25.645031 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5f5a9e-29fb-45f1-936a-979a3c61e00d None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:25.677455 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:25.797940 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9f0dc8-1a79-4285-9dc1-0a09565242b9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4f8c0d696af4bd5a205ca8e9110b8cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:25.798614 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9f0dc8-1a79-4285-9dc1-0a09565242b9 service nova] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:25.798896 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9f0dc8-1a79-4285-9dc1-0a09565242b9 service nova] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:25.799172 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9f0dc8-1a79-4285-9dc1-0a09565242b9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:25.800905 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-1d9f0dc8-1a79-4285-9dc1-0a09565242b9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:33:25.930514 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9f0dc8-1a79-4285-9dc1-0a09565242b9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:25.933422 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9f0dc8-1a79-4285-9dc1-0a09565242b9 service nova] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:25.960026 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 694/1385] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:33:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 573 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:33:28.525165 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5da81de-84d8-41f2-8baf-b39c04f05581 None None] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:28.525752 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5da81de-84d8-41f2-8baf-b39c04f05581 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:28.525883 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5da81de-84d8-41f2-8baf-b39c04f05581 None None] PATH_INFO: `/` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:28.527612 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 692/1386] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:33:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:33:28.535139 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf8abef-92eb-4b9f-b5c2-efac879b51ac None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:28.535653 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf8abef-92eb-4b9f-b5c2-efac879b51ac None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:28.535912 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf8abef-92eb-4b9f-b5c2-efac879b51ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:28.570456 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:28.636588 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-bdf8abef-92eb-4b9f-b5c2-efac879b51ac None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:33:28.638447 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-bdf8abef-92eb-4b9f-b5c2-efac879b51ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:33:28.803228 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 695/1387] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:33:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:33:28.863596 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5da81de-84d8-41f2-8baf-b39c04f05581 None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:28.865620 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-b5da81de-84d8-41f2-8baf-b39c04f05581 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:33:29.071176 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:29.095276 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5da81de-84d8-41f2-8baf-b39c04f05581 None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:29.278254 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297ea72c-e664-4b2f-9331-0215ad79042f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4f8c0d696af4bd5a205ca8e9110b8cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:29.280187 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297ea72c-e664-4b2f-9331-0215ad79042f service nova] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:29.280765 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297ea72c-e664-4b2f-9331-0215ad79042f service nova] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:29.281319 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297ea72c-e664-4b2f-9331-0215ad79042f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:29.285387 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-297ea72c-e664-4b2f-9331-0215ad79042f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:33:29.448775 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297ea72c-e664-4b2f-9331-0215ad79042f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:29.450756 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297ea72c-e664-4b2f-9331-0215ad79042f service nova] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:29.459754 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:29.490602 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 693/1388] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:33:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 628 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:33:31.801168 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deb7889-8eff-4be9-bdf6-e735d36127bb None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:31.801786 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deb7889-8eff-4be9-bdf6-e735d36127bb None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:31.801786 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deb7889-8eff-4be9-bdf6-e735d36127bb None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:31.803114 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 696/1389] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:33:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 14:33:31.809113 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8834d9cb-e368-4383-b89f-55c333b58db3 None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:31.809579 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8834d9cb-e368-4383-b89f-55c333b58db3 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:31.809737 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8834d9cb-e368-4383-b89f-55c333b58db3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:31.837453 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0340ae-2591-468f-a6d7-936be9c76bd9 None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:31.837668 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0340ae-2591-468f-a6d7-936be9c76bd9 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:31.837923 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0340ae-2591-468f-a6d7-936be9c76bd9 None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:31.839442 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 697/1390] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:33:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 14:33:31.844362 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ef3aa9-2991-41b9-b338-5d28db5e3988 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:31.844652 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ef3aa9-2991-41b9-b338-5d28db5e3988 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:31.844931 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ef3aa9-2991-41b9-b338-5d28db5e3988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:31.887251 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-8834d9cb-e368-4383-b89f-55c333b58db3 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:33:31.888591 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-8834d9cb-e368-4383-b89f-55c333b58db3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:33:31.924311 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-24ef3aa9-2991-41b9-b338-5d28db5e3988 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:33:31.929502 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-24ef3aa9-2991-41b9-b338-5d28db5e3988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:33:31.992872 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:32.005643 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 694/1391] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:33:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:33:32.052875 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8834d9cb-e368-4383-b89f-55c333b58db3 None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:32.054341 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-8834d9cb-e368-4383-b89f-55c333b58db3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:33:32.057395 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 698/1392] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:33:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:33:32.119300 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3622a5af-c6bc-4e6b-9c4b-75ed18855c97 None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:32.119588 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3622a5af-c6bc-4e6b-9c4b-75ed18855c97 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:32.119865 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3622a5af-c6bc-4e6b-9c4b-75ed18855c97 None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:32.121289 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 699/1393] 10.222.0.70 () {54 vars in 962 bytes} [Mon Jul 11 14:33:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 14:33:32.126538 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bc4ff0-6782-47f2-910a-67324b2a466a None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:32.127630 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bc4ff0-6782-47f2-910a-67324b2a466a None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:32.127630 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bc4ff0-6782-47f2-910a-67324b2a466a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:32.136524 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:32.192052 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8834d9cb-e368-4383-b89f-55c333b58db3 None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:32.241357 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-b1bc4ff0-6782-47f2-910a-67324b2a466a None None] MFA Rules not processed for user `fa21b44163d84534b9ca1ffe5b5a6071`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:33:32.242623 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-b1bc4ff0-6782-47f2-910a-67324b2a466a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:33:32.324641 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000fd8f0-1c6e-4ad8-b4a8-33e49261c4c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4f8c0d696af4bd5a205ca8e9110b8cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:32.325315 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000fd8f0-1c6e-4ad8-b4a8-33e49261c4c8 service nova] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:32.325597 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000fd8f0-1c6e-4ad8-b4a8-33e49261c4c8 service nova] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:32.325999 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000fd8f0-1c6e-4ad8-b4a8-33e49261c4c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:32.327745 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-000fd8f0-1c6e-4ad8-b4a8-33e49261c4c8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:33:32.334322 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 700/1394] 10.222.0.70 () {58 vars in 1059 bytes} [Mon Jul 11 14:33:32 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:33:32.342442 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bc4ff0-6782-47f2-910a-67324b2a466a None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:32.351058 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bc4ff0-6782-47f2-910a-67324b2a466a None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:32.402162 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:32.414176 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:32.443011 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000fd8f0-1c6e-4ad8-b4a8-33e49261c4c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:32.444607 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4867ab15-9479-476f-8347-a937bce4ddf3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa21b44163d84534b9ca1ffe5b5a6071', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:32.444790 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000fd8f0-1c6e-4ad8-b4a8-33e49261c4c8 service nova] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:32.445262 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4867ab15-9479-476f-8347-a937bce4ddf3 service glance] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:32.445545 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4867ab15-9479-476f-8347-a937bce4ddf3 service glance] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:32.445813 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4867ab15-9479-476f-8347-a937bce4ddf3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:32.447484 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-4867ab15-9479-476f-8347-a937bce4ddf3 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:33:32.468335 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 695/1395] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:33:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:33:32.600315 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4867ab15-9479-476f-8347-a937bce4ddf3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:32.601757 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4867ab15-9479-476f-8347-a937bce4ddf3 service glance] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:32.628227 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 701/1396] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:33:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:33:33.371167 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e853a5-620f-48f2-8828-1992b159bb25 None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:33.371689 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e853a5-620f-48f2-8828-1992b159bb25 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:33.371689 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e853a5-620f-48f2-8828-1992b159bb25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:33.438742 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-b0e853a5-620f-48f2-8828-1992b159bb25 None None] MFA Rules not processed for user `2ef7b195b623456aa0b12dac0a4bf4d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:33:33.439980 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-b0e853a5-620f-48f2-8828-1992b159bb25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:33:33.528471 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 696/1397] 10.222.0.70 () {58 vars in 1009 bytes} [Mon Jul 11 14:33:33 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:33:33.573517 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4bd3ce-b722-44a8-8ee5-fb1a9f6115ba None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:33.574073 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4bd3ce-b722-44a8-8ee5-fb1a9f6115ba None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:33.574167 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4bd3ce-b722-44a8-8ee5-fb1a9f6115ba None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:33.575635 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 702/1398] 10.222.0.70 () {54 vars in 942 bytes} [Mon Jul 11 14:33:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:33:33.583331 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379f6681-9a83-4ad7-8947-5e5cc76e9e00 None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:33.583711 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379f6681-9a83-4ad7-8947-5e5cc76e9e00 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:33.584004 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379f6681-9a83-4ad7-8947-5e5cc76e9e00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:33.659333 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:33.669446 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-379f6681-9a83-4ad7-8947-5e5cc76e9e00 None None] MFA Rules not processed for user `0217add2f5e74a80a1a33b160cc57a2b`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:33:33.670646 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-379f6681-9a83-4ad7-8947-5e5cc76e9e00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:33:33.796805 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 697/1399] 10.222.0.70 () {58 vars in 1039 bytes} [Mon Jul 11 14:33:33 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:33:33.806569 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4bd3ce-b722-44a8-8ee5-fb1a9f6115ba None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:33.808128 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-8d4bd3ce-b722-44a8-8ee5-fb1a9f6115ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:33:33.886428 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:33.954431 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4bd3ce-b722-44a8-8ee5-fb1a9f6115ba None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:34.063682 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c405eadf-24d2-4a25-9fea-972398157282 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0217add2f5e74a80a1a33b160cc57a2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:34.064246 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c405eadf-24d2-4a25-9fea-972398157282 service swift] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:34.064595 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c405eadf-24d2-4a25-9fea-972398157282 service swift] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:34.065362 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c405eadf-24d2-4a25-9fea-972398157282 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:34.067064 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-c405eadf-24d2-4a25-9fea-972398157282 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:33:34.125009 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:34.157084 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c405eadf-24d2-4a25-9fea-972398157282 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:34.158886 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c405eadf-24d2-4a25-9fea-972398157282 service swift] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:34.167545 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 703/1400] 10.222.0.70 () {60 vars in 1384 bytes} [Mon Jul 11 14:33:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 14:33:34.670260 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f138b09-0234-4fd3-b695-632b413a1e1e None None] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:34.670796 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f138b09-0234-4fd3-b695-632b413a1e1e None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:34.670796 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f138b09-0234-4fd3-b695-632b413a1e1e None None] PATH_INFO: `/` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:34.672186 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 698/1401] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:33:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:33:34.677937 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c24e5e-43db-4f3a-b49b-5e5f0d378799 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:34.678514 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c24e5e-43db-4f3a-b49b-5e5f0d378799 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:34.678514 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c24e5e-43db-4f3a-b49b-5e5f0d378799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:34.772392 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-01c24e5e-43db-4f3a-b49b-5e5f0d378799 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:33:34.773659 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-01c24e5e-43db-4f3a-b49b-5e5f0d378799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:33:34.900361 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 704/1402] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:33:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:33:34.950849 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f138b09-0234-4fd3-b695-632b413a1e1e None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:34.952527 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-8f138b09-0234-4fd3-b695-632b413a1e1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:33:35.092525 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:35.143062 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f138b09-0234-4fd3-b695-632b413a1e1e None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:35.431590 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3253576-4efb-48a9-9355-6f92e4b3efe4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4f8c0d696af4bd5a205ca8e9110b8cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:35.432280 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3253576-4efb-48a9-9355-6f92e4b3efe4 service nova] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:35.432569 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3253576-4efb-48a9-9355-6f92e4b3efe4 service nova] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:35.432846 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3253576-4efb-48a9-9355-6f92e4b3efe4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:35.434732 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-d3253576-4efb-48a9-9355-6f92e4b3efe4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:33:35.545983 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:35.577947 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3253576-4efb-48a9-9355-6f92e4b3efe4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:35.579012 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3253576-4efb-48a9-9355-6f92e4b3efe4 service nova] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:35.612407 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 699/1403] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:33:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 662 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:33:37.799945 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14341875-742b-479d-b895-042c65a26865 None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:37.802370 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14341875-742b-479d-b895-042c65a26865 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:37.803211 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14341875-742b-479d-b895-042c65a26865 None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:37.807575 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 705/1404] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:33:37 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 14:33:37.812773 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a32507a-fe08-4c65-95f4-81e409c73a2b None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:37.816650 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a32507a-fe08-4c65-95f4-81e409c73a2b None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:37.819642 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a32507a-fe08-4c65-95f4-81e409c73a2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:37.902710 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-4a32507a-fe08-4c65-95f4-81e409c73a2b None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:33:37.903940 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-4a32507a-fe08-4c65-95f4-81e409c73a2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:33:38.023004 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 700/1405] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:33:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:33:38.074230 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14341875-742b-479d-b895-042c65a26865 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:38.075766 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-14341875-742b-479d-b895-042c65a26865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:33:38.147803 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:38.265270 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14341875-742b-479d-b895-042c65a26865 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:38.405174 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5f012b-48fc-478d-8fd6-a28ace3f1003 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4f8c0d696af4bd5a205ca8e9110b8cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:38.405946 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5f012b-48fc-478d-8fd6-a28ace3f1003 service nova] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:38.406296 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5f012b-48fc-478d-8fd6-a28ace3f1003 service nova] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:38.406630 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5f012b-48fc-478d-8fd6-a28ace3f1003 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:38.409110 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-4c5f012b-48fc-478d-8fd6-a28ace3f1003 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:33:38.419669 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:38.531801 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5f012b-48fc-478d-8fd6-a28ace3f1003 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:38.534069 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5f012b-48fc-478d-8fd6-a28ace3f1003 service nova] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:38.555062 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 706/1406] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:33:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 482 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:33:41.408221 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d350abbb-afc1-4010-bfa3-7fac02a3bb42 None None] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:41.408868 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d350abbb-afc1-4010-bfa3-7fac02a3bb42 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:41.409161 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d350abbb-afc1-4010-bfa3-7fac02a3bb42 None None] PATH_INFO: `/` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:41.411015 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 701/1407] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:33:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:33:41.419641 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb95c615-e178-4079-aca8-6a3c9241f2ad None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:41.420251 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb95c615-e178-4079-aca8-6a3c9241f2ad None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:41.420603 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb95c615-e178-4079-aca8-6a3c9241f2ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:41.532300 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-eb95c615-e178-4079-aca8-6a3c9241f2ad None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:33:41.533642 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-eb95c615-e178-4079-aca8-6a3c9241f2ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:33:41.640691 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:41.662721 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 707/1408] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:33:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:33:41.709067 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d350abbb-afc1-4010-bfa3-7fac02a3bb42 None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:41.710780 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-d350abbb-afc1-4010-bfa3-7fac02a3bb42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:33:41.792486 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:41.911697 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d350abbb-afc1-4010-bfa3-7fac02a3bb42 None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:42.050918 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eac0891-7507-434f-96d2-f03c521c16b7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4f8c0d696af4bd5a205ca8e9110b8cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:42.051494 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eac0891-7507-434f-96d2-f03c521c16b7 service nova] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:42.051765 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eac0891-7507-434f-96d2-f03c521c16b7 service nova] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:42.052031 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eac0891-7507-434f-96d2-f03c521c16b7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:42.054729 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-4eac0891-7507-434f-96d2-f03c521c16b7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:33:42.068089 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:42.171492 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eac0891-7507-434f-96d2-f03c521c16b7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:42.173133 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eac0891-7507-434f-96d2-f03c521c16b7 service nova] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:42.198009 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 702/1409] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:33:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 489 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:33:51.660797 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=6 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:52.193224 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=39 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:57.584472 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296d3a39-fa52-4f40-b48d-c2c8e1da2774 None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:57.584995 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296d3a39-fa52-4f40-b48d-c2c8e1da2774 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:57.584995 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296d3a39-fa52-4f40-b48d-c2c8e1da2774 None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:57.586393 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 708/1410] 10.222.0.70 () {54 vars in 918 bytes} [Mon Jul 11 14:33:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:33:57.591693 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bd38de-7f2c-41af-8910-ae218f0b64b3 None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:57.592166 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bd38de-7f2c-41af-8910-ae218f0b64b3 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:57.592294 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bd38de-7f2c-41af-8910-ae218f0b64b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:57.673362 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-45bd38de-7f2c-41af-8910-ae218f0b64b3 None None] MFA Rules not processed for user `4bf25c7951dc4182996335ca1f0e56ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:33:57.674572 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-45bd38de-7f2c-41af-8910-ae218f0b64b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:33:57.793226 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 703/1411] 10.222.0.70 () {58 vars in 1015 bytes} [Mon Jul 11 14:33:57 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:33:57.809596 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9be7044-049b-41a9-b974-257fa4b2cb4d None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:57.809885 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9be7044-049b-41a9-b974-257fa4b2cb4d None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:57.810165 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9be7044-049b-41a9-b974-257fa4b2cb4d None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:57.811603 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 709/1412] 10.222.0.70 () {54 vars in 918 bytes} [Mon Jul 11 14:33:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:33:57.818257 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3424d6-c068-41d7-a42f-f9797401fe5a None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:57.818533 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3424d6-c068-41d7-a42f-f9797401fe5a None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:57.818811 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3424d6-c068-41d7-a42f-f9797401fe5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:57.895481 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:57.898397 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-ed3424d6-c068-41d7-a42f-f9797401fe5a None None] MFA Rules not processed for user `f4f8c0d696af4bd5a205ca8e9110b8cc`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:33:57.900258 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-ed3424d6-c068-41d7-a42f-f9797401fe5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:33:58.022822 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 704/1413] 10.222.0.70 () {58 vars in 1015 bytes} [Mon Jul 11 14:33:57 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:34:00.650846 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68dea99-d305-4f77-8f5e-ab468e3a228b None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:00.651409 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68dea99-d305-4f77-8f5e-ab468e3a228b None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:00.651409 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68dea99-d305-4f77-8f5e-ab468e3a228b None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:00.652805 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 710/1414] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 11 14:34:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:34:00.658261 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f09505-f964-425b-ab20-b45f46a14b50 None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:00.658719 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f09505-f964-425b-ab20-b45f46a14b50 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:00.658812 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f09505-f964-425b-ab20-b45f46a14b50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:00.727090 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-43f09505-f964-425b-ab20-b45f46a14b50 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:34:00.728378 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-43f09505-f964-425b-ab20-b45f46a14b50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:34:00.786882 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:00.834366 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 705/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 11 14:34:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:34:00.877696 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68dea99-d305-4f77-8f5e-ab468e3a228b None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:00.880191 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-c68dea99-d305-4f77-8f5e-ab468e3a228b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:34:01.034188 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68dea99-d305-4f77-8f5e-ab468e3a228b None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:01.109637 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:01.156546 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e90e44-9f53-4fa9-8dfe-59c47437969b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4f8c0d696af4bd5a205ca8e9110b8cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:01.156546 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e90e44-9f53-4fa9-8dfe-59c47437969b service nova] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:01.156546 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e90e44-9f53-4fa9-8dfe-59c47437969b service nova] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:01.156546 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e90e44-9f53-4fa9-8dfe-59c47437969b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:01.159512 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-30e90e44-9f53-4fa9-8dfe-59c47437969b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:34:01.250763 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e90e44-9f53-4fa9-8dfe-59c47437969b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:01.252407 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e90e44-9f53-4fa9-8dfe-59c47437969b service nova] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:01.271416 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 711/1416] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:34:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:34:02.197902 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615a6208-a295-4e95-8dac-49278298487a None None] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:02.198454 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615a6208-a295-4e95-8dac-49278298487a None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:02.198454 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615a6208-a295-4e95-8dac-49278298487a None None] PATH_INFO: `/` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:02.199866 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 706/1417] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 11 14:34:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:34:02.205219 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76542037-bfd9-420a-9edb-64dfb98f512a None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:02.205653 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76542037-bfd9-420a-9edb-64dfb98f512a None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:02.205782 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76542037-bfd9-420a-9edb-64dfb98f512a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:02.287455 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-76542037-bfd9-420a-9edb-64dfb98f512a None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:34:02.288717 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-76542037-bfd9-420a-9edb-64dfb98f512a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:34:02.316411 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:02.388642 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 712/1418] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 11 14:34:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:34:02.541467 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615a6208-a295-4e95-8dac-49278298487a None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:02.542894 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-615a6208-a295-4e95-8dac-49278298487a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:34:02.729753 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615a6208-a295-4e95-8dac-49278298487a None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:02.774570 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:02.855796 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea5fd82-58bc-46e8-94cf-eacd50d18b52 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4f8c0d696af4bd5a205ca8e9110b8cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:02.856434 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea5fd82-58bc-46e8-94cf-eacd50d18b52 service nova] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:02.856742 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea5fd82-58bc-46e8-94cf-eacd50d18b52 service nova] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:02.857037 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea5fd82-58bc-46e8-94cf-eacd50d18b52 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:02.858853 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-5ea5fd82-58bc-46e8-94cf-eacd50d18b52 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:34:02.961468 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea5fd82-58bc-46e8-94cf-eacd50d18b52 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:02.963201 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea5fd82-58bc-46e8-94cf-eacd50d18b52 service nova] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:02.983735 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 707/1419] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:34:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:34:03.893007 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d88ea3-31ed-4820-a649-9e0340cd79c4 None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:03.893581 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d88ea3-31ed-4820-a649-9e0340cd79c4 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:03.893581 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d88ea3-31ed-4820-a649-9e0340cd79c4 None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:03.895509 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 713/1420] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 11 14:34:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:34:03.901257 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a69680-f1f6-4437-bc01-346ae3481b13 None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:03.901951 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a69680-f1f6-4437-bc01-346ae3481b13 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:03.901951 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a69680-f1f6-4437-bc01-346ae3481b13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:03.975120 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:04.005445 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-69a69680-f1f6-4437-bc01-346ae3481b13 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:34:04.006826 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-69a69680-f1f6-4437-bc01-346ae3481b13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:34:04.110182 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 708/1421] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 11 14:34:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:34:04.270882 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d88ea3-31ed-4820-a649-9e0340cd79c4 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:04.272448 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-29d88ea3-31ed-4820-a649-9e0340cd79c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:34:04.430408 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d88ea3-31ed-4820-a649-9e0340cd79c4 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:04.445423 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:04.546810 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e573159b-74a9-4528-b613-6f0b7842695b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4f8c0d696af4bd5a205ca8e9110b8cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:04.547364 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e573159b-74a9-4528-b613-6f0b7842695b service nova] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:04.547645 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e573159b-74a9-4528-b613-6f0b7842695b service nova] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:04.547921 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e573159b-74a9-4528-b613-6f0b7842695b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:04.549598 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-e573159b-74a9-4528-b613-6f0b7842695b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:34:04.642598 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e573159b-74a9-4528-b613-6f0b7842695b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:04.645181 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e573159b-74a9-4528-b613-6f0b7842695b service nova] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:04.664708 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 714/1422] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:34:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:34:05.563501 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00412f3d-ac05-49c4-9fd1-22fb7863823e None None] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:05.564044 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00412f3d-ac05-49c4-9fd1-22fb7863823e None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:05.564152 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00412f3d-ac05-49c4-9fd1-22fb7863823e None None] PATH_INFO: `/` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:05.566530 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 709/1423] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 11 14:34:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:34:05.571667 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840381c5-dbee-4316-acc8-a0237221823d None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:05.572229 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840381c5-dbee-4316-acc8-a0237221823d None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:05.572330 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840381c5-dbee-4316-acc8-a0237221823d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:05.591509 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:05.651178 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-840381c5-dbee-4316-acc8-a0237221823d None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:34:05.652436 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-840381c5-dbee-4316-acc8-a0237221823d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:34:05.777835 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 715/1424] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 11 14:34:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:34:05.958746 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00412f3d-ac05-49c4-9fd1-22fb7863823e None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:05.960669 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-00412f3d-ac05-49c4-9fd1-22fb7863823e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:34:06.093670 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:06.132991 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00412f3d-ac05-49c4-9fd1-22fb7863823e None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:06.257199 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b33329-0c08-437b-85c9-a92946c14aa6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4f8c0d696af4bd5a205ca8e9110b8cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:06.257863 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b33329-0c08-437b-85c9-a92946c14aa6 service nova] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:06.258150 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b33329-0c08-437b-85c9-a92946c14aa6 service nova] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:06.258460 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b33329-0c08-437b-85c9-a92946c14aa6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:06.260145 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-b2b33329-0c08-437b-85c9-a92946c14aa6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:34:06.342021 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:06.360601 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b33329-0c08-437b-85c9-a92946c14aa6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:06.362230 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b33329-0c08-437b-85c9-a92946c14aa6 service nova] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:06.382915 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 710/1425] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:34:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:34:07.314309 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef3d527-9602-409a-9c8d-b64e44f0b288 None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:07.314887 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef3d527-9602-409a-9c8d-b64e44f0b288 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:07.314887 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef3d527-9602-409a-9c8d-b64e44f0b288 None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:07.316832 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 716/1426] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 11 14:34:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:34:07.321816 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73d1050-fb73-4584-b5bb-bb81ae5bf0de None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:07.322245 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73d1050-fb73-4584-b5bb-bb81ae5bf0de None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:07.322378 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73d1050-fb73-4584-b5bb-bb81ae5bf0de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:07.398437 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-f73d1050-fb73-4584-b5bb-bb81ae5bf0de None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:34:07.399664 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-f73d1050-fb73-4584-b5bb-bb81ae5bf0de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:34:07.503834 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 711/1427] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 11 14:34:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:34:07.666416 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef3d527-9602-409a-9c8d-b64e44f0b288 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:07.668225 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-eef3d527-9602-409a-9c8d-b64e44f0b288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:34:07.761074 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:07.820553 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef3d527-9602-409a-9c8d-b64e44f0b288 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:07.938614 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514899ae-b077-43cc-8456-63ee14909421 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4f8c0d696af4bd5a205ca8e9110b8cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:07.939266 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514899ae-b077-43cc-8456-63ee14909421 service nova] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:07.939545 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514899ae-b077-43cc-8456-63ee14909421 service nova] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:07.939822 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514899ae-b077-43cc-8456-63ee14909421 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:07.941709 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-514899ae-b077-43cc-8456-63ee14909421 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:34:07.993230 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:08.036130 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514899ae-b077-43cc-8456-63ee14909421 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:08.037783 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514899ae-b077-43cc-8456-63ee14909421 service nova] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:08.056312 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 717/1428] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:34:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:34:08.890727 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6d3efd-6edb-4355-bfba-22d4065acf61 None None] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:08.891297 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6d3efd-6edb-4355-bfba-22d4065acf61 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:08.891297 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6d3efd-6edb-4355-bfba-22d4065acf61 None None] PATH_INFO: `/` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:08.892614 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 712/1429] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 11 14:34:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:34:08.899265 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a984452-eb4f-4e79-a7b7-6469f7ee622d None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:08.899779 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a984452-eb4f-4e79-a7b7-6469f7ee622d None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:08.899891 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a984452-eb4f-4e79-a7b7-6469f7ee622d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:08.980770 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-8a984452-eb4f-4e79-a7b7-6469f7ee622d None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:34:08.982006 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-8a984452-eb4f-4e79-a7b7-6469f7ee622d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:34:09.094309 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 718/1430] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 11 14:34:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:34:09.256591 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6d3efd-6edb-4355-bfba-22d4065acf61 None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:09.258302 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-4b6d3efd-6edb-4355-bfba-22d4065acf61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:34:09.317386 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:09.420141 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6d3efd-6edb-4355-bfba-22d4065acf61 None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:09.556573 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7379da6c-0786-48fb-982d-986a325d10da service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4f8c0d696af4bd5a205ca8e9110b8cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:09.557143 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7379da6c-0786-48fb-982d-986a325d10da service nova] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:09.557436 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7379da6c-0786-48fb-982d-986a325d10da service nova] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:09.557980 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7379da6c-0786-48fb-982d-986a325d10da service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:09.559654 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-7379da6c-0786-48fb-982d-986a325d10da service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:34:09.568165 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:09.659127 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7379da6c-0786-48fb-982d-986a325d10da service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:09.661603 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7379da6c-0786-48fb-982d-986a325d10da service nova] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:09.681771 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 713/1431] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:34:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:34:10.502033 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f347e12b-aca0-4535-9ad2-279d4e2d50bc None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:10.502613 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f347e12b-aca0-4535-9ad2-279d4e2d50bc None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:10.502613 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f347e12b-aca0-4535-9ad2-279d4e2d50bc None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:10.504291 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 719/1432] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 11 14:34:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:34:10.509190 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe9e551-ba72-4924-82e4-faa9d21e1c04 None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:10.509653 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe9e551-ba72-4924-82e4-faa9d21e1c04 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:10.509750 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe9e551-ba72-4924-82e4-faa9d21e1c04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:10.586754 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-8fe9e551-ba72-4924-82e4-faa9d21e1c04 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:34:10.587980 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-8fe9e551-ba72-4924-82e4-faa9d21e1c04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:34:10.656484 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:10.687051 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 714/1433] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 11 14:34:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:34:10.836938 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f347e12b-aca0-4535-9ad2-279d4e2d50bc None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:10.838400 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-f347e12b-aca0-4535-9ad2-279d4e2d50bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:34:10.857051 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:10.991125 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f347e12b-aca0-4535-9ad2-279d4e2d50bc None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:11.080441 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:11.107268 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fa3761-5334-4db9-ab9b-8492c4d372b8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4f8c0d696af4bd5a205ca8e9110b8cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:11.107820 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fa3761-5334-4db9-ab9b-8492c4d372b8 service nova] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:11.108099 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fa3761-5334-4db9-ab9b-8492c4d372b8 service nova] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:11.108411 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fa3761-5334-4db9-ab9b-8492c4d372b8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:11.110051 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-44fa3761-5334-4db9-ab9b-8492c4d372b8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:34:11.207483 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fa3761-5334-4db9-ab9b-8492c4d372b8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:11.209163 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fa3761-5334-4db9-ab9b-8492c4d372b8 service nova] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:11.227617 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 720/1434] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:34:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:34:12.073601 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7431856e-ce3c-4829-a3e3-cb13f5021fed None None] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:12.074193 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7431856e-ce3c-4829-a3e3-cb13f5021fed None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:12.074193 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7431856e-ce3c-4829-a3e3-cb13f5021fed None None] PATH_INFO: `/` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:12.075584 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 715/1435] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 11 14:34:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:34:12.081121 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9e7767-5d62-4291-af99-233cf34c2827 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:12.082417 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9e7767-5d62-4291-af99-233cf34c2827 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:12.082417 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9e7767-5d62-4291-af99-233cf34c2827 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:12.163963 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-4d9e7767-5d62-4291-af99-233cf34c2827 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:34:12.165220 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-4d9e7767-5d62-4291-af99-233cf34c2827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:34:12.207588 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:12.264146 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 721/1436] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 11 14:34:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:34:12.416068 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7431856e-ce3c-4829-a3e3-cb13f5021fed None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:12.417512 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-7431856e-ce3c-4829-a3e3-cb13f5021fed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:34:12.566896 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7431856e-ce3c-4829-a3e3-cb13f5021fed None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:12.623693 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:12.686352 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02180c03-1954-4c49-a067-8fc30fb34ee8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4f8c0d696af4bd5a205ca8e9110b8cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:12.686942 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02180c03-1954-4c49-a067-8fc30fb34ee8 service nova] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:12.687223 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02180c03-1954-4c49-a067-8fc30fb34ee8 service nova] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:12.687499 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02180c03-1954-4c49-a067-8fc30fb34ee8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:12.689174 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-02180c03-1954-4c49-a067-8fc30fb34ee8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:34:12.786216 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02180c03-1954-4c49-a067-8fc30fb34ee8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:12.787824 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02180c03-1954-4c49-a067-8fc30fb34ee8 service nova] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:12.806393 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 716/1437] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:34:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:34:13.631138 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f54323-016f-42bd-aae1-e20db33ea79f None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:13.631710 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f54323-016f-42bd-aae1-e20db33ea79f None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:13.631710 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f54323-016f-42bd-aae1-e20db33ea79f None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:13.633118 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 722/1438] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 11 14:34:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:34:13.638434 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aba956e-e810-427c-90bc-8e5fe3266b41 None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:13.638871 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aba956e-e810-427c-90bc-8e5fe3266b41 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:13.638981 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aba956e-e810-427c-90bc-8e5fe3266b41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:13.716389 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-0aba956e-e810-427c-90bc-8e5fe3266b41 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:34:13.717514 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-0aba956e-e810-427c-90bc-8e5fe3266b41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:34:13.719537 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:13.815546 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 717/1439] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 11 14:34:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:34:13.973306 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f54323-016f-42bd-aae1-e20db33ea79f None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:13.975904 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-09f54323-016f-42bd-aae1-e20db33ea79f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:34:14.131348 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f54323-016f-42bd-aae1-e20db33ea79f None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:14.159513 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:14.252045 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129d4bb9-ff88-425c-9bc7-3fcb7ab84584 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4f8c0d696af4bd5a205ca8e9110b8cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:14.252745 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129d4bb9-ff88-425c-9bc7-3fcb7ab84584 service nova] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:14.253027 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129d4bb9-ff88-425c-9bc7-3fcb7ab84584 service nova] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:14.253812 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129d4bb9-ff88-425c-9bc7-3fcb7ab84584 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:14.255502 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-129d4bb9-ff88-425c-9bc7-3fcb7ab84584 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:34:14.349163 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129d4bb9-ff88-425c-9bc7-3fcb7ab84584 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:14.350789 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129d4bb9-ff88-425c-9bc7-3fcb7ab84584 service nova] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:14.369832 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 723/1440] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:34:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:34:16.338872 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e9fce8-8caa-40d4-9e7a-6ff7f299b883 None None] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:16.339446 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e9fce8-8caa-40d4-9e7a-6ff7f299b883 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:16.339446 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e9fce8-8caa-40d4-9e7a-6ff7f299b883 None None] PATH_INFO: `/` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:16.340887 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 718/1441] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 11 14:34:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:34:16.346217 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63389d54-55fa-4178-b49b-c3ce67b7c838 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:16.346659 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63389d54-55fa-4178-b49b-c3ce67b7c838 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:16.346786 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63389d54-55fa-4178-b49b-c3ce67b7c838 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:16.389609 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:16.416078 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-63389d54-55fa-4178-b49b-c3ce67b7c838 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:34:16.417346 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-63389d54-55fa-4178-b49b-c3ce67b7c838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:34:16.517548 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 724/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 11 14:34:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:34:16.561068 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e9fce8-8caa-40d4-9e7a-6ff7f299b883 None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:16.562609 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-f0e9fce8-8caa-40d4-9e7a-6ff7f299b883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:34:16.670894 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e9fce8-8caa-40d4-9e7a-6ff7f299b883 None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:16.705501 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:16.750833 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2f6d60-32b4-4f69-b04f-1bac7dbe6d5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20eede5ccd834862b00123310b5c3975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:16.751486 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2f6d60-32b4-4f69-b04f-1bac7dbe6d5d service neutron] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:16.751768 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2f6d60-32b4-4f69-b04f-1bac7dbe6d5d service neutron] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:16.752041 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2f6d60-32b4-4f69-b04f-1bac7dbe6d5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:16.754405 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-bd2f6d60-32b4-4f69-b04f-1bac7dbe6d5d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:34:16.875389 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2f6d60-32b4-4f69-b04f-1bac7dbe6d5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:16.877091 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2f6d60-32b4-4f69-b04f-1bac7dbe6d5d service neutron] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:16.899193 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 719/1443] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:34:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:34:19.132812 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4e3f66-c567-4f52-9dfc-afe39b60c6e4 None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:19.133367 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4e3f66-c567-4f52-9dfc-afe39b60c6e4 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:19.133367 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4e3f66-c567-4f52-9dfc-afe39b60c6e4 None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:19.134718 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 725/1444] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 11 14:34:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:34:19.140195 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b685f0fb-fd57-43ac-b550-cb4655677773 None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:19.140674 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b685f0fb-fd57-43ac-b550-cb4655677773 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:19.140793 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b685f0fb-fd57-43ac-b550-cb4655677773 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:19.207785 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-b685f0fb-fd57-43ac-b550-cb4655677773 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:34:19.209014 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-b685f0fb-fd57-43ac-b550-cb4655677773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:34:19.222777 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:19.310234 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 720/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 11 14:34:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:34:19.349997 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4e3f66-c567-4f52-9dfc-afe39b60c6e4 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:19.351575 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-da4e3f66-c567-4f52-9dfc-afe39b60c6e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:34:19.460157 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4e3f66-c567-4f52-9dfc-afe39b60c6e4 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:19.476010 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:19.563759 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317cb16b-f6de-4d61-8803-f4fd19793c7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20eede5ccd834862b00123310b5c3975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:19.564456 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317cb16b-f6de-4d61-8803-f4fd19793c7e service neutron] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:19.564736 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317cb16b-f6de-4d61-8803-f4fd19793c7e service neutron] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:19.565011 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317cb16b-f6de-4d61-8803-f4fd19793c7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:19.567028 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-317cb16b-f6de-4d61-8803-f4fd19793c7e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:34:19.687476 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317cb16b-f6de-4d61-8803-f4fd19793c7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:19.688943 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317cb16b-f6de-4d61-8803-f4fd19793c7e service neutron] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:19.709849 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 726/1446] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:34:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:34:22.218994 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02e8012-7bf7-475a-847b-9866cb7d47e0 None None] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:22.219532 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02e8012-7bf7-475a-847b-9866cb7d47e0 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:22.219532 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02e8012-7bf7-475a-847b-9866cb7d47e0 None None] PATH_INFO: `/` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:22.220866 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 721/1447] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 11 14:34:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:34:22.227116 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f761cc3-5af1-46bf-ad72-746200f7362b None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:22.227626 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f761cc3-5af1-46bf-ad72-746200f7362b None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:22.227739 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f761cc3-5af1-46bf-ad72-746200f7362b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:22.279804 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:22.300277 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-7f761cc3-5af1-46bf-ad72-746200f7362b None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:34:22.302878 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-7f761cc3-5af1-46bf-ad72-746200f7362b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:34:22.405316 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 727/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 11 14:34:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:34:22.445582 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02e8012-7bf7-475a-847b-9866cb7d47e0 None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:22.447160 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-d02e8012-7bf7-475a-847b-9866cb7d47e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:34:22.571486 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02e8012-7bf7-475a-847b-9866cb7d47e0 None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:22.616445 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:22.651944 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c04051-b716-451e-816a-b0a089bcddcb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20eede5ccd834862b00123310b5c3975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:22.652635 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c04051-b716-451e-816a-b0a089bcddcb service neutron] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:22.652928 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c04051-b716-451e-816a-b0a089bcddcb service neutron] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:22.653217 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c04051-b716-451e-816a-b0a089bcddcb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:22.654970 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-b4c04051-b716-451e-816a-b0a089bcddcb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:34:22.778941 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c04051-b716-451e-816a-b0a089bcddcb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:22.780554 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c04051-b716-451e-816a-b0a089bcddcb service neutron] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:22.801382 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 722/1449] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:34:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:34:25.057256 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddda8c7-d8c5-49ee-9a3e-c46eee2e8e5a None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:25.057853 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddda8c7-d8c5-49ee-9a3e-c46eee2e8e5a None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:25.057853 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddda8c7-d8c5-49ee-9a3e-c46eee2e8e5a None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:25.059442 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 728/1450] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 11 14:34:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:34:25.064995 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7f3e03-76e7-4209-b701-fca1972927a1 None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:25.065531 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7f3e03-76e7-4209-b701-fca1972927a1 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:25.065531 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7f3e03-76e7-4209-b701-fca1972927a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:25.142834 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-ea7f3e03-76e7-4209-b701-fca1972927a1 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:34:25.144065 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-ea7f3e03-76e7-4209-b701-fca1972927a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:34:25.165994 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:25.250260 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 723/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 11 14:34:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:34:25.303929 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddda8c7-d8c5-49ee-9a3e-c46eee2e8e5a None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:25.305552 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-9ddda8c7-d8c5-49ee-9a3e-c46eee2e8e5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:34:25.413988 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddda8c7-d8c5-49ee-9a3e-c46eee2e8e5a None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:25.435080 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:25.492665 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd668bdd-1c80-4c12-abd0-16f56f1bd91c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20eede5ccd834862b00123310b5c3975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:25.493322 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd668bdd-1c80-4c12-abd0-16f56f1bd91c service neutron] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:25.493610 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd668bdd-1c80-4c12-abd0-16f56f1bd91c service neutron] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:25.493892 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd668bdd-1c80-4c12-abd0-16f56f1bd91c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:25.495563 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-bd668bdd-1c80-4c12-abd0-16f56f1bd91c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:34:25.624131 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd668bdd-1c80-4c12-abd0-16f56f1bd91c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:25.625627 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd668bdd-1c80-4c12-abd0-16f56f1bd91c service neutron] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:25.647917 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 729/1452] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:34:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:34:27.908103 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f07425e-9553-430d-9ae4-ba741baebe57 None None] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:27.908703 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f07425e-9553-430d-9ae4-ba741baebe57 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:27.908703 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f07425e-9553-430d-9ae4-ba741baebe57 None None] PATH_INFO: `/` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:27.910790 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 724/1453] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 11 14:34:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:34:27.917136 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0669cc-6b78-4363-9dd4-b4267ea252cd None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:27.917572 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0669cc-6b78-4363-9dd4-b4267ea252cd None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:27.917708 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0669cc-6b78-4363-9dd4-b4267ea252cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:27.993705 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:27.997021 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-1d0669cc-6b78-4363-9dd4-b4267ea252cd None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:34:27.998766 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-1d0669cc-6b78-4363-9dd4-b4267ea252cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:34:28.099137 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 730/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 11 14:34:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:34:28.138653 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f07425e-9553-430d-9ae4-ba741baebe57 None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:28.140271 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-9f07425e-9553-430d-9ae4-ba741baebe57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:34:28.246147 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f07425e-9553-430d-9ae4-ba741baebe57 None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:28.294787 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:28.322754 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbdaee1-0744-45c0-a5e9-e9cc310d59ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20eede5ccd834862b00123310b5c3975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:28.323405 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbdaee1-0744-45c0-a5e9-e9cc310d59ee service neutron] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:28.323688 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbdaee1-0744-45c0-a5e9-e9cc310d59ee service neutron] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:28.323967 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbdaee1-0744-45c0-a5e9-e9cc310d59ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:28.325660 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-bcbdaee1-0744-45c0-a5e9-e9cc310d59ee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:34:28.441555 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbdaee1-0744-45c0-a5e9-e9cc310d59ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:28.443085 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbdaee1-0744-45c0-a5e9-e9cc310d59ee service neutron] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:28.461854 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 725/1455] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:34:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:34:30.602926 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273730db-7275-4302-b4b3-9f6307053d73 None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:30.603483 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273730db-7275-4302-b4b3-9f6307053d73 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:30.603483 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273730db-7275-4302-b4b3-9f6307053d73 None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:30.604882 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 731/1456] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 11 14:34:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:34:30.610565 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4f5c14-b9b5-4957-a09f-114291ff0824 None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:30.611025 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4f5c14-b9b5-4957-a09f-114291ff0824 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:30.611117 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4f5c14-b9b5-4957-a09f-114291ff0824 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:30.680742 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-5a4f5c14-b9b5-4957-a09f-114291ff0824 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:34:30.681971 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-5a4f5c14-b9b5-4957-a09f-114291ff0824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:34:30.713594 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:30.790587 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 726/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 11 14:34:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:34:30.831805 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273730db-7275-4302-b4b3-9f6307053d73 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:30.834106 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-273730db-7275-4302-b4b3-9f6307053d73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:34:30.945070 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273730db-7275-4302-b4b3-9f6307053d73 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:30.978702 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:31.031668 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eb28b5-78c4-4154-91a7-7c03e7aae4a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20eede5ccd834862b00123310b5c3975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:31.032370 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eb28b5-78c4-4154-91a7-7c03e7aae4a3 service neutron] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:31.032655 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eb28b5-78c4-4154-91a7-7c03e7aae4a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:31.032928 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eb28b5-78c4-4154-91a7-7c03e7aae4a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:31.034649 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-12eb28b5-78c4-4154-91a7-7c03e7aae4a3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:34:31.155425 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12eb28b5-78c4-4154-91a7-7c03e7aae4a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:31.158370 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12eb28b5-78c4-4154-91a7-7c03e7aae4a3 service neutron] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:31.186798 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 732/1458] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:34:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:34:33.302728 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a449e951-ee3f-447c-ac4b-2c6ba39670ad None None] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:33.303312 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a449e951-ee3f-447c-ac4b-2c6ba39670ad None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:33.303312 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a449e951-ee3f-447c-ac4b-2c6ba39670ad None None] PATH_INFO: `/` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:33.304781 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 727/1459] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 11 14:34:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 14:34:33.310397 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d938381-4995-4523-9fe3-2f8c505ccf8a None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:33.310838 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d938381-4995-4523-9fe3-2f8c505ccf8a None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:33.310938 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d938381-4995-4523-9fe3-2f8c505ccf8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:33.383701 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-9d938381-4995-4523-9fe3-2f8c505ccf8a None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:34:33.384958 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-9d938381-4995-4523-9fe3-2f8c505ccf8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:34:33.393505 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:33.484745 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 733/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 11 14:34:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:34:33.523064 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a449e951-ee3f-447c-ac4b-2c6ba39670ad None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:33.524650 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-a449e951-ee3f-447c-ac4b-2c6ba39670ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:34:33.633991 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a449e951-ee3f-447c-ac4b-2c6ba39670ad None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:33.690102 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:33.709056 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54b2025-02dc-4125-a6a1-4e7ff6714ad4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20eede5ccd834862b00123310b5c3975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:33.709716 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54b2025-02dc-4125-a6a1-4e7ff6714ad4 service neutron] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:33.710012 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54b2025-02dc-4125-a6a1-4e7ff6714ad4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:33.710294 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54b2025-02dc-4125-a6a1-4e7ff6714ad4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:33.711953 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-f54b2025-02dc-4125-a6a1-4e7ff6714ad4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:34:33.834980 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54b2025-02dc-4125-a6a1-4e7ff6714ad4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:33.836370 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54b2025-02dc-4125-a6a1-4e7ff6714ad4 service neutron] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:33.855548 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 728/1461] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:34:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:34:36.009313 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e525b571-6db5-4cba-a76b-2d45bbb61775 None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:36.009896 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e525b571-6db5-4cba-a76b-2d45bbb61775 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:36.009896 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e525b571-6db5-4cba-a76b-2d45bbb61775 None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:36.011260 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 734/1462] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 11 14:34:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:34:36.017091 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dde245-6e58-4116-a4e1-ee611336debf None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:36.017537 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dde245-6e58-4116-a4e1-ee611336debf None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:36.017656 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dde245-6e58-4116-a4e1-ee611336debf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:36.090795 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-24dde245-6e58-4116-a4e1-ee611336debf None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:34:36.092034 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-24dde245-6e58-4116-a4e1-ee611336debf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:34:36.131300 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:36.192075 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 729/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 11 14:34:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:34:36.229613 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e525b571-6db5-4cba-a76b-2d45bbb61775 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:36.231186 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-e525b571-6db5-4cba-a76b-2d45bbb61775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:34:36.340625 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e525b571-6db5-4cba-a76b-2d45bbb61775 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:36.380176 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:36.419384 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4467addc-fbd4-4f60-9b94-3a17c75a48de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20eede5ccd834862b00123310b5c3975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:36.420083 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4467addc-fbd4-4f60-9b94-3a17c75a48de service neutron] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:36.420348 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4467addc-fbd4-4f60-9b94-3a17c75a48de service neutron] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:36.420628 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4467addc-fbd4-4f60-9b94-3a17c75a48de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:36.422288 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-4467addc-fbd4-4f60-9b94-3a17c75a48de service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:34:36.536434 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4467addc-fbd4-4f60-9b94-3a17c75a48de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:36.537875 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4467addc-fbd4-4f60-9b94-3a17c75a48de service neutron] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:36.557673 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 735/1464] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:34:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:34:38.631659 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffe9741-a833-4230-bcf0-bdd7b1a7e46f None None] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:38.632299 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffe9741-a833-4230-bcf0-bdd7b1a7e46f None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:38.632299 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffe9741-a833-4230-bcf0-bdd7b1a7e46f None None] PATH_INFO: `/` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:38.633724 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 730/1465] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 11 14:34:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:34:38.639826 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db128b9d-3138-4363-a0b9-54b88ba32d99 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:38.640622 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db128b9d-3138-4363-a0b9-54b88ba32d99 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:38.640622 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db128b9d-3138-4363-a0b9-54b88ba32d99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:38.719273 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-db128b9d-3138-4363-a0b9-54b88ba32d99 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:34:38.720527 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-db128b9d-3138-4363-a0b9-54b88ba32d99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:34:38.741464 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:38.824266 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 736/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 11 14:34:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:34:38.861904 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffe9741-a833-4230-bcf0-bdd7b1a7e46f None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:38.864743 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-dffe9741-a833-4230-bcf0-bdd7b1a7e46f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:34:38.971574 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffe9741-a833-4230-bcf0-bdd7b1a7e46f None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:39.040173 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:39.047684 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a96c5b-42aa-4c38-ae23-7c5c72ac1526 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20eede5ccd834862b00123310b5c3975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:39.048376 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a96c5b-42aa-4c38-ae23-7c5c72ac1526 service neutron] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:39.048664 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a96c5b-42aa-4c38-ae23-7c5c72ac1526 service neutron] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:39.048957 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a96c5b-42aa-4c38-ae23-7c5c72ac1526 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:39.050627 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-46a96c5b-42aa-4c38-ae23-7c5c72ac1526 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:34:39.161887 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a96c5b-42aa-4c38-ae23-7c5c72ac1526 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:39.163333 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a96c5b-42aa-4c38-ae23-7c5c72ac1526 service neutron] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:39.182527 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 731/1467] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:34:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:34:41.307665 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec702834-ceee-46b2-869a-4a058acfe2fb None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:41.308272 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec702834-ceee-46b2-869a-4a058acfe2fb None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:41.308272 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec702834-ceee-46b2-869a-4a058acfe2fb None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:41.309924 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 737/1468] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 11 14:34:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:34:41.315146 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56c0ab0-2380-4695-b1c4-09b8bae90b0a None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:41.315588 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56c0ab0-2380-4695-b1c4-09b8bae90b0a None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:41.315700 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56c0ab0-2380-4695-b1c4-09b8bae90b0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:41.383943 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-d56c0ab0-2380-4695-b1c4-09b8bae90b0a None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:34:41.385202 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-d56c0ab0-2380-4695-b1c4-09b8bae90b0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:34:41.444625 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:41.497424 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 732/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 11 14:34:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:34:41.534288 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec702834-ceee-46b2-869a-4a058acfe2fb None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:41.535895 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-ec702834-ceee-46b2-869a-4a058acfe2fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:34:41.650630 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec702834-ceee-46b2-869a-4a058acfe2fb None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:41.699904 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:41.728043 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80712512-9fd2-4a9d-bcfb-09ad5e201e19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20eede5ccd834862b00123310b5c3975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:41.728847 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80712512-9fd2-4a9d-bcfb-09ad5e201e19 service neutron] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:41.729127 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80712512-9fd2-4a9d-bcfb-09ad5e201e19 service neutron] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:41.729402 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80712512-9fd2-4a9d-bcfb-09ad5e201e19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:41.731040 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-80712512-9fd2-4a9d-bcfb-09ad5e201e19 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:34:41.842487 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80712512-9fd2-4a9d-bcfb-09ad5e201e19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:41.843879 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80712512-9fd2-4a9d-bcfb-09ad5e201e19 service neutron] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:41.862081 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 738/1470] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:34:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:34:51.495492 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=22 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:51.859852 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=66 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:35:02.265647 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd2f436-361a-470e-9f35-c94a8f17a968 None None] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:35:02.266214 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd2f436-361a-470e-9f35-c94a8f17a968 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:35:02.266214 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd2f436-361a-470e-9f35-c94a8f17a968 None None] PATH_INFO: `/` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:35:02.267630 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 733/1471] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:35:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:35:02.273990 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f69a89-d804-49cf-bd01-d5b3606f98fc None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:35:02.274459 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f69a89-d804-49cf-bd01-d5b3606f98fc None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:35:02.274572 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f69a89-d804-49cf-bd01-d5b3606f98fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:35:02.342368 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-25f69a89-d804-49cf-bd01-d5b3606f98fc None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:35:02.343612 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-25f69a89-d804-49cf-bd01-d5b3606f98fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:35:02.449776 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 739/1472] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:35:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:35:02.536893 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42611ca-c3e9-439e-b96c-2f6abe6ce1ae None None] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:35:02.537173 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42611ca-c3e9-439e-b96c-2f6abe6ce1ae None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:35:02.537446 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42611ca-c3e9-439e-b96c-2f6abe6ce1ae None None] PATH_INFO: `/` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:35:02.538808 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 734/1473] 10.222.0.70 () {54 vars in 962 bytes} [Mon Jul 11 14:35:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:35:02.543736 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0649a21f-a67d-42fa-bd4d-ade953844de0 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:35:02.544035 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0649a21f-a67d-42fa-bd4d-ade953844de0 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:35:02.544348 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0649a21f-a67d-42fa-bd4d-ade953844de0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:35:02.630785 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-0649a21f-a67d-42fa-bd4d-ade953844de0 None None] MFA Rules not processed for user `fa21b44163d84534b9ca1ffe5b5a6071`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:35:02.632021 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-0649a21f-a67d-42fa-bd4d-ade953844de0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:35:02.652769 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:35:02.709332 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 740/1474] 10.222.0.70 () {58 vars in 1059 bytes} [Mon Jul 11 14:35:02 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:35:02.718016 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42611ca-c3e9-439e-b96c-2f6abe6ce1ae None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:35:02.719580 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-e42611ca-c3e9-439e-b96c-2f6abe6ce1ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:35:02.828909 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42611ca-c3e9-439e-b96c-2f6abe6ce1ae None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:35:02.906969 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba46116-616b-4af0-9689-e93b7f681d85 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa21b44163d84534b9ca1ffe5b5a6071', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:35:02.907988 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba46116-616b-4af0-9689-e93b7f681d85 service glance] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:35:02.908388 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba46116-616b-4af0-9689-e93b7f681d85 service glance] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:35:02.908921 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba46116-616b-4af0-9689-e93b7f681d85 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:35:02.911761 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-4ba46116-616b-4af0-9689-e93b7f681d85 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:35:02.982342 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:35:03.039373 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba46116-616b-4af0-9689-e93b7f681d85 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:35:03.040937 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba46116-616b-4af0-9689-e93b7f681d85 service glance] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:35:03.061546 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 735/1475] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:35:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:35:05.396907 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781f238d-72fa-4ef7-970a-0b1489e86f79 None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:35:05.397781 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781f238d-72fa-4ef7-970a-0b1489e86f79 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:35:05.397781 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781f238d-72fa-4ef7-970a-0b1489e86f79 None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:35:05.399146 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 741/1476] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:35:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:35:05.408278 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0d394b-65cd-4a29-a8f4-00ea4640a36c None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:35:05.408830 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0d394b-65cd-4a29-a8f4-00ea4640a36c None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:35:05.408830 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0d394b-65cd-4a29-a8f4-00ea4640a36c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:35:05.486988 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-4a0d394b-65cd-4a29-a8f4-00ea4640a36c None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:35:05.489327 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-4a0d394b-65cd-4a29-a8f4-00ea4640a36c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:35:05.624045 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 736/1477] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:35:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:35:05.648834 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781f238d-72fa-4ef7-970a-0b1489e86f79 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:35:05.650313 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-781f238d-72fa-4ef7-970a-0b1489e86f79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:35:05.834777 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781f238d-72fa-4ef7-970a-0b1489e86f79 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:35:05.896516 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:35:05.952831 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f3a4c3-a811-46a4-81d3-54a5cf530461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:35:05.953607 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f3a4c3-a811-46a4-81d3-54a5cf530461 admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:35:05.953919 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f3a4c3-a811-46a4-81d3-54a5cf530461 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:35:05.954236 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f3a4c3-a811-46a4-81d3-54a5cf530461 admin admin] PATH_INFO: `/v3/projects` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:35:05.954994 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f3a4c3-a811-46a4-81d3-54a5cf530461 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:35:05.956940 dv-cinder-master-3-smb devstack@keystone.service[80535]: WARNING py.warnings [None req-14f3a4c3-a811-46a4-81d3-54a5cf530461 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 11 14:35:05.956940 dv-cinder-master-3-smb devstack@keystone.service[80535]: warnings.warn(msg) Jul 11 14:35:05.956940 dv-cinder-master-3-smb devstack@keystone.service[80535]: Jul 11 14:35:05.958743 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f3a4c3-a811-46a4-81d3-54a5cf530461 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:35:05.980145 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 742/1478] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 11 14:35:05 2022] GET /identity/v3/projects => generated 2553 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:35:08.205337 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ae62b9-8f81-4b2d-a696-0ec8f18f854c None None] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:35:08.205903 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ae62b9-8f81-4b2d-a696-0ec8f18f854c None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:35:08.205903 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ae62b9-8f81-4b2d-a696-0ec8f18f854c None None] PATH_INFO: `/` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:35:08.207171 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 737/1479] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:35:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:35:08.213159 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501c155e-4657-4fa2-8571-0bde0ea79506 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:35:08.213612 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501c155e-4657-4fa2-8571-0bde0ea79506 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:35:08.213715 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501c155e-4657-4fa2-8571-0bde0ea79506 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:35:08.278502 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-501c155e-4657-4fa2-8571-0bde0ea79506 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:35:08.279724 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-501c155e-4657-4fa2-8571-0bde0ea79506 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:35:08.377629 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 743/1480] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:35:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:35:08.422562 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ae62b9-8f81-4b2d-a696-0ec8f18f854c None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:35:08.424231 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-01ae62b9-8f81-4b2d-a696-0ec8f18f854c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:35:08.435328 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:35:08.581040 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ae62b9-8f81-4b2d-a696-0ec8f18f854c None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:35:08.669090 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:35:08.703312 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69cee48-1ffc-44bf-a7a9-6f953768e2c9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4f8c0d696af4bd5a205ca8e9110b8cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:35:08.703967 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69cee48-1ffc-44bf-a7a9-6f953768e2c9 service nova] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:35:08.704281 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69cee48-1ffc-44bf-a7a9-6f953768e2c9 service nova] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:35:08.704558 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69cee48-1ffc-44bf-a7a9-6f953768e2c9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:35:08.706207 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-c69cee48-1ffc-44bf-a7a9-6f953768e2c9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:35:08.804375 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69cee48-1ffc-44bf-a7a9-6f953768e2c9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:35:08.805984 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69cee48-1ffc-44bf-a7a9-6f953768e2c9 service nova] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:35:08.825275 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 738/1481] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:35:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:35:11.150061 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b0e9cb-fd59-4fb7-9f92-b1d9b8d9880b None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:35:11.150676 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b0e9cb-fd59-4fb7-9f92-b1d9b8d9880b None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:35:11.150676 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b0e9cb-fd59-4fb7-9f92-b1d9b8d9880b None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:35:11.152086 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 744/1482] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:35:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:35:11.162437 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0035c815-2534-4f2d-bf66-5d5332efaff2 None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:35:11.163040 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0035c815-2534-4f2d-bf66-5d5332efaff2 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:35:11.163296 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0035c815-2534-4f2d-bf66-5d5332efaff2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:35:11.231032 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-0035c815-2534-4f2d-bf66-5d5332efaff2 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:35:11.232279 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-0035c815-2534-4f2d-bf66-5d5332efaff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:35:11.279416 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:35:11.332725 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 739/1483] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:35:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:35:11.369819 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b0e9cb-fd59-4fb7-9f92-b1d9b8d9880b None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:35:11.371382 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-61b0e9cb-fd59-4fb7-9f92-b1d9b8d9880b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:35:11.396320 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:35:11.477446 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b0e9cb-fd59-4fb7-9f92-b1d9b8d9880b None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:35:11.554349 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a719450d-ce5e-428a-9bfd-f4e4faf3034c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20eede5ccd834862b00123310b5c3975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:35:11.554998 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a719450d-ce5e-428a-9bfd-f4e4faf3034c service neutron] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:35:11.555279 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a719450d-ce5e-428a-9bfd-f4e4faf3034c service neutron] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:35:11.555554 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a719450d-ce5e-428a-9bfd-f4e4faf3034c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:35:11.557260 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-a719450d-ce5e-428a-9bfd-f4e4faf3034c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:35:11.632599 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:35:11.669213 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a719450d-ce5e-428a-9bfd-f4e4faf3034c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:35:11.670651 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a719450d-ce5e-428a-9bfd-f4e4faf3034c service neutron] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:35:11.690923 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 745/1484] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:35:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:35:13.836676 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3536fada-7f39-4497-91d7-ac1c401c355d None None] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:35:13.837208 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3536fada-7f39-4497-91d7-ac1c401c355d None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:35:13.837208 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3536fada-7f39-4497-91d7-ac1c401c355d None None] PATH_INFO: `/` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:35:13.838501 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 740/1485] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:35:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:35:13.843838 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34cdc86-a1f4-40c7-8e2c-e1a997970ee2 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:35:13.844291 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34cdc86-a1f4-40c7-8e2c-e1a997970ee2 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:35:13.844436 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34cdc86-a1f4-40c7-8e2c-e1a997970ee2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:35:13.913844 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-e34cdc86-a1f4-40c7-8e2c-e1a997970ee2 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:35:13.915080 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-e34cdc86-a1f4-40c7-8e2c-e1a997970ee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:35:14.013987 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 746/1486] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:35:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:35:14.052476 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3536fada-7f39-4497-91d7-ac1c401c355d None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:35:14.054049 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-3536fada-7f39-4497-91d7-ac1c401c355d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:35:14.161871 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3536fada-7f39-4497-91d7-ac1c401c355d None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:35:14.235322 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:35:14.237757 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99cae2d-84d6-4d69-a8f1-b89f9901a2ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20eede5ccd834862b00123310b5c3975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:35:14.238412 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99cae2d-84d6-4d69-a8f1-b89f9901a2ae service neutron] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:35:14.238868 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99cae2d-84d6-4d69-a8f1-b89f9901a2ae service neutron] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:35:14.239155 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99cae2d-84d6-4d69-a8f1-b89f9901a2ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:35:14.241306 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-d99cae2d-84d6-4d69-a8f1-b89f9901a2ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:35:14.355000 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99cae2d-84d6-4d69-a8f1-b89f9901a2ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:35:14.356709 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99cae2d-84d6-4d69-a8f1-b89f9901a2ae service neutron] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:35:14.376102 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 741/1487] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:35:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:35:16.560672 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71e8da8-fecb-4da2-9367-0241b3f1b7ec None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:35:16.561653 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71e8da8-fecb-4da2-9367-0241b3f1b7ec None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:35:16.561653 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71e8da8-fecb-4da2-9367-0241b3f1b7ec None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:35:16.563011 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 747/1488] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:35:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:35:16.568602 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f31511-a40a-4dc2-a066-4bfb3bd8e05c None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:35:16.569093 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f31511-a40a-4dc2-a066-4bfb3bd8e05c None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:35:16.569198 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f31511-a40a-4dc2-a066-4bfb3bd8e05c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:35:16.637159 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-83f31511-a40a-4dc2-a066-4bfb3bd8e05c None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:35:16.638394 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-83f31511-a40a-4dc2-a066-4bfb3bd8e05c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:35:16.691784 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:35:16.737858 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 742/1489] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:35:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:35:16.778325 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71e8da8-fecb-4da2-9367-0241b3f1b7ec None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:35:16.779903 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-e71e8da8-fecb-4da2-9367-0241b3f1b7ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:35:16.817556 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:35:16.890307 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71e8da8-fecb-4da2-9367-0241b3f1b7ec None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:35:16.967400 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6ce97c-fcf1-4617-8c3e-cab88749a77d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20eede5ccd834862b00123310b5c3975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:35:16.968052 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6ce97c-fcf1-4617-8c3e-cab88749a77d service neutron] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:35:16.968377 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6ce97c-fcf1-4617-8c3e-cab88749a77d service neutron] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:35:16.968653 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6ce97c-fcf1-4617-8c3e-cab88749a77d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:35:16.970312 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-5b6ce97c-fcf1-4617-8c3e-cab88749a77d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:35:17.050179 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:35:17.080179 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6ce97c-fcf1-4617-8c3e-cab88749a77d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:35:17.081661 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6ce97c-fcf1-4617-8c3e-cab88749a77d service neutron] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:35:17.100362 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 748/1490] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:35:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:35:19.306968 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde138e7-d888-4023-9f49-902776543ae5 None None] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:35:19.307544 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde138e7-d888-4023-9f49-902776543ae5 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:35:19.307544 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde138e7-d888-4023-9f49-902776543ae5 None None] PATH_INFO: `/` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:35:19.308911 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 743/1491] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 11 14:35:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:35:19.314395 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58810c7-4267-430d-b583-ec90bb96f46c None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:35:19.314812 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58810c7-4267-430d-b583-ec90bb96f46c None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:35:19.314968 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58810c7-4267-430d-b583-ec90bb96f46c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:35:19.383679 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-c58810c7-4267-430d-b583-ec90bb96f46c None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:35:19.384962 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-c58810c7-4267-430d-b583-ec90bb96f46c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:35:19.482997 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 749/1492] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 11 14:35:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:35:19.524301 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde138e7-d888-4023-9f49-902776543ae5 None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:35:19.525842 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-cde138e7-d888-4023-9f49-902776543ae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:35:19.633564 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde138e7-d888-4023-9f49-902776543ae5 None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:35:19.708526 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e15c205-5277-4af5-bfd3-5516ff5af4f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20eede5ccd834862b00123310b5c3975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:35:19.709180 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e15c205-5277-4af5-bfd3-5516ff5af4f2 service neutron] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:35:19.709476 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e15c205-5277-4af5-bfd3-5516ff5af4f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:35:19.709724 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e15c205-5277-4af5-bfd3-5516ff5af4f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:35:19.711360 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-0e15c205-5277-4af5-bfd3-5516ff5af4f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:35:19.721179 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:35:19.825123 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e15c205-5277-4af5-bfd3-5516ff5af4f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:35:19.826475 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e15c205-5277-4af5-bfd3-5516ff5af4f2 service neutron] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:35:19.844914 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 744/1493] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:35:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:35:29.480536 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=82 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:35:29.842635 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=50 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:36:48.830390 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ead570-7739-4ec7-bca7-a4a5949aa936 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:36:48.830975 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ead570-7739-4ec7-bca7-a4a5949aa936 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:36:48.830975 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ead570-7739-4ec7-bca7-a4a5949aa936 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:36:48.909738 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-26ead570-7739-4ec7-bca7-a4a5949aa936 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:36:48.911140 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-26ead570-7739-4ec7-bca7-a4a5949aa936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:36:49.008326 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 750/1494] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:36:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:36:49.016252 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefb2ae4-95a8-4353-bcdf-19d5a3380c93 None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:36:49.016742 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefb2ae4-95a8-4353-bcdf-19d5a3380c93 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:36:49.016848 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefb2ae4-95a8-4353-bcdf-19d5a3380c93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:36:49.092428 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-eefb2ae4-95a8-4353-bcdf-19d5a3380c93 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:36:49.093564 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-eefb2ae4-95a8-4353-bcdf-19d5a3380c93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:36:49.191220 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 745/1495] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:36:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:36:49.196998 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ead570-7739-4ec7-bca7-a4a5949aa936 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:36:49.198213 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-26ead570-7739-4ec7-bca7-a4a5949aa936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:36:49.210256 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ead570-7739-4ec7-bca7-a4a5949aa936 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:36:49.273851 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:36:49.309628 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa0fcb6-7713-4931-92bf-6011e6954e3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:36:49.310291 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa0fcb6-7713-4931-92bf-6011e6954e3b admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:36:49.310577 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa0fcb6-7713-4931-92bf-6011e6954e3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:36:49.310855 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa0fcb6-7713-4931-92bf-6011e6954e3b admin admin] PATH_INFO: `/v3/domains` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:36:49.311583 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa0fcb6-7713-4931-92bf-6011e6954e3b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:36:49.311892 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa0fcb6-7713-4931-92bf-6011e6954e3b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:36:49.312943 dv-cinder-master-3-smb devstack@keystone.service[80535]: WARNING py.warnings [None req-1aa0fcb6-7713-4931-92bf-6011e6954e3b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 11 14:36:49.312943 dv-cinder-master-3-smb devstack@keystone.service[80535]: warnings.warn(msg) Jul 11 14:36:49.312943 dv-cinder-master-3-smb devstack@keystone.service[80535]: Jul 11 14:36:49.313845 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa0fcb6-7713-4931-92bf-6011e6954e3b admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:36:49.325388 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 751/1496] 10.222.0.70 () {58 vars in 1152 bytes} [Mon Jul 11 14:36:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:36:49.333826 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefb2ae4-95a8-4353-bcdf-19d5a3380c93 None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:36:49.343145 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefb2ae4-95a8-4353-bcdf-19d5a3380c93 None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:36:49.405983 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:36:49.440301 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926369c1-e21e-4b2e-9827-712b77ddbebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:36:49.440961 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926369c1-e21e-4b2e-9827-712b77ddbebe admin admin] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:36:49.441238 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926369c1-e21e-4b2e-9827-712b77ddbebe admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:36:49.441672 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926369c1-e21e-4b2e-9827-712b77ddbebe admin admin] PATH_INFO: `/v3/projects` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:36:49.442614 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926369c1-e21e-4b2e-9827-712b77ddbebe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:36:49.444342 dv-cinder-master-3-smb devstack@keystone.service[80534]: WARNING py.warnings [None req-926369c1-e21e-4b2e-9827-712b77ddbebe admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 11 14:36:49.444342 dv-cinder-master-3-smb devstack@keystone.service[80534]: warnings.warn(msg) Jul 11 14:36:49.444342 dv-cinder-master-3-smb devstack@keystone.service[80534]: Jul 11 14:36:49.445535 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926369c1-e21e-4b2e-9827-712b77ddbebe admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:36:49.504399 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 746/1497] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jul 11 14:36:49 2022] POST /identity/v3/projects => generated 379 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:36:49.508924 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa0fcb6-7713-4931-92bf-6011e6954e3b admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:36:49.510472 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-1aa0fcb6-7713-4931-92bf-6011e6954e3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:36:49.544562 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa0fcb6-7713-4931-92bf-6011e6954e3b admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:36:49.642055 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02f03d8-0a64-4b86-b193-c78cc49c56b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:36:49.642635 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02f03d8-0a64-4b86-b193-c78cc49c56b7 admin admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:36:49.642916 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02f03d8-0a64-4b86-b193-c78cc49c56b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:36:49.643218 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02f03d8-0a64-4b86-b193-c78cc49c56b7 admin admin] PATH_INFO: `/v3/users` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:36:49.643875 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02f03d8-0a64-4b86-b193-c78cc49c56b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:36:49.645613 dv-cinder-master-3-smb devstack@keystone.service[80535]: WARNING py.warnings [None req-b02f03d8-0a64-4b86-b193-c78cc49c56b7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 11 14:36:49.645613 dv-cinder-master-3-smb devstack@keystone.service[80535]: warnings.warn(msg) Jul 11 14:36:49.645613 dv-cinder-master-3-smb devstack@keystone.service[80535]: Jul 11 14:36:49.646838 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02f03d8-0a64-4b86-b193-c78cc49c56b7 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:36:49.691634 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 752/1498] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jul 11 14:36:49 2022] POST /identity/v3/users => generated 290 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:36:49.696070 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926369c1-e21e-4b2e-9827-712b77ddbebe admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:36:49.697615 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-926369c1-e21e-4b2e-9827-712b77ddbebe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:36:49.759700 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926369c1-e21e-4b2e-9827-712b77ddbebe admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:36:49.848856 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:36:49.860608 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ce2cad-0009-4c39-a5f1-06a7703e7eea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:36:49.861280 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ce2cad-0009-4c39-a5f1-06a7703e7eea admin admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:36:49.861561 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ce2cad-0009-4c39-a5f1-06a7703e7eea admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:36:49.861834 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ce2cad-0009-4c39-a5f1-06a7703e7eea admin admin] PATH_INFO: `/v3/roles` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:36:49.862677 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ce2cad-0009-4c39-a5f1-06a7703e7eea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:36:49.863988 dv-cinder-master-3-smb devstack@keystone.service[80534]: WARNING py.warnings [None req-43ce2cad-0009-4c39-a5f1-06a7703e7eea admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 11 14:36:49.863988 dv-cinder-master-3-smb devstack@keystone.service[80534]: warnings.warn(msg) Jul 11 14:36:49.863988 dv-cinder-master-3-smb devstack@keystone.service[80534]: Jul 11 14:36:49.865256 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ce2cad-0009-4c39-a5f1-06a7703e7eea admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:36:49.877657 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 747/1499] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:36:49 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:36:49.882328 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02f03d8-0a64-4b86-b193-c78cc49c56b7 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:36:49.883852 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-b02f03d8-0a64-4b86-b193-c78cc49c56b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:36:49.896580 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02f03d8-0a64-4b86-b193-c78cc49c56b7 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:36:49.922550 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:36:49.992723 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5733bff1-f4c8-45d9-91e7-fc295b990708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:36:49.993429 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5733bff1-f4c8-45d9-91e7-fc295b990708 admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:36:49.993735 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5733bff1-f4c8-45d9-91e7-fc295b990708 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:36:49.994007 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5733bff1-f4c8-45d9-91e7-fc295b990708 admin admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:36:49.994737 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5733bff1-f4c8-45d9-91e7-fc295b990708 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:36:49.995739 dv-cinder-master-3-smb devstack@keystone.service[80535]: WARNING py.warnings [None req-5733bff1-f4c8-45d9-91e7-fc295b990708 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 11 14:36:49.995739 dv-cinder-master-3-smb devstack@keystone.service[80535]: warnings.warn(msg) Jul 11 14:36:49.995739 dv-cinder-master-3-smb devstack@keystone.service[80535]: Jul 11 14:36:49.996659 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5733bff1-f4c8-45d9-91e7-fc295b990708 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:36:50.009563 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 753/1500] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:36:49 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:36:50.013902 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ce2cad-0009-4c39-a5f1-06a7703e7eea admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:36:50.015402 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-43ce2cad-0009-4c39-a5f1-06a7703e7eea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:36:50.052038 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ce2cad-0009-4c39-a5f1-06a7703e7eea admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:36:50.149904 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55676c4a-427e-4997-a1b3-3123c629e6b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:36:50.150714 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55676c4a-427e-4997-a1b3-3123c629e6b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:36:50.150999 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55676c4a-427e-4997-a1b3-3123c629e6b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:36:50.151277 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55676c4a-427e-4997-a1b3-3123c629e6b6 admin admin] PATH_INFO: `/v3/projects/a395fb105e1642b995f75f49420aee2e/users/919629d0b7b542f2a131d3b7b7420d0c/roles/8eff41f243c843ed95505a488ca6eada` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:36:50.174139 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55676c4a-427e-4997-a1b3-3123c629e6b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a395fb105e1642b995f75f49420aee2e, user_id=919629d0b7b542f2a131d3b7b7420d0c, role_id=8eff41f243c843ed95505a488ca6eada)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:36:50.175172 dv-cinder-master-3-smb devstack@keystone.service[80534]: WARNING py.warnings [None req-55676c4a-427e-4997-a1b3-3123c629e6b6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 11 14:36:50.175172 dv-cinder-master-3-smb devstack@keystone.service[80534]: warnings.warn(msg) Jul 11 14:36:50.175172 dv-cinder-master-3-smb devstack@keystone.service[80534]: Jul 11 14:36:50.177349 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55676c4a-427e-4997-a1b3-3123c629e6b6 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:36:50.202482 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 748/1501] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jul 11 14:36:50 2022] PUT /identity/v3/projects/a395fb105e1642b995f75f49420aee2e/users/919629d0b7b542f2a131d3b7b7420d0c/roles/8eff41f243c843ed95505a488ca6eada => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:36:50.220790 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f032c61-d463-47e2-a3af-722b03151427 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:36:50.221081 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f032c61-d463-47e2-a3af-722b03151427 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:36:50.221364 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f032c61-d463-47e2-a3af-722b03151427 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:36:50.278320 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-8f032c61-d463-47e2-a3af-722b03151427 None None] MFA Rules not processed for user `919629d0b7b542f2a131d3b7b7420d0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:36:50.279545 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-8f032c61-d463-47e2-a3af-722b03151427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:36:50.361802 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 754/1502] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:36:50 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:36:50.375084 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf3f909-5c80-475a-be6c-41476f567da4 None None] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:36:50.375369 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf3f909-5c80-475a-be6c-41476f567da4 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:36:50.375645 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf3f909-5c80-475a-be6c-41476f567da4 None None] PATH_INFO: `/` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:36:50.377067 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 749/1503] 10.222.0.70 () {54 vars in 963 bytes} [Mon Jul 11 14:36:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:36:50.383081 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f73a75-e6ff-482f-a1ce-f9330bf04555 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:36:50.383376 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f73a75-e6ff-482f-a1ce-f9330bf04555 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:36:50.383677 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f73a75-e6ff-482f-a1ce-f9330bf04555 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:36:50.417154 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:36:50.463539 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-89f73a75-e6ff-482f-a1ce-f9330bf04555 None None] MFA Rules not processed for user `868e7c2dec264512b972c8736d659c34`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:36:50.464793 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-89f73a75-e6ff-482f-a1ce-f9330bf04555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:36:50.539422 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 755/1504] 10.222.0.70 () {58 vars in 1060 bytes} [Mon Jul 11 14:36:50 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:36:50.547132 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf3f909-5c80-475a-be6c-41476f567da4 None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:36:50.548659 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-ebf3f909-5c80-475a-be6c-41476f567da4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:36:50.600987 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:36:50.657062 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf3f909-5c80-475a-be6c-41476f567da4 None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:36:50.733457 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5accdb8-c2ab-42f3-9fde-62c5d75d9286 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '868e7c2dec264512b972c8736d659c34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:36:50.734027 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5accdb8-c2ab-42f3-9fde-62c5d75d9286 service cinder] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:36:50.734312 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5accdb8-c2ab-42f3-9fde-62c5d75d9286 service cinder] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:36:50.734633 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5accdb8-c2ab-42f3-9fde-62c5d75d9286 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:36:50.736321 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-e5accdb8-c2ab-42f3-9fde-62c5d75d9286 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:36:50.835772 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5accdb8-c2ab-42f3-9fde-62c5d75d9286 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:36:50.837243 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5accdb8-c2ab-42f3-9fde-62c5d75d9286 service cinder] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:36:50.841010 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:36:50.858124 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 750/1505] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:36:50 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:36:50.900933 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee1df3e-7962-4ac0-85cf-5013c5f6b8a4 None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:36:50.901392 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee1df3e-7962-4ac0-85cf-5013c5f6b8a4 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:36:50.901498 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee1df3e-7962-4ac0-85cf-5013c5f6b8a4 None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:36:50.902782 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 756/1506] 10.222.0.70 () {52 vars in 829 bytes} [Mon Jul 11 14:36:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:36:50.906265 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5accdb8-c2ab-42f3-9fde-62c5d75d9286 service cinder] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:36:50.907468 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-e5accdb8-c2ab-42f3-9fde-62c5d75d9286 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:36:51.009962 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5accdb8-c2ab-42f3-9fde-62c5d75d9286 service cinder] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:36:51.106876 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80daf7bd-e603-443c-8bd8-01396f8724f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:36:51.107741 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80daf7bd-e603-443c-8bd8-01396f8724f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:36:51.108023 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80daf7bd-e603-443c-8bd8-01396f8724f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:36:51.108323 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80daf7bd-e603-443c-8bd8-01396f8724f4 admin admin] PATH_INFO: `/v3/users/919629d0b7b542f2a131d3b7b7420d0c` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:36:51.121769 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80daf7bd-e603-443c-8bd8-01396f8724f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=919629d0b7b542f2a131d3b7b7420d0c)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:36:51.122797 dv-cinder-master-3-smb devstack@keystone.service[80534]: WARNING py.warnings [None req-80daf7bd-e603-443c-8bd8-01396f8724f4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 11 14:36:51.122797 dv-cinder-master-3-smb devstack@keystone.service[80534]: warnings.warn(msg) Jul 11 14:36:51.122797 dv-cinder-master-3-smb devstack@keystone.service[80534]: Jul 11 14:36:51.124010 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80daf7bd-e603-443c-8bd8-01396f8724f4 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:36:51.134974 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:36:51.192725 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-80daf7bd-e603-443c-8bd8-01396f8724f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '919629d0b7b542f2a131d3b7b7420d0c'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:36:51.205407 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-80daf7bd-e603-443c-8bd8-01396f8724f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '919629d0b7b542f2a131d3b7b7420d0c'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:36:51.215186 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-80daf7bd-e603-443c-8bd8-01396f8724f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '919629d0b7b542f2a131d3b7b7420d0c'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:36:51.215779 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-80daf7bd-e603-443c-8bd8-01396f8724f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '919629d0b7b542f2a131d3b7b7420d0c'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:36:51.216365 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-80daf7bd-e603-443c-8bd8-01396f8724f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '919629d0b7b542f2a131d3b7b7420d0c'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:36:51.242021 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 751/1507] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jul 11 14:36:50 2022] DELETE /identity/v3/users/919629d0b7b542f2a131d3b7b7420d0c => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:36:51.246706 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d37d76-9f7f-45d3-947e-fbc30899a5d8 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:36:51.246996 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d37d76-9f7f-45d3-947e-fbc30899a5d8 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:36:51.247311 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d37d76-9f7f-45d3-947e-fbc30899a5d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:36:51.304696 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-b4d37d76-9f7f-45d3-947e-fbc30899a5d8 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:36:51.305810 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-b4d37d76-9f7f-45d3-947e-fbc30899a5d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:36:51.382261 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:36:51.395876 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 757/1508] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:36:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:36:51.405432 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80daf7bd-e603-443c-8bd8-01396f8724f4 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:36:51.406664 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-80daf7bd-e603-443c-8bd8-01396f8724f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:36:51.509164 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80daf7bd-e603-443c-8bd8-01396f8724f4 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:36:51.563600 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:36:51.586329 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31800c2-b00c-4195-83bc-7a2b2ddef64e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20eede5ccd834862b00123310b5c3975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:36:51.586992 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31800c2-b00c-4195-83bc-7a2b2ddef64e service neutron] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:36:51.587279 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31800c2-b00c-4195-83bc-7a2b2ddef64e service neutron] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:36:51.587561 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31800c2-b00c-4195-83bc-7a2b2ddef64e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:36:51.589247 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-d31800c2-b00c-4195-83bc-7a2b2ddef64e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:36:51.702738 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31800c2-b00c-4195-83bc-7a2b2ddef64e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:36:51.704176 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31800c2-b00c-4195-83bc-7a2b2ddef64e service neutron] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:36:51.724230 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 752/1509] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:36:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:36:52.084686 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d37d76-9f7f-45d3-947e-fbc30899a5d8 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:36:52.085927 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-b4d37d76-9f7f-45d3-947e-fbc30899a5d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:36:52.097492 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d37d76-9f7f-45d3-947e-fbc30899a5d8 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:36:52.198139 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdbac24-6535-45dd-b7e9-16d4f996bc69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:36:52.198994 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdbac24-6535-45dd-b7e9-16d4f996bc69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:36:52.199272 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdbac24-6535-45dd-b7e9-16d4f996bc69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:36:52.199542 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdbac24-6535-45dd-b7e9-16d4f996bc69 admin admin] PATH_INFO: `/v3/projects/a395fb105e1642b995f75f49420aee2e` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:36:52.209593 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdbac24-6535-45dd-b7e9-16d4f996bc69 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a395fb105e1642b995f75f49420aee2e)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:36:52.210621 dv-cinder-master-3-smb devstack@keystone.service[80535]: WARNING py.warnings [None req-ebdbac24-6535-45dd-b7e9-16d4f996bc69 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 11 14:36:52.210621 dv-cinder-master-3-smb devstack@keystone.service[80535]: warnings.warn(msg) Jul 11 14:36:52.210621 dv-cinder-master-3-smb devstack@keystone.service[80535]: Jul 11 14:36:52.211833 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdbac24-6535-45dd-b7e9-16d4f996bc69 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:36:52.270252 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-ebdbac24-6535-45dd-b7e9-16d4f996bc69 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a395fb105e1642b995f75f49420aee2e', 'request_id': 'req-ebdbac24-6535-45dd-b7e9-16d4f996bc69'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:36:52.276276 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-ebdbac24-6535-45dd-b7e9-16d4f996bc69 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a395fb105e1642b995f75f49420aee2e', 'request_id': 'req-ebdbac24-6535-45dd-b7e9-16d4f996bc69'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:36:52.290142 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-ebdbac24-6535-45dd-b7e9-16d4f996bc69 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a395fb105e1642b995f75f49420aee2e', 'request_id': 'req-ebdbac24-6535-45dd-b7e9-16d4f996bc69'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:36:52.318721 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-ebdbac24-6535-45dd-b7e9-16d4f996bc69 admin admin] The token cache is being invalidate because project a395fb105e1642b995f75f49420aee2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:36:52.319204 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-ebdbac24-6535-45dd-b7e9-16d4f996bc69 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:36:52.319924 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-ebdbac24-6535-45dd-b7e9-16d4f996bc69 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:36:52.321733 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 758/1510] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jul 11 14:36:52 2022] DELETE /identity/v3/projects/a395fb105e1642b995f75f49420aee2e => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:37:01.721425 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=62 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:37:02.315781 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:38:44.571318 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7674fe95-ef1c-4e83-b735-cddc2d36c7cc None None] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:38:44.571904 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7674fe95-ef1c-4e83-b735-cddc2d36c7cc None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:38:44.571904 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7674fe95-ef1c-4e83-b735-cddc2d36c7cc None None] PATH_INFO: `/` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:38:44.573287 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 753/1511] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 11 14:38:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:38:44.578523 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1f7bca-3bf3-4013-afba-7214c558e93c None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:38:44.578990 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1f7bca-3bf3-4013-afba-7214c558e93c None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:38:44.579204 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1f7bca-3bf3-4013-afba-7214c558e93c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:38:44.664358 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-3f1f7bca-3bf3-4013-afba-7214c558e93c None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:38:44.665590 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-3f1f7bca-3bf3-4013-afba-7214c558e93c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:38:44.899130 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 759/1512] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 11 14:38:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:38:45.055036 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7674fe95-ef1c-4e83-b735-cddc2d36c7cc None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:38:45.057303 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-7674fe95-ef1c-4e83-b735-cddc2d36c7cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:38:45.180449 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7674fe95-ef1c-4e83-b735-cddc2d36c7cc None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:38:45.186380 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7835bc-aad2-40df-86c4-628094405e1d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4f8c0d696af4bd5a205ca8e9110b8cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:38:45.187100 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7835bc-aad2-40df-86c4-628094405e1d service nova] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:38:45.187386 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7835bc-aad2-40df-86c4-628094405e1d service nova] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:38:45.187665 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7835bc-aad2-40df-86c4-628094405e1d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:38:45.197170 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7835bc-aad2-40df-86c4-628094405e1d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:38:45.198753 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7835bc-aad2-40df-86c4-628094405e1d service nova] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:38:45.208163 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 754/1513] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:38:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:38:46.063250 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046f7c5c-c424-4d51-8466-3da907afca64 None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:38:46.064618 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046f7c5c-c424-4d51-8466-3da907afca64 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:38:46.064618 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046f7c5c-c424-4d51-8466-3da907afca64 None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:38:46.065978 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 760/1514] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 11 14:38:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:38:46.070840 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d404ced-e6e6-40c4-8c55-923c9699b4cd None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:38:46.071272 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d404ced-e6e6-40c4-8c55-923c9699b4cd None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:38:46.071402 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d404ced-e6e6-40c4-8c55-923c9699b4cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:38:46.090076 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-2d404ced-e6e6-40c4-8c55-923c9699b4cd None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:38:46.091287 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-2d404ced-e6e6-40c4-8c55-923c9699b4cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:38:46.100674 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 755/1515] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 11 14:38:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:38:46.264479 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046f7c5c-c424-4d51-8466-3da907afca64 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:38:46.288853 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046f7c5c-c424-4d51-8466-3da907afca64 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:38:46.295113 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fbf06a-7031-47b3-a82b-9ba56d159da7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4f8c0d696af4bd5a205ca8e9110b8cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:38:46.295719 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fbf06a-7031-47b3-a82b-9ba56d159da7 service nova] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:38:46.296002 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fbf06a-7031-47b3-a82b-9ba56d159da7 service nova] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:38:46.296305 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fbf06a-7031-47b3-a82b-9ba56d159da7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:38:46.306937 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fbf06a-7031-47b3-a82b-9ba56d159da7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:38:46.308810 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fbf06a-7031-47b3-a82b-9ba56d159da7 service nova] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:38:46.320148 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 761/1516] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:38:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:38:47.223633 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f94486b-527d-46f6-b05a-91356de082a5 None None] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:38:47.224182 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f94486b-527d-46f6-b05a-91356de082a5 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:38:47.224182 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f94486b-527d-46f6-b05a-91356de082a5 None None] PATH_INFO: `/v3` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:38:47.225504 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 756/1517] 10.222.0.62 () {54 vars in 925 bytes} [Mon Jul 11 14:38:47 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:38:47.231619 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e209b38-986d-4325-b3fa-160a97db93c1 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:38:47.232074 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e209b38-986d-4325-b3fa-160a97db93c1 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:38:47.232178 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e209b38-986d-4325-b3fa-160a97db93c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:38:47.290267 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-9e209b38-986d-4325-b3fa-160a97db93c1 None None] MFA Rules not processed for user `4bf25c7951dc4182996335ca1f0e56ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:38:47.291497 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-9e209b38-986d-4325-b3fa-160a97db93c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:38:47.308094 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:38:47.363442 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 762/1518] 10.222.0.62 () {58 vars in 1015 bytes} [Mon Jul 11 14:38:47 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:38:51.246570 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb7db0c-c58e-4068-bf0a-e67ad5aac729 None None] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:38:51.247126 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb7db0c-c58e-4068-bf0a-e67ad5aac729 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:38:51.247126 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb7db0c-c58e-4068-bf0a-e67ad5aac729 None None] PATH_INFO: `/` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:38:51.248415 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 757/1519] 10.222.0.70 () {54 vars in 960 bytes} [Mon Jul 11 14:38:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:38:51.254024 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3b6103-4b4a-49d5-9850-e38cf257a9f4 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:38:51.254467 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3b6103-4b4a-49d5-9850-e38cf257a9f4 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:38:51.254586 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3b6103-4b4a-49d5-9850-e38cf257a9f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:38:51.273709 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-4e3b6103-4b4a-49d5-9850-e38cf257a9f4 None None] MFA Rules not processed for user `4bf25c7951dc4182996335ca1f0e56ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:38:51.274916 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-4e3b6103-4b4a-49d5-9850-e38cf257a9f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:38:51.283699 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 763/1520] 10.222.0.70 () {58 vars in 1057 bytes} [Mon Jul 11 14:38:51 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:38:51.291229 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb7db0c-c58e-4068-bf0a-e67ad5aac729 None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:38:51.304720 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb7db0c-c58e-4068-bf0a-e67ad5aac729 None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:38:51.309602 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7346c209-932d-44e4-a537-c1e57c578b3a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bf25c7951dc4182996335ca1f0e56ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:38:51.310241 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7346c209-932d-44e4-a537-c1e57c578b3a service placement] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:38:51.310528 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7346c209-932d-44e4-a537-c1e57c578b3a service placement] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:38:51.310807 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7346c209-932d-44e4-a537-c1e57c578b3a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:38:51.320084 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7346c209-932d-44e4-a537-c1e57c578b3a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:38:51.321701 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7346c209-932d-44e4-a537-c1e57c578b3a service placement] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:38:51.332458 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 758/1521] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:38:51 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:38:57.571750 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d3ecf3-0b45-46e4-a933-28212ff2e799 None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:38:57.572381 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d3ecf3-0b45-46e4-a933-28212ff2e799 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:38:57.572381 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d3ecf3-0b45-46e4-a933-28212ff2e799 None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:38:57.573717 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 764/1522] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 11 14:38:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:38:57.578596 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b77605-0ef3-40f4-bb5d-bbcbbd85d5ff None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:38:57.579213 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b77605-0ef3-40f4-bb5d-bbcbbd85d5ff None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:38:57.579213 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b77605-0ef3-40f4-bb5d-bbcbbd85d5ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:38:57.597916 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-98b77605-0ef3-40f4-bb5d-bbcbbd85d5ff None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:38:57.599114 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-98b77605-0ef3-40f4-bb5d-bbcbbd85d5ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:38:57.607010 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 759/1523] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 11 14:38:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:38:57.770448 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d3ecf3-0b45-46e4-a933-28212ff2e799 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:38:57.785919 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d3ecf3-0b45-46e4-a933-28212ff2e799 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:38:57.790630 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210f4dbb-78b6-4d06-8cb9-6a0a70555cc8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4f8c0d696af4bd5a205ca8e9110b8cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:38:57.791221 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210f4dbb-78b6-4d06-8cb9-6a0a70555cc8 service nova] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:38:57.791500 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210f4dbb-78b6-4d06-8cb9-6a0a70555cc8 service nova] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:38:57.791773 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210f4dbb-78b6-4d06-8cb9-6a0a70555cc8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:38:57.801002 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210f4dbb-78b6-4d06-8cb9-6a0a70555cc8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:38:57.802587 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210f4dbb-78b6-4d06-8cb9-6a0a70555cc8 service nova] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:38:57.812048 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 765/1524] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:38:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:38:58.662372 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e636c73-2093-49c7-b162-03b285e4a3d5 None None] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:38:58.662950 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e636c73-2093-49c7-b162-03b285e4a3d5 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:38:58.662950 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e636c73-2093-49c7-b162-03b285e4a3d5 None None] PATH_INFO: `/` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:38:58.664319 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 760/1525] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 11 14:38:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:38:58.669288 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82805823-ea31-4c45-9745-827d81a5fb1d None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:38:58.669729 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82805823-ea31-4c45-9745-827d81a5fb1d None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:38:58.669840 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82805823-ea31-4c45-9745-827d81a5fb1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:38:58.688944 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-82805823-ea31-4c45-9745-827d81a5fb1d None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:38:58.690143 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-82805823-ea31-4c45-9745-827d81a5fb1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:38:58.698079 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 766/1526] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 11 14:38:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:38:58.850413 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e636c73-2093-49c7-b162-03b285e4a3d5 None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:38:58.865502 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e636c73-2093-49c7-b162-03b285e4a3d5 None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:38:58.870913 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8a0c10-b522-4f36-a2c0-9b3dc28574cf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4f8c0d696af4bd5a205ca8e9110b8cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:38:58.871544 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8a0c10-b522-4f36-a2c0-9b3dc28574cf service nova] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:38:58.871830 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8a0c10-b522-4f36-a2c0-9b3dc28574cf service nova] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:38:58.872107 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8a0c10-b522-4f36-a2c0-9b3dc28574cf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:38:58.880549 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8a0c10-b522-4f36-a2c0-9b3dc28574cf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:38:58.882280 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8a0c10-b522-4f36-a2c0-9b3dc28574cf service nova] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:38:58.892138 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 761/1527] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:38:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:39:02.915746 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5656f017-1584-485f-bcb1-b1d04288a7de None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:39:02.916302 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5656f017-1584-485f-bcb1-b1d04288a7de None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:39:02.916433 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5656f017-1584-485f-bcb1-b1d04288a7de None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:39:02.918004 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 767/1528] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 11 14:39:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:39:02.923322 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7932f98c-3247-47c6-ae81-29944b3eae5d None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:39:02.923775 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7932f98c-3247-47c6-ae81-29944b3eae5d None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:39:02.923880 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7932f98c-3247-47c6-ae81-29944b3eae5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:39:02.942747 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-7932f98c-3247-47c6-ae81-29944b3eae5d None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:39:02.943928 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-7932f98c-3247-47c6-ae81-29944b3eae5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:39:02.951683 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 762/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 11 14:39:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:39:03.026844 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5656f017-1584-485f-bcb1-b1d04288a7de None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:39:03.028572 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-5656f017-1584-485f-bcb1-b1d04288a7de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:39:03.108695 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5656f017-1584-485f-bcb1-b1d04288a7de None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:39:03.112756 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfa2bcb-186d-4a1f-a1a8-646eedd237e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20eede5ccd834862b00123310b5c3975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:39:03.113405 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfa2bcb-186d-4a1f-a1a8-646eedd237e1 service neutron] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:39:03.113693 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfa2bcb-186d-4a1f-a1a8-646eedd237e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:39:03.113972 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfa2bcb-186d-4a1f-a1a8-646eedd237e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:39:03.123005 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfa2bcb-186d-4a1f-a1a8-646eedd237e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:39:03.124479 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfa2bcb-186d-4a1f-a1a8-646eedd237e1 service neutron] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:39:03.134417 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 768/1530] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:39:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:39:05.204123 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd15b04-05ea-459c-bba4-8cc63cd9ee57 None None] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:39:05.204717 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd15b04-05ea-459c-bba4-8cc63cd9ee57 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:39:05.204886 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd15b04-05ea-459c-bba4-8cc63cd9ee57 None None] PATH_INFO: `/` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:39:05.206445 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 763/1531] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 11 14:39:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:39:05.212602 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ab7109-7d14-4dd3-982e-8abe0fdf6187 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:39:05.213071 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ab7109-7d14-4dd3-982e-8abe0fdf6187 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:39:05.213237 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ab7109-7d14-4dd3-982e-8abe0fdf6187 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:39:05.232754 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-72ab7109-7d14-4dd3-982e-8abe0fdf6187 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:39:05.233970 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-72ab7109-7d14-4dd3-982e-8abe0fdf6187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:39:05.242037 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 769/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 11 14:39:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:39:05.278595 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd15b04-05ea-459c-bba4-8cc63cd9ee57 None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:39:05.290341 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd15b04-05ea-459c-bba4-8cc63cd9ee57 None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:39:05.293848 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba287211-3060-481c-9484-a295b02a1fff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20eede5ccd834862b00123310b5c3975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:39:05.294488 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba287211-3060-481c-9484-a295b02a1fff service neutron] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:39:05.294764 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba287211-3060-481c-9484-a295b02a1fff service neutron] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:39:05.295034 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba287211-3060-481c-9484-a295b02a1fff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:39:05.304232 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba287211-3060-481c-9484-a295b02a1fff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:39:05.305695 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba287211-3060-481c-9484-a295b02a1fff service neutron] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:39:05.315478 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 764/1533] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:39:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:39:09.224528 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75a3509-6f0c-495b-b0d2-068f56b0d21d None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:39:09.225074 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75a3509-6f0c-495b-b0d2-068f56b0d21d None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:39:09.225074 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75a3509-6f0c-495b-b0d2-068f56b0d21d None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:39:09.226452 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 770/1534] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 11 14:39:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:39:09.231776 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498544a2-863f-4672-ae72-de595409a455 None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:39:09.232270 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498544a2-863f-4672-ae72-de595409a455 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:39:09.232416 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498544a2-863f-4672-ae72-de595409a455 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:39:09.252775 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-498544a2-863f-4672-ae72-de595409a455 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:39:09.253993 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-498544a2-863f-4672-ae72-de595409a455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:39:09.261956 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 765/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 11 14:39:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:39:09.573217 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75a3509-6f0c-495b-b0d2-068f56b0d21d None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:39:09.575276 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-e75a3509-6f0c-495b-b0d2-068f56b0d21d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:39:09.642119 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:39:09.656058 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75a3509-6f0c-495b-b0d2-068f56b0d21d None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:39:09.660599 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ef1673-d9f3-4c2c-aa4c-6023510d2a30 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '868e7c2dec264512b972c8736d659c34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:39:09.661248 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ef1673-d9f3-4c2c-aa4c-6023510d2a30 service cinder] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:39:09.661534 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ef1673-d9f3-4c2c-aa4c-6023510d2a30 service cinder] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:39:09.661815 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ef1673-d9f3-4c2c-aa4c-6023510d2a30 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:39:09.671139 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ef1673-d9f3-4c2c-aa4c-6023510d2a30 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:39:09.672900 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ef1673-d9f3-4c2c-aa4c-6023510d2a30 service cinder] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:39:09.682924 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 771/1536] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:39:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:39:11.841892 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f9df5f-f290-4a0f-8b52-a747ba4c9179 None None] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:39:11.842447 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f9df5f-f290-4a0f-8b52-a747ba4c9179 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:39:11.842447 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f9df5f-f290-4a0f-8b52-a747ba4c9179 None None] PATH_INFO: `/` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:39:11.843725 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 766/1537] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 11 14:39:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:39:11.849116 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83445292-544f-457a-bcfc-4012203a847e None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:39:11.849587 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83445292-544f-457a-bcfc-4012203a847e None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:39:11.849697 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83445292-544f-457a-bcfc-4012203a847e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:39:11.868373 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-83445292-544f-457a-bcfc-4012203a847e None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:39:11.869573 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-83445292-544f-457a-bcfc-4012203a847e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:39:11.878737 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 772/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 11 14:39:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:39:12.191085 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f9df5f-f290-4a0f-8b52-a747ba4c9179 None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:39:12.192923 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-21f9df5f-f290-4a0f-8b52-a747ba4c9179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:39:12.201414 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=84 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:39:12.208812 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f9df5f-f290-4a0f-8b52-a747ba4c9179 None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:39:12.212483 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c58dee5-54db-4e2c-94ea-6609215c20f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '868e7c2dec264512b972c8736d659c34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:39:12.213153 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c58dee5-54db-4e2c-94ea-6609215c20f6 service cinder] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:39:12.213455 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c58dee5-54db-4e2c-94ea-6609215c20f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:39:12.213734 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c58dee5-54db-4e2c-94ea-6609215c20f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:39:12.223345 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c58dee5-54db-4e2c-94ea-6609215c20f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:39:12.224873 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c58dee5-54db-4e2c-94ea-6609215c20f6 service cinder] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:39:12.235383 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 767/1539] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:39:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:39:21.863502 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=11 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:39:22.230290 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=5 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:40:54.884716 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c880c3e7-e0e2-4046-9b55-0ef266b0ca23 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:40:54.885775 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c880c3e7-e0e2-4046-9b55-0ef266b0ca23 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:40:54.886390 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c880c3e7-e0e2-4046-9b55-0ef266b0ca23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:40:54.907332 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-c880c3e7-e0e2-4046-9b55-0ef266b0ca23 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:40:54.909455 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-c880c3e7-e0e2-4046-9b55-0ef266b0ca23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:40:54.922301 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 773/1540] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:40:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:40:54.931441 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd78289-46d3-48a9-b2a5-0f7828e9accc None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:40:54.932020 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd78289-46d3-48a9-b2a5-0f7828e9accc None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:40:54.932020 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd78289-46d3-48a9-b2a5-0f7828e9accc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:40:54.963465 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-acd78289-46d3-48a9-b2a5-0f7828e9accc None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:40:54.965062 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-acd78289-46d3-48a9-b2a5-0f7828e9accc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:40:54.978067 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 768/1541] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:40:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:40:54.984780 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c880c3e7-e0e2-4046-9b55-0ef266b0ca23 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:40:54.997771 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c880c3e7-e0e2-4046-9b55-0ef266b0ca23 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:40:55.004087 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6443c79b-97d9-4440-813c-32a6d69aa990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:40:55.005151 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6443c79b-97d9-4440-813c-32a6d69aa990 admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:40:55.005672 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6443c79b-97d9-4440-813c-32a6d69aa990 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:40:55.006172 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6443c79b-97d9-4440-813c-32a6d69aa990 admin admin] PATH_INFO: `/v3/domains` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:40:55.007280 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6443c79b-97d9-4440-813c-32a6d69aa990 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:40:55.007924 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6443c79b-97d9-4440-813c-32a6d69aa990 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:40:55.009852 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6443c79b-97d9-4440-813c-32a6d69aa990 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:40:55.026365 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 774/1542] 10.222.0.70 () {58 vars in 1152 bytes} [Mon Jul 11 14:40:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:40:55.035044 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd78289-46d3-48a9-b2a5-0f7828e9accc None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:40:55.045891 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd78289-46d3-48a9-b2a5-0f7828e9accc None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:40:55.056893 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d869306b-ef17-4da6-bb63-aed7d10851cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:40:55.057579 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d869306b-ef17-4da6-bb63-aed7d10851cb admin admin] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:40:55.057866 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d869306b-ef17-4da6-bb63-aed7d10851cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:40:55.058147 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d869306b-ef17-4da6-bb63-aed7d10851cb admin admin] PATH_INFO: `/v3/projects` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:40:55.059157 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcd4794-0c82-4c54-9947-5bfbf64d4d08 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:40:55.059663 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d869306b-ef17-4da6-bb63-aed7d10851cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:40:55.060060 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcd4794-0c82-4c54-9947-5bfbf64d4d08 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:40:55.060585 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcd4794-0c82-4c54-9947-5bfbf64d4d08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:40:55.061629 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d869306b-ef17-4da6-bb63-aed7d10851cb admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:40:55.094421 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-9fcd4794-0c82-4c54-9947-5bfbf64d4d08 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:40:55.096044 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-9fcd4794-0c82-4c54-9947-5bfbf64d4d08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:40:55.115899 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 775/1543] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:40:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:40:55.117680 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403914d8-ed4d-4038-a7a8-89fd09d9aab2 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:40:55.118197 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403914d8-ed4d-4038-a7a8-89fd09d9aab2 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:40:55.118822 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403914d8-ed4d-4038-a7a8-89fd09d9aab2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:40:55.122436 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 769/1544] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jul 11 14:40:55 2022] POST /identity/v3/projects => generated 391 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:40:55.123914 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8793353-f274-4c09-89bd-ce493f7c1d67 None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:40:55.124231 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8793353-f274-4c09-89bd-ce493f7c1d67 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:40:55.124509 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8793353-f274-4c09-89bd-ce493f7c1d67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:40:55.145686 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-403914d8-ed4d-4038-a7a8-89fd09d9aab2 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:40:55.147247 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-403914d8-ed4d-4038-a7a8-89fd09d9aab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:40:55.150965 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-d8793353-f274-4c09-89bd-ce493f7c1d67 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:40:55.153017 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-d8793353-f274-4c09-89bd-ce493f7c1d67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:40:55.218015 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 776/1545] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:40:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:40:55.219335 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b38f35-01c7-4a4b-a067-daaffb442bbf None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:40:55.219771 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b38f35-01c7-4a4b-a067-daaffb442bbf None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:40:55.220051 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b38f35-01c7-4a4b-a067-daaffb442bbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:40:55.228262 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 770/1546] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:40:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:40:55.228262 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8793353-f274-4c09-89bd-ce493f7c1d67 None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:40:55.236738 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8793353-f274-4c09-89bd-ce493f7c1d67 None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:40:55.238915 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-e9b38f35-01c7-4a4b-a067-daaffb442bbf None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:40:55.240107 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-e9b38f35-01c7-4a4b-a067-daaffb442bbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:40:55.241396 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b46ce2-a290-44bb-9c9c-e031fe71d984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:40:55.242071 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b46ce2-a290-44bb-9c9c-e031fe71d984 admin admin] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:40:55.242357 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b46ce2-a290-44bb-9c9c-e031fe71d984 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:40:55.242635 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b46ce2-a290-44bb-9c9c-e031fe71d984 admin admin] PATH_INFO: `/v3/users` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:40:55.243326 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b46ce2-a290-44bb-9c9c-e031fe71d984 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:40:55.244375 dv-cinder-master-3-smb devstack@keystone.service[80534]: WARNING py.warnings [None req-b2b46ce2-a290-44bb-9c9c-e031fe71d984 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 11 14:40:55.244375 dv-cinder-master-3-smb devstack@keystone.service[80534]: warnings.warn(msg) Jul 11 14:40:55.244375 dv-cinder-master-3-smb devstack@keystone.service[80534]: Jul 11 14:40:55.245576 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b46ce2-a290-44bb-9c9c-e031fe71d984 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:40:55.248382 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 777/1547] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:40:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:40:55.249597 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff21d6aa-1073-4527-ba46-9652f0ca13fd None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:40:55.249884 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff21d6aa-1073-4527-ba46-9652f0ca13fd None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:40:55.250161 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff21d6aa-1073-4527-ba46-9652f0ca13fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:40:55.267740 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 771/1548] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jul 11 14:40:55 2022] POST /identity/v3/users => generated 296 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:40:55.270988 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-ff21d6aa-1073-4527-ba46-9652f0ca13fd None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:40:55.271088 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5f4fdf-fa55-4c7a-b5c1-b786d563faf2 None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:40:55.271088 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5f4fdf-fa55-4c7a-b5c1-b786d563faf2 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:40:55.271251 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-ff21d6aa-1073-4527-ba46-9652f0ca13fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:40:55.271348 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5f4fdf-fa55-4c7a-b5c1-b786d563faf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:40:55.279423 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 778/1549] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:40:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:40:55.281347 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0027f647-2f35-48e2-abbf-c1f9f50959c3 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:40:55.281787 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0027f647-2f35-48e2-abbf-c1f9f50959c3 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:40:55.282181 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0027f647-2f35-48e2-abbf-c1f9f50959c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:40:55.291238 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-4c5f4fdf-fa55-4c7a-b5c1-b786d563faf2 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:40:55.293253 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-4c5f4fdf-fa55-4c7a-b5c1-b786d563faf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:40:55.302065 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 772/1550] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:40:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:40:55.303527 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40faf122-9a43-4933-b1cd-71e28cca05b6 None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:40:55.303814 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40faf122-9a43-4933-b1cd-71e28cca05b6 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:40:55.304093 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40faf122-9a43-4933-b1cd-71e28cca05b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:40:55.308515 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-0027f647-2f35-48e2-abbf-c1f9f50959c3 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:40:55.310223 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-0027f647-2f35-48e2-abbf-c1f9f50959c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:40:55.323182 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 779/1551] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:40:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:40:55.324766 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76630174-6a27-4c63-9d10-91ae1e57a310 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:40:55.325060 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76630174-6a27-4c63-9d10-91ae1e57a310 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:40:55.325259 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-40faf122-9a43-4933-b1cd-71e28cca05b6 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:40:55.325418 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76630174-6a27-4c63-9d10-91ae1e57a310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:40:55.326442 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-40faf122-9a43-4933-b1cd-71e28cca05b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:40:55.336261 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 773/1552] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:40:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:40:55.337922 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4508cd-d56a-4316-8ab1-479ae1fbe694 None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:40:55.338201 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4508cd-d56a-4316-8ab1-479ae1fbe694 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:40:55.338503 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4508cd-d56a-4316-8ab1-479ae1fbe694 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:40:55.348897 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-76630174-6a27-4c63-9d10-91ae1e57a310 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:40:55.350107 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-76630174-6a27-4c63-9d10-91ae1e57a310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:40:55.359512 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 780/1553] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:40:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:40:55.361459 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e447ed5c-a4f4-4472-8048-f666c036a13c None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:40:55.361860 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e447ed5c-a4f4-4472-8048-f666c036a13c None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:40:55.362220 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e447ed5c-a4f4-4472-8048-f666c036a13c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:40:55.366481 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-5a4508cd-d56a-4316-8ab1-479ae1fbe694 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:40:55.367679 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-5a4508cd-d56a-4316-8ab1-479ae1fbe694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:40:55.376951 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 774/1554] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:40:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:40:55.377788 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4508cd-d56a-4316-8ab1-479ae1fbe694 None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:40:55.384548 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-e447ed5c-a4f4-4472-8048-f666c036a13c None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:40:55.385883 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-e447ed5c-a4f4-4472-8048-f666c036a13c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:40:55.388409 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4508cd-d56a-4316-8ab1-479ae1fbe694 None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:40:55.392942 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd865b00-8d83-4c87-93d6-35981d617a27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:40:55.393607 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd865b00-8d83-4c87-93d6-35981d617a27 admin admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:40:55.393889 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd865b00-8d83-4c87-93d6-35981d617a27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:40:55.394168 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd865b00-8d83-4c87-93d6-35981d617a27 admin admin] PATH_INFO: `/v3/roles` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:40:55.394390 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 781/1555] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:40:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:40:55.398252 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd865b00-8d83-4c87-93d6-35981d617a27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:40:55.398377 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e394a95e-e5cc-4ef6-8f32-f02813516600 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:40:55.398377 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e394a95e-e5cc-4ef6-8f32-f02813516600 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:40:55.398377 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e394a95e-e5cc-4ef6-8f32-f02813516600 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:40:55.398614 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd865b00-8d83-4c87-93d6-35981d617a27 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:40:55.408941 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 775/1556] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:40:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:40:55.409672 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd865b00-8d83-4c87-93d6-35981d617a27 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:40:55.417725 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-e394a95e-e5cc-4ef6-8f32-f02813516600 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:40:55.419566 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-e394a95e-e5cc-4ef6-8f32-f02813516600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:40:55.420775 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd865b00-8d83-4c87-93d6-35981d617a27 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:40:55.425378 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c460c776-c74d-4411-b619-6f03c8aaa0a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:40:55.426029 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c460c776-c74d-4411-b619-6f03c8aaa0a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:40:55.426310 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c460c776-c74d-4411-b619-6f03c8aaa0a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:40:55.426583 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c460c776-c74d-4411-b619-6f03c8aaa0a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:40:55.427304 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c460c776-c74d-4411-b619-6f03c8aaa0a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:40:55.427607 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c460c776-c74d-4411-b619-6f03c8aaa0a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:40:55.428293 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 782/1557] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:40:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:40:55.428664 dv-cinder-master-3-smb devstack@keystone.service[80534]: WARNING py.warnings [None req-c460c776-c74d-4411-b619-6f03c8aaa0a8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 11 14:40:55.428664 dv-cinder-master-3-smb devstack@keystone.service[80534]: warnings.warn(msg) Jul 11 14:40:55.428664 dv-cinder-master-3-smb devstack@keystone.service[80534]: Jul 11 14:40:55.429987 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c460c776-c74d-4411-b619-6f03c8aaa0a8 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:40:55.434204 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eea0c1f-d642-4568-b113-422395e80309 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:40:55.434675 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eea0c1f-d642-4568-b113-422395e80309 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:40:55.434961 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eea0c1f-d642-4568-b113-422395e80309 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:40:55.443658 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 776/1558] 10.222.0.70 () {58 vars in 1152 bytes} [Mon Jul 11 14:40:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:40:55.445137 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4bd7b0-dff3-4ab3-8876-2c1f9efa2c56 None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:40:55.445526 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4bd7b0-dff3-4ab3-8876-2c1f9efa2c56 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:40:55.446039 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4bd7b0-dff3-4ab3-8876-2c1f9efa2c56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:40:55.454275 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-9eea0c1f-d642-4568-b113-422395e80309 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:40:55.455503 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-9eea0c1f-d642-4568-b113-422395e80309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:40:55.463580 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 783/1559] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:40:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:40:55.465002 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eea0c1f-d642-4568-b113-422395e80309 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:40:55.467043 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-8e4bd7b0-dff3-4ab3-8876-2c1f9efa2c56 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:40:55.468454 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-8e4bd7b0-dff3-4ab3-8876-2c1f9efa2c56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:40:55.475082 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eea0c1f-d642-4568-b113-422395e80309 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:40:55.477493 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 777/1560] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:40:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:40:55.478293 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4bd7b0-dff3-4ab3-8876-2c1f9efa2c56 None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:40:55.483190 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4296590d-3c61-4488-95ae-373323f12504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:40:55.483858 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4296590d-3c61-4488-95ae-373323f12504 admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:40:55.484139 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4296590d-3c61-4488-95ae-373323f12504 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:40:55.484444 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4296590d-3c61-4488-95ae-373323f12504 admin admin] PATH_INFO: `/v3/domains` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:40:55.485177 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4296590d-3c61-4488-95ae-373323f12504 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:40:55.485483 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4296590d-3c61-4488-95ae-373323f12504 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:40:55.487077 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4296590d-3c61-4488-95ae-373323f12504 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:40:55.488490 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4bd7b0-dff3-4ab3-8876-2c1f9efa2c56 None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:40:55.493282 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d992600a-d26c-47dd-a711-21a90db59e5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:40:55.493935 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d992600a-d26c-47dd-a711-21a90db59e5c admin admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:40:55.494224 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d992600a-d26c-47dd-a711-21a90db59e5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:40:55.494501 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d992600a-d26c-47dd-a711-21a90db59e5c admin admin] PATH_INFO: `/v3/domains` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:40:55.495225 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d992600a-d26c-47dd-a711-21a90db59e5c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:40:55.495531 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d992600a-d26c-47dd-a711-21a90db59e5c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:40:55.497469 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d992600a-d26c-47dd-a711-21a90db59e5c admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:40:55.499291 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 784/1561] 10.222.0.70 () {58 vars in 1152 bytes} [Mon Jul 11 14:40:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:40:55.500217 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4296590d-3c61-4488-95ae-373323f12504 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:40:55.517794 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 778/1562] 10.222.0.70 () {58 vars in 1152 bytes} [Mon Jul 11 14:40:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:40:55.517794 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d992600a-d26c-47dd-a711-21a90db59e5c admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:40:55.518116 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4296590d-3c61-4488-95ae-373323f12504 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:40:55.519899 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d27746-19cb-4e0d-a6d0-979b99de17bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:40:55.520593 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d27746-19cb-4e0d-a6d0-979b99de17bd admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:40:55.520878 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d27746-19cb-4e0d-a6d0-979b99de17bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:40:55.521153 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d27746-19cb-4e0d-a6d0-979b99de17bd admin admin] PATH_INFO: `/v3/domains` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:40:55.521876 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d27746-19cb-4e0d-a6d0-979b99de17bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:40:55.522242 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d27746-19cb-4e0d-a6d0-979b99de17bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:40:55.523452 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d992600a-d26c-47dd-a711-21a90db59e5c admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:40:55.523789 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d27746-19cb-4e0d-a6d0-979b99de17bd admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:40:55.529584 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba2c8bd-facb-42ba-8802-4a704b362f47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:40:55.530414 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba2c8bd-facb-42ba-8802-4a704b362f47 admin admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:40:55.530703 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba2c8bd-facb-42ba-8802-4a704b362f47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:40:55.530979 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba2c8bd-facb-42ba-8802-4a704b362f47 admin admin] PATH_INFO: `/v3/roles` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:40:55.531710 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba2c8bd-facb-42ba-8802-4a704b362f47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:40:55.533378 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba2c8bd-facb-42ba-8802-4a704b362f47 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:40:55.537682 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 785/1563] 10.222.0.70 () {58 vars in 1152 bytes} [Mon Jul 11 14:40:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:40:55.538952 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d27746-19cb-4e0d-a6d0-979b99de17bd admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:40:55.545146 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 779/1564] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:40:55 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:40:55.548977 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba2c8bd-facb-42ba-8802-4a704b362f47 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:40:55.550277 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d27746-19cb-4e0d-a6d0-979b99de17bd admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:40:55.555327 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c67a6f-158a-4142-b493-fed544e46d5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:40:55.555981 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c67a6f-158a-4142-b493-fed544e46d5d admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:40:55.556290 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c67a6f-158a-4142-b493-fed544e46d5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:40:55.556565 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c67a6f-158a-4142-b493-fed544e46d5d admin admin] PATH_INFO: `/v3/domains` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:40:55.557287 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c67a6f-158a-4142-b493-fed544e46d5d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:40:55.557594 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c67a6f-158a-4142-b493-fed544e46d5d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:40:55.559205 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c67a6f-158a-4142-b493-fed544e46d5d admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:40:55.564823 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba2c8bd-facb-42ba-8802-4a704b362f47 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:40:55.571575 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 786/1565] 10.222.0.70 () {58 vars in 1152 bytes} [Mon Jul 11 14:40:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:40:55.572426 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c67a6f-158a-4142-b493-fed544e46d5d admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:40:55.573395 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817901b1-6a27-4cdc-bb22-ea433cee5ad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:40:55.574636 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817901b1-6a27-4cdc-bb22-ea433cee5ad7 admin admin] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:40:55.574910 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817901b1-6a27-4cdc-bb22-ea433cee5ad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:40:55.575181 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817901b1-6a27-4cdc-bb22-ea433cee5ad7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:40:55.575885 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817901b1-6a27-4cdc-bb22-ea433cee5ad7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:40:55.577814 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817901b1-6a27-4cdc-bb22-ea433cee5ad7 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:40:55.587413 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c67a6f-158a-4142-b493-fed544e46d5d admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:40:55.594929 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20244ae4-e7e6-4dd4-a97d-9a5e575752a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:40:55.594929 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20244ae4-e7e6-4dd4-a97d-9a5e575752a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:40:55.595463 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20244ae4-e7e6-4dd4-a97d-9a5e575752a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:40:55.595463 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20244ae4-e7e6-4dd4-a97d-9a5e575752a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:40:55.596309 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20244ae4-e7e6-4dd4-a97d-9a5e575752a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:40:55.596593 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20244ae4-e7e6-4dd4-a97d-9a5e575752a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:40:55.598932 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20244ae4-e7e6-4dd4-a97d-9a5e575752a9 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:40:55.622620 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 780/1566] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jul 11 14:40:55 2022] POST /identity/v3/projects => generated 373 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:40:55.622856 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 787/1567] 10.222.0.70 () {58 vars in 1152 bytes} [Mon Jul 11 14:40:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:40:55.622856 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20244ae4-e7e6-4dd4-a97d-9a5e575752a9 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:40:55.623062 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817901b1-6a27-4cdc-bb22-ea433cee5ad7 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:40:55.629036 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20244ae4-e7e6-4dd4-a97d-9a5e575752a9 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:40:55.629911 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:40:55.667120 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:40:55.693211 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817901b1-6a27-4cdc-bb22-ea433cee5ad7 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:40:55.695441 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7180d0d9-3d57-4eb6-96e9-be3d3e5853c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:40:55.696336 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7180d0d9-3d57-4eb6-96e9-be3d3e5853c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:40:55.697106 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7180d0d9-3d57-4eb6-96e9-be3d3e5853c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:40:55.697548 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7180d0d9-3d57-4eb6-96e9-be3d3e5853c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:40:55.698168 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64460a1-3f56-4eb2-b4ac-5aefe0eb18c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:40:55.700865 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7180d0d9-3d57-4eb6-96e9-be3d3e5853c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:40:55.700984 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64460a1-3f56-4eb2-b4ac-5aefe0eb18c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:40:55.700984 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64460a1-3f56-4eb2-b4ac-5aefe0eb18c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:40:55.700984 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64460a1-3f56-4eb2-b4ac-5aefe0eb18c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:40:55.701397 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64460a1-3f56-4eb2-b4ac-5aefe0eb18c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:40:55.701695 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64460a1-3f56-4eb2-b4ac-5aefe0eb18c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:40:55.702087 dv-cinder-master-3-smb devstack@keystone.service[80535]: WARNING py.warnings [None req-7180d0d9-3d57-4eb6-96e9-be3d3e5853c9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 11 14:40:55.702087 dv-cinder-master-3-smb devstack@keystone.service[80535]: warnings.warn(msg) Jul 11 14:40:55.702087 dv-cinder-master-3-smb devstack@keystone.service[80535]: Jul 11 14:40:55.703296 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64460a1-3f56-4eb2-b4ac-5aefe0eb18c7 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:40:55.703769 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7180d0d9-3d57-4eb6-96e9-be3d3e5853c9 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:40:55.724161 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 781/1568] 10.222.0.70 () {58 vars in 1152 bytes} [Mon Jul 11 14:40:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:40:55.724161 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64460a1-3f56-4eb2-b4ac-5aefe0eb18c7 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:40:55.727734 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64460a1-3f56-4eb2-b4ac-5aefe0eb18c7 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:40:55.733435 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1585f03d-dd11-4663-b4e6-12c007ee1c82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:40:55.734088 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1585f03d-dd11-4663-b4e6-12c007ee1c82 admin admin] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:40:55.734373 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1585f03d-dd11-4663-b4e6-12c007ee1c82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:40:55.734651 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1585f03d-dd11-4663-b4e6-12c007ee1c82 admin admin] PATH_INFO: `/v3/projects` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:40:55.735340 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1585f03d-dd11-4663-b4e6-12c007ee1c82 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:40:55.739411 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 788/1569] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jul 11 14:40:55 2022] POST /identity/v3/projects => generated 385 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:40:55.739411 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7180d0d9-3d57-4eb6-96e9-be3d3e5853c9 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:40:55.739701 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1585f03d-dd11-4663-b4e6-12c007ee1c82 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:40:55.774012 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 782/1570] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jul 11 14:40:55 2022] POST /identity/v3/projects => generated 405 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:40:55.774012 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1585f03d-dd11-4663-b4e6-12c007ee1c82 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:40:55.816468 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7180d0d9-3d57-4eb6-96e9-be3d3e5853c9 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:40:55.850786 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1585f03d-dd11-4663-b4e6-12c007ee1c82 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:40:55.856625 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fa03e1-3d3b-437a-b412-d602156b5cbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:40:55.857599 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fa03e1-3d3b-437a-b412-d602156b5cbe admin admin] REQUEST_METHOD: `PUT` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:40:55.857942 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fa03e1-3d3b-437a-b412-d602156b5cbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:40:55.858344 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fa03e1-3d3b-437a-b412-d602156b5cbe admin admin] PATH_INFO: `/v3/projects/825d34a4f14e4f7eb8981e67b936a77f/users/fee6e5aa4b4947faa8b6f7937250986b/roles/8eff41f243c843ed95505a488ca6eada` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:40:55.880211 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fa03e1-3d3b-437a-b412-d602156b5cbe admin admin] RBAC: Authorizing `identity:create_grant(project_id=825d34a4f14e4f7eb8981e67b936a77f, user_id=fee6e5aa4b4947faa8b6f7937250986b, role_id=8eff41f243c843ed95505a488ca6eada)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:40:55.884388 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b3ad6f-19fc-4749-9c51-df25fd65b146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:40:55.885169 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fa03e1-3d3b-437a-b412-d602156b5cbe admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:40:55.885486 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b3ad6f-19fc-4749-9c51-df25fd65b146 admin admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:40:55.886247 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b3ad6f-19fc-4749-9c51-df25fd65b146 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:40:55.886478 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b3ad6f-19fc-4749-9c51-df25fd65b146 admin admin] PATH_INFO: `/v3/projects` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:40:55.888184 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b3ad6f-19fc-4749-9c51-df25fd65b146 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:40:55.891456 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b3ad6f-19fc-4749-9c51-df25fd65b146 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:40:55.904629 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 783/1571] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jul 11 14:40:55 2022] PUT /identity/v3/projects/825d34a4f14e4f7eb8981e67b936a77f/users/fee6e5aa4b4947faa8b6f7937250986b/roles/8eff41f243c843ed95505a488ca6eada => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:40:55.905672 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fa03e1-3d3b-437a-b412-d602156b5cbe admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:40:55.940929 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 789/1572] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jul 11 14:40:55 2022] POST /identity/v3/projects => generated 377 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:40:55.941618 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b3ad6f-19fc-4749-9c51-df25fd65b146 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:40:55.988427 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fa03e1-3d3b-437a-b412-d602156b5cbe admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:40:55.998968 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:40:56.000818 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:40:56.014984 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b3ad6f-19fc-4749-9c51-df25fd65b146 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:40:56.019830 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b4f9b7-04be-4cb4-bdad-1d78baa56725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:40:56.020564 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b4f9b7-04be-4cb4-bdad-1d78baa56725 admin admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:40:56.020852 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b4f9b7-04be-4cb4-bdad-1d78baa56725 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:40:56.021129 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b4f9b7-04be-4cb4-bdad-1d78baa56725 admin admin] PATH_INFO: `/v3/projects` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:40:56.021830 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b4f9b7-04be-4cb4-bdad-1d78baa56725 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:40:56.023763 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b4f9b7-04be-4cb4-bdad-1d78baa56725 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:40:56.053746 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be8c199-abc0-44c3-9128-dc980a6dc582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:40:56.054151 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 790/1573] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jul 11 14:40:55 2022] POST /identity/v3/projects => generated 385 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:40:56.054424 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be8c199-abc0-44c3-9128-dc980a6dc582 admin admin] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:40:56.054628 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b4f9b7-04be-4cb4-bdad-1d78baa56725 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:40:56.054789 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be8c199-abc0-44c3-9128-dc980a6dc582 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:40:56.055071 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be8c199-abc0-44c3-9128-dc980a6dc582 admin admin] PATH_INFO: `/v3/projects` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:40:56.055943 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be8c199-abc0-44c3-9128-dc980a6dc582 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:40:56.058015 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be8c199-abc0-44c3-9128-dc980a6dc582 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:40:56.093206 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 784/1574] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jul 11 14:40:55 2022] POST /identity/v3/projects => generated 389 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:40:56.094841 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be8c199-abc0-44c3-9128-dc980a6dc582 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:40:56.125976 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b4f9b7-04be-4cb4-bdad-1d78baa56725 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:40:56.170196 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be8c199-abc0-44c3-9128-dc980a6dc582 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:40:56.174996 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e5b5b4-d388-4a0e-8bfd-086224a74ea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:40:56.175685 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e5b5b4-d388-4a0e-8bfd-086224a74ea7 admin admin] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:40:56.175975 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e5b5b4-d388-4a0e-8bfd-086224a74ea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:40:56.176280 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e5b5b4-d388-4a0e-8bfd-086224a74ea7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:40:56.176989 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e5b5b4-d388-4a0e-8bfd-086224a74ea7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:40:56.178932 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e5b5b4-d388-4a0e-8bfd-086224a74ea7 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:40:56.186408 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e03ab0-4d42-4c1b-9689-2936e5ad34fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:40:56.187089 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e03ab0-4d42-4c1b-9689-2936e5ad34fc admin admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:40:56.187375 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e03ab0-4d42-4c1b-9689-2936e5ad34fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:40:56.187654 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e03ab0-4d42-4c1b-9689-2936e5ad34fc admin admin] PATH_INFO: `/v3/users` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:40:56.188393 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e03ab0-4d42-4c1b-9689-2936e5ad34fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:40:56.190596 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e03ab0-4d42-4c1b-9689-2936e5ad34fc admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:40:56.212795 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 785/1575] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jul 11 14:40:56 2022] POST /identity/v3/projects => generated 369 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:40:56.212795 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e5b5b4-d388-4a0e-8bfd-086224a74ea7 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:40:56.220332 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 791/1576] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jul 11 14:40:56 2022] POST /identity/v3/users => generated 287 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:40:56.221650 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e03ab0-4d42-4c1b-9689-2936e5ad34fc admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:40:56.232948 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e03ab0-4d42-4c1b-9689-2936e5ad34fc admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:40:56.289167 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e5b5b4-d388-4a0e-8bfd-086224a74ea7 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:40:56.294835 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f60d23d-4210-41cc-9366-2968e2a842b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:40:56.295701 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f60d23d-4210-41cc-9366-2968e2a842b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:40:56.296111 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f60d23d-4210-41cc-9366-2968e2a842b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:40:56.296111 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f60d23d-4210-41cc-9366-2968e2a842b6 admin admin] PATH_INFO: `/v3/users` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:40:56.296809 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f60d23d-4210-41cc-9366-2968e2a842b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:40:56.298791 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f60d23d-4210-41cc-9366-2968e2a842b6 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:40:56.307107 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00db7bd-65ca-4043-9b53-2ff14a43730d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:40:56.307931 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00db7bd-65ca-4043-9b53-2ff14a43730d admin admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:40:56.309000 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00db7bd-65ca-4043-9b53-2ff14a43730d admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:40:56.309543 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00db7bd-65ca-4043-9b53-2ff14a43730d admin admin] PATH_INFO: `/v3/users` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:40:56.309826 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00db7bd-65ca-4043-9b53-2ff14a43730d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:40:56.311980 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00db7bd-65ca-4043-9b53-2ff14a43730d admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:40:56.320000 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 786/1577] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jul 11 14:40:56 2022] POST /identity/v3/users => generated 293 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:40:56.321555 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7630441f-470c-4512-b242-7c9f3d90b870 None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:40:56.321850 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7630441f-470c-4512-b242-7c9f3d90b870 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:40:56.322125 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7630441f-470c-4512-b242-7c9f3d90b870 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:40:56.337943 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 792/1578] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jul 11 14:40:56 2022] POST /identity/v3/users => generated 303 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:40:56.338520 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00db7bd-65ca-4043-9b53-2ff14a43730d admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:40:56.339880 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-7630441f-470c-4512-b242-7c9f3d90b870 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:40:56.341272 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-7630441f-470c-4512-b242-7c9f3d90b870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:40:56.345713 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:40:56.349875 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00db7bd-65ca-4043-9b53-2ff14a43730d admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:40:56.350527 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 787/1579] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:40:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:40:56.351051 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7630441f-470c-4512-b242-7c9f3d90b870 None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:40:56.358626 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:40:56.362992 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7630441f-470c-4512-b242-7c9f3d90b870 None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:40:56.364043 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd1e29d-e564-49b7-952c-33de8c804e00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:40:56.365241 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd1e29d-e564-49b7-952c-33de8c804e00 admin admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:40:56.365826 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd1e29d-e564-49b7-952c-33de8c804e00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:40:56.366400 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd1e29d-e564-49b7-952c-33de8c804e00 admin admin] PATH_INFO: `/v3/users` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:40:56.367686 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd1e29d-e564-49b7-952c-33de8c804e00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:40:56.369586 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77b0421-7f7a-408a-8e32-97c15c3e7755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:40:56.370346 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77b0421-7f7a-408a-8e32-97c15c3e7755 admin admin] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:40:56.370730 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77b0421-7f7a-408a-8e32-97c15c3e7755 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:40:56.371596 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77b0421-7f7a-408a-8e32-97c15c3e7755 admin admin] PATH_INFO: `/v3/users` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:40:56.372180 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd1e29d-e564-49b7-952c-33de8c804e00 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:40:56.372507 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77b0421-7f7a-408a-8e32-97c15c3e7755 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:40:56.374532 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77b0421-7f7a-408a-8e32-97c15c3e7755 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:40:56.396315 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 788/1580] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jul 11 14:40:56 2022] POST /identity/v3/users => generated 293 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:40:56.397181 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77b0421-7f7a-408a-8e32-97c15c3e7755 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:40:56.401192 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 793/1581] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jul 11 14:40:56 2022] POST /identity/v3/users => generated 289 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:40:56.402345 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd1e29d-e564-49b7-952c-33de8c804e00 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:40:56.408436 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77b0421-7f7a-408a-8e32-97c15c3e7755 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:40:56.412565 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd1e29d-e564-49b7-952c-33de8c804e00 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:40:56.413349 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1f22ec-3e12-422c-b551-be091396bf74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:40:56.414031 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1f22ec-3e12-422c-b551-be091396bf74 admin admin] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:40:56.414319 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1f22ec-3e12-422c-b551-be091396bf74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:40:56.414596 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1f22ec-3e12-422c-b551-be091396bf74 admin admin] PATH_INFO: `/v3/users` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:40:56.415300 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1f22ec-3e12-422c-b551-be091396bf74 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:40:56.417347 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1f22ec-3e12-422c-b551-be091396bf74 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:40:56.417482 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4c6a26-3c82-4b42-9d98-ad209c9d8953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:40:56.418909 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4c6a26-3c82-4b42-9d98-ad209c9d8953 admin admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:40:56.419186 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4c6a26-3c82-4b42-9d98-ad209c9d8953 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:40:56.419467 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4c6a26-3c82-4b42-9d98-ad209c9d8953 admin admin] PATH_INFO: `/v3/users` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:40:56.420151 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4c6a26-3c82-4b42-9d98-ad209c9d8953 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:40:56.422071 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4c6a26-3c82-4b42-9d98-ad209c9d8953 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:40:56.442160 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 789/1582] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jul 11 14:40:56 2022] POST /identity/v3/users => generated 295 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:40:56.443422 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1f22ec-3e12-422c-b551-be091396bf74 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:40:56.451451 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 794/1583] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jul 11 14:40:56 2022] POST /identity/v3/users => generated 285 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:40:56.452338 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4c6a26-3c82-4b42-9d98-ad209c9d8953 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:40:56.457402 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1f22ec-3e12-422c-b551-be091396bf74 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:40:56.462508 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4c6a26-3c82-4b42-9d98-ad209c9d8953 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:40:56.462716 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01220de-c7b0-4857-958a-6095234b0301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:40:56.463522 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01220de-c7b0-4857-958a-6095234b0301 admin admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:40:56.463745 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01220de-c7b0-4857-958a-6095234b0301 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:40:56.464019 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01220de-c7b0-4857-958a-6095234b0301 admin admin] PATH_INFO: `/v3/roles` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:40:56.465166 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01220de-c7b0-4857-958a-6095234b0301 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:40:56.466852 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01220de-c7b0-4857-958a-6095234b0301 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:40:56.469048 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9bc1e7-4e37-4fbd-8c0e-77a82ac4323b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:40:56.469740 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9bc1e7-4e37-4fbd-8c0e-77a82ac4323b admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:40:56.470028 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9bc1e7-4e37-4fbd-8c0e-77a82ac4323b admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:40:56.470308 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9bc1e7-4e37-4fbd-8c0e-77a82ac4323b admin admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:40:56.471707 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9bc1e7-4e37-4fbd-8c0e-77a82ac4323b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:40:56.473441 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9bc1e7-4e37-4fbd-8c0e-77a82ac4323b admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:40:56.479121 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 790/1584] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:40:56 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:40:56.479818 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01220de-c7b0-4857-958a-6095234b0301 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:40:56.488866 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 795/1585] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:40:56 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:40:56.489799 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9bc1e7-4e37-4fbd-8c0e-77a82ac4323b admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:40:56.491038 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01220de-c7b0-4857-958a-6095234b0301 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:40:56.497144 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3aedd8-a931-4016-b514-037afd75feb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:40:56.497837 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3aedd8-a931-4016-b514-037afd75feb6 admin admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:40:56.498116 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3aedd8-a931-4016-b514-037afd75feb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:40:56.498420 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3aedd8-a931-4016-b514-037afd75feb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:40:56.499203 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3aedd8-a931-4016-b514-037afd75feb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:40:56.500832 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3aedd8-a931-4016-b514-037afd75feb6 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:40:56.512211 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 791/1586] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:40:56 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:40:56.512918 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3aedd8-a931-4016-b514-037afd75feb6 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:40:56.524483 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3aedd8-a931-4016-b514-037afd75feb6 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:40:56.530260 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342c7e0f-4536-4388-99fc-9b3085c7a822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:40:56.530959 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342c7e0f-4536-4388-99fc-9b3085c7a822 admin admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:40:56.531310 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342c7e0f-4536-4388-99fc-9b3085c7a822 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:40:56.531656 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342c7e0f-4536-4388-99fc-9b3085c7a822 admin admin] PATH_INFO: `/v3/roles` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:40:56.532568 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342c7e0f-4536-4388-99fc-9b3085c7a822 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:40:56.534251 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342c7e0f-4536-4388-99fc-9b3085c7a822 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:40:56.545689 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 792/1587] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:40:56 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:40:56.546571 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342c7e0f-4536-4388-99fc-9b3085c7a822 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:40:56.553241 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9bc1e7-4e37-4fbd-8c0e-77a82ac4323b admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:40:56.557101 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5feee3f4-9180-4072-bc54-09b9e86fc6ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20eede5ccd834862b00123310b5c3975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:40:56.557796 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feee3f4-9180-4072-bc54-09b9e86fc6ec service neutron] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:40:56.558136 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feee3f4-9180-4072-bc54-09b9e86fc6ec service neutron] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:40:56.559156 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feee3f4-9180-4072-bc54-09b9e86fc6ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:40:56.563843 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342c7e0f-4536-4388-99fc-9b3085c7a822 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:40:56.568881 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaeb8c6-aa3f-42a8-ab64-279808b9e852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:40:56.569474 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaeb8c6-aa3f-42a8-ab64-279808b9e852 admin admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:40:56.569601 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5feee3f4-9180-4072-bc54-09b9e86fc6ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:40:56.569761 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaeb8c6-aa3f-42a8-ab64-279808b9e852 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:40:56.570037 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaeb8c6-aa3f-42a8-ab64-279808b9e852 admin admin] PATH_INFO: `/v3/roles` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:40:56.570767 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaeb8c6-aa3f-42a8-ab64-279808b9e852 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:40:56.571036 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5feee3f4-9180-4072-bc54-09b9e86fc6ec service neutron] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:40:56.572620 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaeb8c6-aa3f-42a8-ab64-279808b9e852 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:40:56.582374 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 796/1588] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:40:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:40:56.585014 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 793/1589] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:40:56 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:40:56.588169 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaeb8c6-aa3f-42a8-ab64-279808b9e852 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:40:56.588707 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5feee3f4-9180-4072-bc54-09b9e86fc6ec service neutron] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:40:56.597643 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaeb8c6-aa3f-42a8-ab64-279808b9e852 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:40:56.600957 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5feee3f4-9180-4072-bc54-09b9e86fc6ec service neutron] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:40:56.607818 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77001f1-49a4-48e9-81ad-8b3b7a8773c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:40:56.608120 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8f3871-66ae-4e94-88a6-5665259921f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:40:56.608579 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77001f1-49a4-48e9-81ad-8b3b7a8773c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:40:56.608804 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8f3871-66ae-4e94-88a6-5665259921f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:40:56.608970 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77001f1-49a4-48e9-81ad-8b3b7a8773c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:40:56.609142 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8f3871-66ae-4e94-88a6-5665259921f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:40:56.609332 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77001f1-49a4-48e9-81ad-8b3b7a8773c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:40:56.609480 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8f3871-66ae-4e94-88a6-5665259921f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:40:56.609795 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77001f1-49a4-48e9-81ad-8b3b7a8773c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:40:56.609967 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8f3871-66ae-4e94-88a6-5665259921f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:40:56.611512 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8f3871-66ae-4e94-88a6-5665259921f0 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:40:56.611797 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77001f1-49a4-48e9-81ad-8b3b7a8773c0 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:40:56.625092 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 797/1590] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:40:56 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:40:56.626515 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77001f1-49a4-48e9-81ad-8b3b7a8773c0 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:40:56.632752 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 794/1591] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:40:56 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:40:56.634207 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8f3871-66ae-4e94-88a6-5665259921f0 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:40:56.638952 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77001f1-49a4-48e9-81ad-8b3b7a8773c0 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:40:56.643688 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0410fe89-43fb-4acb-a2c3-eb10bff20e36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:40:56.644902 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0410fe89-43fb-4acb-a2c3-eb10bff20e36 admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:40:56.644902 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0410fe89-43fb-4acb-a2c3-eb10bff20e36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:40:56.645185 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8f3871-66ae-4e94-88a6-5665259921f0 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:40:56.645319 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0410fe89-43fb-4acb-a2c3-eb10bff20e36 admin admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:40:56.646154 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0410fe89-43fb-4acb-a2c3-eb10bff20e36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:40:56.648072 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0410fe89-43fb-4acb-a2c3-eb10bff20e36 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:40:56.651476 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc35fc0c-74e4-49a8-96fd-b166d86026cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:40:56.653304 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc35fc0c-74e4-49a8-96fd-b166d86026cf admin admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:40:56.653866 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc35fc0c-74e4-49a8-96fd-b166d86026cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:40:56.654240 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc35fc0c-74e4-49a8-96fd-b166d86026cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:40:56.655239 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc35fc0c-74e4-49a8-96fd-b166d86026cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:40:56.656831 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc35fc0c-74e4-49a8-96fd-b166d86026cf admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:40:56.666055 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 798/1592] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:40:56 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:40:56.666055 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0410fe89-43fb-4acb-a2c3-eb10bff20e36 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:40:56.676262 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 795/1593] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:40:56 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:40:56.676262 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc35fc0c-74e4-49a8-96fd-b166d86026cf admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:40:56.682330 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0410fe89-43fb-4acb-a2c3-eb10bff20e36 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:40:56.687191 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc35fc0c-74e4-49a8-96fd-b166d86026cf admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:40:56.687388 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a051b2b3-0f73-43bb-aa1a-77a700c906b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:40:56.688065 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a051b2b3-0f73-43bb-aa1a-77a700c906b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:40:56.688462 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a051b2b3-0f73-43bb-aa1a-77a700c906b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:40:56.688731 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a051b2b3-0f73-43bb-aa1a-77a700c906b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:40:56.689471 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a051b2b3-0f73-43bb-aa1a-77a700c906b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:40:56.691482 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a051b2b3-0f73-43bb-aa1a-77a700c906b8 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:40:56.705881 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8ab6cc-284a-4b3f-8e1b-73e11cab00fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:40:56.705881 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8ab6cc-284a-4b3f-8e1b-73e11cab00fc admin admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:40:56.705881 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8ab6cc-284a-4b3f-8e1b-73e11cab00fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:40:56.705881 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8ab6cc-284a-4b3f-8e1b-73e11cab00fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:40:56.706477 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8ab6cc-284a-4b3f-8e1b-73e11cab00fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:40:56.709751 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8ab6cc-284a-4b3f-8e1b-73e11cab00fc admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:40:56.709960 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 799/1594] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:40:56 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:40:56.710064 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a051b2b3-0f73-43bb-aa1a-77a700c906b8 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:40:56.723120 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a051b2b3-0f73-43bb-aa1a-77a700c906b8 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:40:56.728739 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 796/1595] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:40:56 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:40:56.728739 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8ab6cc-284a-4b3f-8e1b-73e11cab00fc admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:40:56.734838 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05140f5c-93d8-460a-adeb-98850af924ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:40:56.735700 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05140f5c-93d8-460a-adeb-98850af924ef admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:40:56.736122 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05140f5c-93d8-460a-adeb-98850af924ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:40:56.736581 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05140f5c-93d8-460a-adeb-98850af924ef admin admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:40:56.737536 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05140f5c-93d8-460a-adeb-98850af924ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:40:56.739474 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05140f5c-93d8-460a-adeb-98850af924ef admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:40:56.743432 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8ab6cc-284a-4b3f-8e1b-73e11cab00fc admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:40:56.750150 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd53779b-de72-4743-b2bc-1bd82c6c685d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:40:56.751116 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd53779b-de72-4743-b2bc-1bd82c6c685d admin admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:40:56.751640 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd53779b-de72-4743-b2bc-1bd82c6c685d admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:40:56.752044 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd53779b-de72-4743-b2bc-1bd82c6c685d admin admin] PATH_INFO: `/v3/roles` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:40:56.756269 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd53779b-de72-4743-b2bc-1bd82c6c685d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:40:56.756468 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 800/1596] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:40:56 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:40:56.756468 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05140f5c-93d8-460a-adeb-98850af924ef admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:40:56.756682 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd53779b-de72-4743-b2bc-1bd82c6c685d admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:40:56.765114 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05140f5c-93d8-460a-adeb-98850af924ef admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:40:56.773784 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 797/1597] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:40:56 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:40:56.774843 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd53779b-de72-4743-b2bc-1bd82c6c685d admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:40:56.778336 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce699363-e0c3-4e5b-b939-a5cf2947c880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:40:56.779027 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce699363-e0c3-4e5b-b939-a5cf2947c880 admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:40:56.779312 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce699363-e0c3-4e5b-b939-a5cf2947c880 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:40:56.779588 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce699363-e0c3-4e5b-b939-a5cf2947c880 admin admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:40:56.780355 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce699363-e0c3-4e5b-b939-a5cf2947c880 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:40:56.782024 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce699363-e0c3-4e5b-b939-a5cf2947c880 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:40:56.791338 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd53779b-de72-4743-b2bc-1bd82c6c685d admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:40:56.796924 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 801/1598] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:40:56 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:40:56.798413 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c488a70-c413-49e6-9f96-ae5439a46f4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:40:56.799208 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c488a70-c413-49e6-9f96-ae5439a46f4c admin admin] REQUEST_METHOD: `PUT` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:40:56.799208 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c488a70-c413-49e6-9f96-ae5439a46f4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:40:56.799584 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c488a70-c413-49e6-9f96-ae5439a46f4c admin admin] PATH_INFO: `/v3/projects/a94feb5a9416485295e2c8cc2291b266/users/84d965347a8e4ebfbd6f9b3af9a8c7c7/roles/8eff41f243c843ed95505a488ca6eada` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:40:56.800800 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce699363-e0c3-4e5b-b939-a5cf2947c880 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:40:56.813409 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce699363-e0c3-4e5b-b939-a5cf2947c880 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:40:56.820589 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c488a70-c413-49e6-9f96-ae5439a46f4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a94feb5a9416485295e2c8cc2291b266, user_id=84d965347a8e4ebfbd6f9b3af9a8c7c7, role_id=8eff41f243c843ed95505a488ca6eada)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:40:56.823416 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c488a70-c413-49e6-9f96-ae5439a46f4c admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:40:56.829905 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81087d06-c2d6-4e15-8dd3-016b47b02840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:40:56.831716 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81087d06-c2d6-4e15-8dd3-016b47b02840 admin admin] REQUEST_METHOD: `PUT` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:40:56.831922 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81087d06-c2d6-4e15-8dd3-016b47b02840 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:40:56.832417 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81087d06-c2d6-4e15-8dd3-016b47b02840 admin admin] PATH_INFO: `/v3/projects/1ee995ce48ba4215ae1c6c20a26434a5/users/a6012dc479f54ac5a6907a95cdc072a3/roles/8eff41f243c843ed95505a488ca6eada` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:40:56.841268 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 798/1599] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jul 11 14:40:56 2022] PUT /identity/v3/projects/a94feb5a9416485295e2c8cc2291b266/users/84d965347a8e4ebfbd6f9b3af9a8c7c7/roles/8eff41f243c843ed95505a488ca6eada => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:40:56.842096 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c488a70-c413-49e6-9f96-ae5439a46f4c admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:40:56.855390 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81087d06-c2d6-4e15-8dd3-016b47b02840 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ee995ce48ba4215ae1c6c20a26434a5, user_id=a6012dc479f54ac5a6907a95cdc072a3, role_id=8eff41f243c843ed95505a488ca6eada)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:40:56.856313 dv-cinder-master-3-smb devstack@keystone.service[80535]: WARNING py.warnings [None req-81087d06-c2d6-4e15-8dd3-016b47b02840 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 11 14:40:56.856313 dv-cinder-master-3-smb devstack@keystone.service[80535]: warnings.warn(msg) Jul 11 14:40:56.856313 dv-cinder-master-3-smb devstack@keystone.service[80535]: Jul 11 14:40:56.858278 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81087d06-c2d6-4e15-8dd3-016b47b02840 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:40:56.875387 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 802/1600] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jul 11 14:40:56 2022] PUT /identity/v3/projects/1ee995ce48ba4215ae1c6c20a26434a5/users/a6012dc479f54ac5a6907a95cdc072a3/roles/8eff41f243c843ed95505a488ca6eada => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:40:56.885185 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81087d06-c2d6-4e15-8dd3-016b47b02840 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:40:56.941728 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:40:56.951315 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c488a70-c413-49e6-9f96-ae5439a46f4c admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:40:56.965775 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81087d06-c2d6-4e15-8dd3-016b47b02840 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:40:56.970889 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00c2fac-c169-4eea-82c5-c088bfe6f178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:40:56.971794 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00c2fac-c169-4eea-82c5-c088bfe6f178 admin admin] REQUEST_METHOD: `PUT` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:40:56.972181 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00c2fac-c169-4eea-82c5-c088bfe6f178 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:40:56.972528 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00c2fac-c169-4eea-82c5-c088bfe6f178 admin admin] PATH_INFO: `/v3/projects/d3ad620e82564c96a6466a45abcbdab5/users/caa770e36e624905b2e23610e901e22d/roles/8eff41f243c843ed95505a488ca6eada` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:40:56.974239 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:40:56.993563 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00c2fac-c169-4eea-82c5-c088bfe6f178 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3ad620e82564c96a6466a45abcbdab5, user_id=caa770e36e624905b2e23610e901e22d, role_id=8eff41f243c843ed95505a488ca6eada)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:40:56.996808 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00c2fac-c169-4eea-82c5-c088bfe6f178 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:40:57.015121 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 803/1601] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jul 11 14:40:56 2022] PUT /identity/v3/projects/d3ad620e82564c96a6466a45abcbdab5/users/caa770e36e624905b2e23610e901e22d/roles/8eff41f243c843ed95505a488ca6eada => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:40:57.015738 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00c2fac-c169-4eea-82c5-c088bfe6f178 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:40:57.022358 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a44bfc1-06c3-4983-9cf4-da32a3ec5b29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:40:57.023268 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a44bfc1-06c3-4983-9cf4-da32a3ec5b29 admin admin] REQUEST_METHOD: `PUT` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:40:57.023550 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a44bfc1-06c3-4983-9cf4-da32a3ec5b29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:40:57.023936 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a44bfc1-06c3-4983-9cf4-da32a3ec5b29 admin admin] PATH_INFO: `/v3/projects/2dcc139831c34b80a133956d11abfdb8/users/c992e0de17eb4db983a163ec4db77620/roles/8eff41f243c843ed95505a488ca6eada` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:40:57.046057 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a44bfc1-06c3-4983-9cf4-da32a3ec5b29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2dcc139831c34b80a133956d11abfdb8, user_id=c992e0de17eb4db983a163ec4db77620, role_id=8eff41f243c843ed95505a488ca6eada)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:40:57.049313 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a44bfc1-06c3-4983-9cf4-da32a3ec5b29 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:40:57.076457 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 799/1602] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jul 11 14:40:56 2022] PUT /identity/v3/projects/2dcc139831c34b80a133956d11abfdb8/users/c992e0de17eb4db983a163ec4db77620/roles/8eff41f243c843ed95505a488ca6eada => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:40:57.077664 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a44bfc1-06c3-4983-9cf4-da32a3ec5b29 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:40:57.106960 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00c2fac-c169-4eea-82c5-c088bfe6f178 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:40:57.153937 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a44bfc1-06c3-4983-9cf4-da32a3ec5b29 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:40:57.159991 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a179753f-a0ce-4ce0-aaf1-b8c2a56d8d30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:40:57.160945 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a179753f-a0ce-4ce0-aaf1-b8c2a56d8d30 admin admin] REQUEST_METHOD: `PUT` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:40:57.161230 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a179753f-a0ce-4ce0-aaf1-b8c2a56d8d30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:40:57.161508 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a179753f-a0ce-4ce0-aaf1-b8c2a56d8d30 admin admin] PATH_INFO: `/v3/projects/5a076f0bf242483497f1297c87240c2d/users/8d5ccf016a41426cb589005da57bbf6f/roles/8eff41f243c843ed95505a488ca6eada` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:40:57.181590 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a179753f-a0ce-4ce0-aaf1-b8c2a56d8d30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a076f0bf242483497f1297c87240c2d, user_id=8d5ccf016a41426cb589005da57bbf6f, role_id=8eff41f243c843ed95505a488ca6eada)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:40:57.185623 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a179753f-a0ce-4ce0-aaf1-b8c2a56d8d30 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:40:57.197289 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe6a6f9-68e5-4810-ad7a-04fa9a4f2d9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:40:57.198556 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe6a6f9-68e5-4810-ad7a-04fa9a4f2d9c admin admin] REQUEST_METHOD: `PUT` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:40:57.200089 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe6a6f9-68e5-4810-ad7a-04fa9a4f2d9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:40:57.200808 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe6a6f9-68e5-4810-ad7a-04fa9a4f2d9c admin admin] PATH_INFO: `/v3/projects/26bf43591445472585b2e35428f6d07e/users/61a806b41a1442188b56d371cbf713d1/roles/8eff41f243c843ed95505a488ca6eada` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:40:57.206883 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 800/1603] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jul 11 14:40:57 2022] PUT /identity/v3/projects/5a076f0bf242483497f1297c87240c2d/users/8d5ccf016a41426cb589005da57bbf6f/roles/8eff41f243c843ed95505a488ca6eada => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:40:57.208181 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a179753f-a0ce-4ce0-aaf1-b8c2a56d8d30 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:40:57.222203 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe6a6f9-68e5-4810-ad7a-04fa9a4f2d9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=26bf43591445472585b2e35428f6d07e, user_id=61a806b41a1442188b56d371cbf713d1, role_id=8eff41f243c843ed95505a488ca6eada)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:40:57.226083 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe6a6f9-68e5-4810-ad7a-04fa9a4f2d9c admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:40:57.246354 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 804/1604] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jul 11 14:40:57 2022] PUT /identity/v3/projects/26bf43591445472585b2e35428f6d07e/users/61a806b41a1442188b56d371cbf713d1/roles/8eff41f243c843ed95505a488ca6eada => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:40:57.248179 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48fa47e-8dc5-48a2-9685-60b34e80e0a0 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:40:57.248666 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48fa47e-8dc5-48a2-9685-60b34e80e0a0 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:40:57.249139 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48fa47e-8dc5-48a2-9685-60b34e80e0a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:40:57.288884 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-c48fa47e-8dc5-48a2-9685-60b34e80e0a0 None None] MFA Rules not processed for user `84d965347a8e4ebfbd6f9b3af9a8c7c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:40:57.291024 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-c48fa47e-8dc5-48a2-9685-60b34e80e0a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:40:57.293934 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a179753f-a0ce-4ce0-aaf1-b8c2a56d8d30 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:40:57.336737 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:40:57.351728 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:40:57.372962 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b178d28-89c4-4eeb-a991-eaf4752d9ed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:40:57.373891 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b178d28-89c4-4eeb-a991-eaf4752d9ed4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:40:57.374176 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b178d28-89c4-4eeb-a991-eaf4752d9ed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:40:57.374532 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b178d28-89c4-4eeb-a991-eaf4752d9ed4 admin admin] PATH_INFO: `/v3/projects/177be2414e2b47b4914b218196d3d6aa/users/0f1ce165f69645e4a94b2484118d638a/roles/8eff41f243c843ed95505a488ca6eada` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:40:57.395577 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 805/1605] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:40:57 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:40:57.395577 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c78170-f943-4424-8efa-58e5d172101d None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:40:57.395577 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c78170-f943-4424-8efa-58e5d172101d None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:40:57.395577 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c78170-f943-4424-8efa-58e5d172101d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:40:57.397877 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b178d28-89c4-4eeb-a991-eaf4752d9ed4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=177be2414e2b47b4914b218196d3d6aa, user_id=0f1ce165f69645e4a94b2484118d638a, role_id=8eff41f243c843ed95505a488ca6eada)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:40:57.400731 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b178d28-89c4-4eeb-a991-eaf4752d9ed4 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:40:57.419935 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 801/1606] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jul 11 14:40:57 2022] PUT /identity/v3/projects/177be2414e2b47b4914b218196d3d6aa/users/0f1ce165f69645e4a94b2484118d638a/roles/8eff41f243c843ed95505a488ca6eada => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:40:57.421608 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece1c1c2-10a5-4379-856b-e85af2b3e2fa None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:40:57.422042 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece1c1c2-10a5-4379-856b-e85af2b3e2fa None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:40:57.422450 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece1c1c2-10a5-4379-856b-e85af2b3e2fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:40:57.442224 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-b5c78170-f943-4424-8efa-58e5d172101d None None] MFA Rules not processed for user `a6012dc479f54ac5a6907a95cdc072a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:40:57.443731 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-b5c78170-f943-4424-8efa-58e5d172101d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:40:57.446615 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-ece1c1c2-10a5-4379-856b-e85af2b3e2fa None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:40:57.448223 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-ece1c1c2-10a5-4379-856b-e85af2b3e2fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:40:57.537130 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 802/1607] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:40:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:40:57.542400 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbcbbec-f54a-4d1f-ac09-68cb0ce8f0ef None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:40:57.543069 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbcbbec-f54a-4d1f-ac09-68cb0ce8f0ef None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:40:57.543366 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbcbbec-f54a-4d1f-ac09-68cb0ce8f0ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:40:57.555032 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 806/1608] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:40:57 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:40:57.557700 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aedadad-9c53-44b5-b1b4-1ba9bb616b22 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:40:57.557700 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aedadad-9c53-44b5-b1b4-1ba9bb616b22 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:40:57.557700 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aedadad-9c53-44b5-b1b4-1ba9bb616b22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:40:57.579199 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-6bbcbbec-f54a-4d1f-ac09-68cb0ce8f0ef None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:40:57.580799 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-6bbcbbec-f54a-4d1f-ac09-68cb0ce8f0ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:40:57.603650 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-8aedadad-9c53-44b5-b1b4-1ba9bb616b22 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:40:57.604475 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 803/1609] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:40:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:40:57.606718 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828a1599-121b-4433-a318-ba23868926ca None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:40:57.607624 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-8aedadad-9c53-44b5-b1b4-1ba9bb616b22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:40:57.608397 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828a1599-121b-4433-a318-ba23868926ca None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:40:57.609317 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828a1599-121b-4433-a318-ba23868926ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:40:57.619216 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 807/1610] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:40:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:40:57.620049 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aedadad-9c53-44b5-b1b4-1ba9bb616b22 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:40:57.632945 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aedadad-9c53-44b5-b1b4-1ba9bb616b22 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:40:57.639018 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c51bb53-3f5d-427c-bf73-7080404fff04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:40:57.639711 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c51bb53-3f5d-427c-bf73-7080404fff04 admin admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:40:57.640512 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c51bb53-3f5d-427c-bf73-7080404fff04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:40:57.640512 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c51bb53-3f5d-427c-bf73-7080404fff04 admin admin] PATH_INFO: `/v3/projects` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:40:57.641031 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c51bb53-3f5d-427c-bf73-7080404fff04 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:40:57.643039 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c51bb53-3f5d-427c-bf73-7080404fff04 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:40:57.651085 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-828a1599-121b-4433-a318-ba23868926ca None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:40:57.653142 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-828a1599-121b-4433-a318-ba23868926ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:40:57.662367 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 804/1611] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:40:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:40:57.674603 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35740e4e-43f2-4613-b493-9e3ca5c2f9b2 None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:40:57.675435 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35740e4e-43f2-4613-b493-9e3ca5c2f9b2 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:40:57.675923 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35740e4e-43f2-4613-b493-9e3ca5c2f9b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:40:57.678955 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 808/1612] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jul 11 14:40:57 2022] POST /identity/v3/projects => generated 373 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:40:57.680621 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c51bb53-3f5d-427c-bf73-7080404fff04 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:40:57.724415 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-35740e4e-43f2-4613-b493-9e3ca5c2f9b2 None None] MFA Rules not processed for user `0f1ce165f69645e4a94b2484118d638a`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:40:57.725696 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-35740e4e-43f2-4613-b493-9e3ca5c2f9b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:40:57.820806 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c51bb53-3f5d-427c-bf73-7080404fff04 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:40:57.826581 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664400da-229f-44b1-bc6d-7da5ab5659d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20eede5ccd834862b00123310b5c3975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:40:57.832310 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 805/1613] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:40:57 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:40:57.832509 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664400da-229f-44b1-bc6d-7da5ab5659d0 service neutron] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:40:57.832509 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664400da-229f-44b1-bc6d-7da5ab5659d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:40:57.832509 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664400da-229f-44b1-bc6d-7da5ab5659d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:40:57.832765 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c66f8e-b543-4e84-b5ea-6f64159c9f66 None None] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:40:57.832765 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c66f8e-b543-4e84-b5ea-6f64159c9f66 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:40:57.832765 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c66f8e-b543-4e84-b5ea-6f64159c9f66 None None] PATH_INFO: `/` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:40:57.832765 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 806/1614] 10.222.0.70 () {54 vars in 961 bytes} [Mon Jul 11 14:40:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:40:57.839060 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c66f8e-b543-4e84-b5ea-6f64159c9f66 None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:40:57.855988 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c66f8e-b543-4e84-b5ea-6f64159c9f66 None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:40:57.867694 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea67e195-0f4c-4590-9145-3e111c3040fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20eede5ccd834862b00123310b5c3975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:40:57.869539 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea67e195-0f4c-4590-9145-3e111c3040fc service neutron] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:40:57.870072 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea67e195-0f4c-4590-9145-3e111c3040fc service neutron] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:40:57.870713 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea67e195-0f4c-4590-9145-3e111c3040fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:40:57.926696 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:40:57.930336 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664400da-229f-44b1-bc6d-7da5ab5659d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:40:57.933942 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664400da-229f-44b1-bc6d-7da5ab5659d0 service neutron] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:40:57.946913 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 809/1615] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:40:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:40:57.951259 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:40:57.955142 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664400da-229f-44b1-bc6d-7da5ab5659d0 service neutron] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:40:57.973275 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664400da-229f-44b1-bc6d-7da5ab5659d0 service neutron] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:40:57.979390 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f49af9-55a7-4164-b7aa-2dbf1eaa1f2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20eede5ccd834862b00123310b5c3975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:40:57.980829 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f49af9-55a7-4164-b7aa-2dbf1eaa1f2a service neutron] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:40:57.981261 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f49af9-55a7-4164-b7aa-2dbf1eaa1f2a service neutron] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:40:57.981688 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f49af9-55a7-4164-b7aa-2dbf1eaa1f2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:40:57.998331 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f49af9-55a7-4164-b7aa-2dbf1eaa1f2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:40:58.000609 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea67e195-0f4c-4590-9145-3e111c3040fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:40:58.000860 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f49af9-55a7-4164-b7aa-2dbf1eaa1f2a service neutron] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:40:58.002080 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea67e195-0f4c-4590-9145-3e111c3040fc service neutron] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:40:58.014892 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 807/1616] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:40:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:40:58.015977 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea67e195-0f4c-4590-9145-3e111c3040fc service neutron] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:40:58.020918 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 810/1617] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:40:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:40:58.022094 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f49af9-55a7-4164-b7aa-2dbf1eaa1f2a service neutron] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:40:58.029171 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea67e195-0f4c-4590-9145-3e111c3040fc service neutron] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:40:58.034460 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b049aff-11e6-4a49-9184-7a3a892a3830 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20eede5ccd834862b00123310b5c3975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:40:58.035122 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b049aff-11e6-4a49-9184-7a3a892a3830 service neutron] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:40:58.035440 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b049aff-11e6-4a49-9184-7a3a892a3830 service neutron] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:40:58.035720 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b049aff-11e6-4a49-9184-7a3a892a3830 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:40:58.042784 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f49af9-55a7-4164-b7aa-2dbf1eaa1f2a service neutron] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:40:58.050991 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b049aff-11e6-4a49-9184-7a3a892a3830 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:40:58.053033 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b049aff-11e6-4a49-9184-7a3a892a3830 service neutron] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:40:58.055074 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d503f79f-85e8-4d88-aa2b-1558869106dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:40:58.055788 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d503f79f-85e8-4d88-aa2b-1558869106dc admin admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:40:58.056075 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d503f79f-85e8-4d88-aa2b-1558869106dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:40:58.056397 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d503f79f-85e8-4d88-aa2b-1558869106dc admin admin] PATH_INFO: `/v3/users` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:40:58.058905 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d503f79f-85e8-4d88-aa2b-1558869106dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:40:58.063328 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d503f79f-85e8-4d88-aa2b-1558869106dc admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:40:58.072554 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 808/1618] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:40:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:40:58.076820 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfa8787-6900-4437-96a8-e39692aabea8 None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:40:58.077522 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfa8787-6900-4437-96a8-e39692aabea8 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:40:58.078120 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfa8787-6900-4437-96a8-e39692aabea8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:40:58.131070 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 811/1619] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jul 11 14:40:58 2022] POST /identity/v3/users => generated 293 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:40:58.134406 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8781977-184a-4baa-b6f2-cdd9b1bd53b2 None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:40:58.135082 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8781977-184a-4baa-b6f2-cdd9b1bd53b2 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:40:58.135893 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8781977-184a-4baa-b6f2-cdd9b1bd53b2 None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:40:58.139400 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 812/1620] 10.222.0.70 () {54 vars in 961 bytes} [Mon Jul 11 14:40:58 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:40:58.140807 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8781977-184a-4baa-b6f2-cdd9b1bd53b2 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:40:58.164300 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8781977-184a-4baa-b6f2-cdd9b1bd53b2 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:40:58.173656 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c08090-f7d6-40b5-aa91-9dd78c096c8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:40:58.174538 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c08090-f7d6-40b5-aa91-9dd78c096c8d admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:40:58.175111 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c08090-f7d6-40b5-aa91-9dd78c096c8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:40:58.175488 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c08090-f7d6-40b5-aa91-9dd78c096c8d admin admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:40:58.177167 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c08090-f7d6-40b5-aa91-9dd78c096c8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:40:58.179100 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c08090-f7d6-40b5-aa91-9dd78c096c8d admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:40:58.195185 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-8cfa8787-6900-4437-96a8-e39692aabea8 None None] MFA Rules not processed for user `f4f8c0d696af4bd5a205ca8e9110b8cc`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:40:58.196476 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-8cfa8787-6900-4437-96a8-e39692aabea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:40:58.204543 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 813/1621] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:40:58 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:40:58.206320 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33ff2ed-8855-4404-8814-04d8606203fe None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:40:58.208013 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33ff2ed-8855-4404-8814-04d8606203fe None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:40:58.208535 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33ff2ed-8855-4404-8814-04d8606203fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:40:58.252483 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-c33ff2ed-8855-4404-8814-04d8606203fe None None] MFA Rules not processed for user `f4f8c0d696af4bd5a205ca8e9110b8cc`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:40:58.258368 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-c33ff2ed-8855-4404-8814-04d8606203fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:40:58.302983 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 809/1622] 10.222.0.70 () {58 vars in 1058 bytes} [Mon Jul 11 14:40:58 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:40:58.304064 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfa8787-6900-4437-96a8-e39692aabea8 None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:40:58.335213 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfa8787-6900-4437-96a8-e39692aabea8 None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:40:58.349934 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90910b20-a970-40b0-b0f1-89cadaf9d6a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:40:58.352025 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90910b20-a970-40b0-b0f1-89cadaf9d6a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:40:58.352856 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90910b20-a970-40b0-b0f1-89cadaf9d6a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:40:58.354713 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90910b20-a970-40b0-b0f1-89cadaf9d6a0 admin admin] PATH_INFO: `/v3/projects/6e2f4af802a54c4ea6e5c1f59a618f1c/users/c88dd518b2ed47fb946e4e99498a6ff2/roles/b46df176b0fe479da63c318db225bed4` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:40:58.386226 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 814/1623] 10.222.0.70 () {58 vars in 1058 bytes} [Mon Jul 11 14:40:58 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:40:58.388165 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33ff2ed-8855-4404-8814-04d8606203fe None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:40:58.401442 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90910b20-a970-40b0-b0f1-89cadaf9d6a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e2f4af802a54c4ea6e5c1f59a618f1c, user_id=c88dd518b2ed47fb946e4e99498a6ff2, role_id=b46df176b0fe479da63c318db225bed4)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:40:58.406053 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90910b20-a970-40b0-b0f1-89cadaf9d6a0 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:40:58.415226 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33ff2ed-8855-4404-8814-04d8606203fe None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:40:58.440036 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531c999b-142d-4e44-9988-ee3a92979fb6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4f8c0d696af4bd5a205ca8e9110b8cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:40:58.443146 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531c999b-142d-4e44-9988-ee3a92979fb6 service nova] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:40:58.443818 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531c999b-142d-4e44-9988-ee3a92979fb6 service nova] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:40:58.445267 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 810/1624] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jul 11 14:40:58 2022] PUT /identity/v3/projects/6e2f4af802a54c4ea6e5c1f59a618f1c/users/c88dd518b2ed47fb946e4e99498a6ff2/roles/b46df176b0fe479da63c318db225bed4 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:40:58.445944 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531c999b-142d-4e44-9988-ee3a92979fb6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:40:58.453440 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90910b20-a970-40b0-b0f1-89cadaf9d6a0 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:40:58.673089 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90910b20-a970-40b0-b0f1-89cadaf9d6a0 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:40:58.675883 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531c999b-142d-4e44-9988-ee3a92979fb6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:40:58.678703 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531c999b-142d-4e44-9988-ee3a92979fb6 service nova] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:40:58.688970 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0bc34b-81bd-438d-a040-19f55c4c6af7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4f8c0d696af4bd5a205ca8e9110b8cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:40:58.689807 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0bc34b-81bd-438d-a040-19f55c4c6af7 service nova] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:40:58.690092 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0bc34b-81bd-438d-a040-19f55c4c6af7 service nova] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:40:58.690638 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0bc34b-81bd-438d-a040-19f55c4c6af7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:40:58.693586 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 815/1625] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:40:58 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:40:58.709261 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531c999b-142d-4e44-9988-ee3a92979fb6 service nova] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:40:58.717285 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:40:58.728635 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531c999b-142d-4e44-9988-ee3a92979fb6 service nova] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:40:58.873883 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:40:58.915291 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afcc841-85e4-42f6-b44d-dea00ef7c410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:40:58.916002 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afcc841-85e4-42f6-b44d-dea00ef7c410 admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:40:58.916303 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afcc841-85e4-42f6-b44d-dea00ef7c410 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:40:58.916588 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afcc841-85e4-42f6-b44d-dea00ef7c410 admin admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:40:58.917353 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afcc841-85e4-42f6-b44d-dea00ef7c410 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:40:58.919167 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afcc841-85e4-42f6-b44d-dea00ef7c410 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:40:58.922842 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0bc34b-81bd-438d-a040-19f55c4c6af7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:40:58.926203 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0bc34b-81bd-438d-a040-19f55c4c6af7 service nova] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:40:58.960542 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 811/1627] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:40:58 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 512 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:40:58.961124 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 816/1627] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:40:58 2022] GET /identity/v3/roles => generated 1420 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:40:58.961631 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0bc34b-81bd-438d-a040-19f55c4c6af7 service nova] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:40:58.985263 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0bc34b-81bd-438d-a040-19f55c4c6af7 service nova] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:40:58.995174 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bafd25b-ff10-494f-9a91-479af296975c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:40:58.997282 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bafd25b-ff10-494f-9a91-479af296975c admin admin] REQUEST_METHOD: `PUT` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:40:58.997785 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bafd25b-ff10-494f-9a91-479af296975c admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:40:58.998230 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bafd25b-ff10-494f-9a91-479af296975c admin admin] PATH_INFO: `/v3/projects/6e2f4af802a54c4ea6e5c1f59a618f1c/users/c88dd518b2ed47fb946e4e99498a6ff2/roles/b46df176b0fe479da63c318db225bed4` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:40:59.017203 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bafd25b-ff10-494f-9a91-479af296975c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e2f4af802a54c4ea6e5c1f59a618f1c, user_id=c88dd518b2ed47fb946e4e99498a6ff2, role_id=b46df176b0fe479da63c318db225bed4)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:40:59.026090 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bafd25b-ff10-494f-9a91-479af296975c admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:40:59.057973 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 812/1628] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jul 11 14:40:58 2022] PUT /identity/v3/projects/6e2f4af802a54c4ea6e5c1f59a618f1c/users/c88dd518b2ed47fb946e4e99498a6ff2/roles/b46df176b0fe479da63c318db225bed4 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:40:59.070516 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e24a4be-c0a3-4735-b285-ab226832376e None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:40:59.070852 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e24a4be-c0a3-4735-b285-ab226832376e None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:40:59.071281 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e24a4be-c0a3-4735-b285-ab226832376e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:40:59.110505 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-9e24a4be-c0a3-4735-b285-ab226832376e None None] MFA Rules not processed for user `c88dd518b2ed47fb946e4e99498a6ff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:40:59.112194 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-9e24a4be-c0a3-4735-b285-ab226832376e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:40:59.231554 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 817/1629] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:40:59 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:40:59.240736 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bafd25b-ff10-494f-9a91-479af296975c admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:40:59.538608 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bafd25b-ff10-494f-9a91-479af296975c admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:40:59.560343 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64965100-2200-4712-9332-8fbcecaef20f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '868e7c2dec264512b972c8736d659c34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:40:59.560343 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64965100-2200-4712-9332-8fbcecaef20f service cinder] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:40:59.560343 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64965100-2200-4712-9332-8fbcecaef20f service cinder] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:40:59.560343 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64965100-2200-4712-9332-8fbcecaef20f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:40:59.627321 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64965100-2200-4712-9332-8fbcecaef20f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:40:59.630388 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64965100-2200-4712-9332-8fbcecaef20f service cinder] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:40:59.635960 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9cd10a-ebef-4b4a-8aa7-bb3a250c75ff None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:40:59.637316 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9cd10a-ebef-4b4a-8aa7-bb3a250c75ff None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:40:59.637886 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9cd10a-ebef-4b4a-8aa7-bb3a250c75ff None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:40:59.640302 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 818/1630] 10.222.0.70 () {54 vars in 912 bytes} [Mon Jul 11 14:40:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 14:40:59.648886 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa2510f-2b7b-443a-849f-7e638315dce0 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:40:59.649336 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa2510f-2b7b-443a-849f-7e638315dce0 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:40:59.649871 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa2510f-2b7b-443a-849f-7e638315dce0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:40:59.682714 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 813/1631] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:40:59 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:40:59.688826 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040ae412-8c93-4006-be74-cfe93ed55206 None None] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:40:59.694168 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040ae412-8c93-4006-be74-cfe93ed55206 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:40:59.694823 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040ae412-8c93-4006-be74-cfe93ed55206 None None] PATH_INFO: `/` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:40:59.701170 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 814/1632] 10.222.0.70 () {54 vars in 912 bytes} [Mon Jul 11 14:40:59 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 14:40:59.717733 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-4fa2510f-2b7b-443a-849f-7e638315dce0 None None] MFA Rules not processed for user `f4f8c0d696af4bd5a205ca8e9110b8cc`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:40:59.720575 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-4fa2510f-2b7b-443a-849f-7e638315dce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:40:59.723196 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5623841d-146f-4309-9bc3-b4a0cdab77c7 None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:40:59.723920 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5623841d-146f-4309-9bc3-b4a0cdab77c7 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:40:59.724452 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5623841d-146f-4309-9bc3-b4a0cdab77c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:40:59.841973 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-5623841d-146f-4309-9bc3-b4a0cdab77c7 None None] MFA Rules not processed for user `f4f8c0d696af4bd5a205ca8e9110b8cc`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:40:59.844082 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-5623841d-146f-4309-9bc3-b4a0cdab77c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:40:59.870086 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 819/1633] 10.222.0.70 () {58 vars in 1009 bytes} [Mon Jul 11 14:40:59 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:40:59.892432 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa2510f-2b7b-443a-849f-7e638315dce0 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:40:59.893345 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 815/1634] 10.222.0.70 () {58 vars in 1009 bytes} [Mon Jul 11 14:40:59 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:40:59.916013 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa2510f-2b7b-443a-849f-7e638315dce0 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:40:59.920396 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ece8bf1-3988-4fad-8bf4-53d56e390c52 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '868e7c2dec264512b972c8736d659c34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:40:59.921080 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ece8bf1-3988-4fad-8bf4-53d56e390c52 service cinder] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:40:59.921372 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ece8bf1-3988-4fad-8bf4-53d56e390c52 service cinder] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:40:59.921653 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ece8bf1-3988-4fad-8bf4-53d56e390c52 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:40:59.928489 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5623841d-146f-4309-9bc3-b4a0cdab77c7 None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:40:59.936453 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ece8bf1-3988-4fad-8bf4-53d56e390c52 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:40:59.938025 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ece8bf1-3988-4fad-8bf4-53d56e390c52 service cinder] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:40:59.955233 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 820/1635] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:40:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:40:59.960763 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5623841d-146f-4309-9bc3-b4a0cdab77c7 None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:40:59.967422 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c2d657-3d2e-44b9-ac64-df22ccc524f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '868e7c2dec264512b972c8736d659c34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:40:59.968559 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c2d657-3d2e-44b9-ac64-df22ccc524f2 service cinder] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:40:59.968962 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c2d657-3d2e-44b9-ac64-df22ccc524f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:40:59.969466 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c2d657-3d2e-44b9-ac64-df22ccc524f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:40:59.985150 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c2d657-3d2e-44b9-ac64-df22ccc524f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:40:59.987153 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c2d657-3d2e-44b9-ac64-df22ccc524f2 service cinder] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:00.019212 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 816/1636] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:40:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:41:00.862560 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ece8bf1-3988-4fad-8bf4-53d56e390c52 service cinder] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:00.882004 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ece8bf1-3988-4fad-8bf4-53d56e390c52 service cinder] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:00.896811 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538166a9-b1c6-497a-8d1a-360bc9cda0ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '868e7c2dec264512b972c8736d659c34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:00.898111 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538166a9-b1c6-497a-8d1a-360bc9cda0ab service cinder] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:00.902900 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538166a9-b1c6-497a-8d1a-360bc9cda0ab service cinder] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:00.903493 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538166a9-b1c6-497a-8d1a-360bc9cda0ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:01.076856 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:41:01.130624 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538166a9-b1c6-497a-8d1a-360bc9cda0ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:01.133709 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538166a9-b1c6-497a-8d1a-360bc9cda0ab service cinder] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:01.150556 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 821/1637] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:41:00 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:41:01.321951 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816c0a3e-6d4d-4186-9540-b8dc909c7e1b None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:01.322874 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816c0a3e-6d4d-4186-9540-b8dc909c7e1b None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:01.322874 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816c0a3e-6d4d-4186-9540-b8dc909c7e1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:01.383620 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-816c0a3e-6d4d-4186-9540-b8dc909c7e1b None None] MFA Rules not processed for user `c992e0de17eb4db983a163ec4db77620`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:41:01.389623 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-816c0a3e-6d4d-4186-9540-b8dc909c7e1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:01.614407 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 817/1638] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:41:01 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:41:01.619464 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538166a9-b1c6-497a-8d1a-360bc9cda0ab service cinder] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:01.974888 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538166a9-b1c6-497a-8d1a-360bc9cda0ab service cinder] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:02.008372 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30109bee-66b0-4f77-b483-93024baf9008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:02.014067 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30109bee-66b0-4f77-b483-93024baf9008 admin admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:02.015093 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30109bee-66b0-4f77-b483-93024baf9008 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:02.015871 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30109bee-66b0-4f77-b483-93024baf9008 admin admin] PATH_INFO: `/v3/projects` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:02.018263 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30109bee-66b0-4f77-b483-93024baf9008 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:02.025739 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30109bee-66b0-4f77-b483-93024baf9008 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:02.123362 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 822/1639] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jul 11 14:41:01 2022] POST /identity/v3/projects => generated 403 bytes in 504 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:41:02.126866 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816c0a3e-6d4d-4186-9540-b8dc909c7e1b None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:02.144848 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816c0a3e-6d4d-4186-9540-b8dc909c7e1b None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:02.180004 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:41:02.366294 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de4c45a-9c75-4079-ae5d-fef524f17ab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:02.368594 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de4c45a-9c75-4079-ae5d-fef524f17ab4 admin admin] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:02.374400 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de4c45a-9c75-4079-ae5d-fef524f17ab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:02.376017 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de4c45a-9c75-4079-ae5d-fef524f17ab4 admin admin] PATH_INFO: `/v3/users` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:02.378759 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de4c45a-9c75-4079-ae5d-fef524f17ab4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:02.385125 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de4c45a-9c75-4079-ae5d-fef524f17ab4 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:02.438337 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 818/1640] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jul 11 14:41:02 2022] POST /identity/v3/users => generated 308 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:41:02.444753 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30109bee-66b0-4f77-b483-93024baf9008 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:02.460702 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30109bee-66b0-4f77-b483-93024baf9008 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:02.469916 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a243e3cd-75ff-494b-9cbb-3ecd5ef56cbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:02.470980 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a243e3cd-75ff-494b-9cbb-3ecd5ef56cbf admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:02.472128 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a243e3cd-75ff-494b-9cbb-3ecd5ef56cbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:02.472920 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a243e3cd-75ff-494b-9cbb-3ecd5ef56cbf admin admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:02.474460 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a243e3cd-75ff-494b-9cbb-3ecd5ef56cbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:02.476925 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a243e3cd-75ff-494b-9cbb-3ecd5ef56cbf admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:02.503321 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 823/1641] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:41:02 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:41:02.508779 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de4c45a-9c75-4079-ae5d-fef524f17ab4 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:02.520772 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de4c45a-9c75-4079-ae5d-fef524f17ab4 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:02.526796 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e87990-6e34-4e9c-81b5-51e7b8e0b2d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:02.527850 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e87990-6e34-4e9c-81b5-51e7b8e0b2d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:02.528417 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e87990-6e34-4e9c-81b5-51e7b8e0b2d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:02.528946 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e87990-6e34-4e9c-81b5-51e7b8e0b2d3 admin admin] PATH_INFO: `/v3/projects/9e3081dc595f49aca38c228be376e03b/users/11aa0ddfff96474c8f621100efa69911/roles/b46df176b0fe479da63c318db225bed4` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:02.563992 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e87990-6e34-4e9c-81b5-51e7b8e0b2d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e3081dc595f49aca38c228be376e03b, user_id=11aa0ddfff96474c8f621100efa69911, role_id=b46df176b0fe479da63c318db225bed4)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:02.571590 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e87990-6e34-4e9c-81b5-51e7b8e0b2d3 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:02.637531 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 819/1642] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jul 11 14:41:02 2022] PUT /identity/v3/projects/9e3081dc595f49aca38c228be376e03b/users/11aa0ddfff96474c8f621100efa69911/roles/b46df176b0fe479da63c318db225bed4 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:41:02.642572 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a243e3cd-75ff-494b-9cbb-3ecd5ef56cbf admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:02.670875 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a243e3cd-75ff-494b-9cbb-3ecd5ef56cbf admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:02.895472 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc9afe7-9b88-4ca9-8dcb-6b69ea0a88c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:02.896189 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc9afe7-9b88-4ca9-8dcb-6b69ea0a88c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:02.896539 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc9afe7-9b88-4ca9-8dcb-6b69ea0a88c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:02.896828 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc9afe7-9b88-4ca9-8dcb-6b69ea0a88c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:02.897597 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc9afe7-9b88-4ca9-8dcb-6b69ea0a88c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:02.900347 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc9afe7-9b88-4ca9-8dcb-6b69ea0a88c6 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:02.933210 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 824/1643] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:41:02 2022] GET /identity/v3/roles => generated 1420 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 14:41:02.935266 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e87990-6e34-4e9c-81b5-51e7b8e0b2d3 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:02.998315 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e87990-6e34-4e9c-81b5-51e7b8e0b2d3 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:03.017327 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51a6e16-f01c-4cac-b1ac-bc8c3d9e5d9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:03.061080 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51a6e16-f01c-4cac-b1ac-bc8c3d9e5d9a admin admin] REQUEST_METHOD: `PUT` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:03.061080 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51a6e16-f01c-4cac-b1ac-bc8c3d9e5d9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:03.061080 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51a6e16-f01c-4cac-b1ac-bc8c3d9e5d9a admin admin] PATH_INFO: `/v3/projects/9e3081dc595f49aca38c228be376e03b/users/11aa0ddfff96474c8f621100efa69911/roles/b46df176b0fe479da63c318db225bed4` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:03.061080 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51a6e16-f01c-4cac-b1ac-bc8c3d9e5d9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e3081dc595f49aca38c228be376e03b, user_id=11aa0ddfff96474c8f621100efa69911, role_id=b46df176b0fe479da63c318db225bed4)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:03.061080 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51a6e16-f01c-4cac-b1ac-bc8c3d9e5d9a admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:03.163250 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 820/1644] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jul 11 14:41:02 2022] PUT /identity/v3/projects/9e3081dc595f49aca38c228be376e03b/users/11aa0ddfff96474c8f621100efa69911/roles/b46df176b0fe479da63c318db225bed4 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:41:04.102579 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc9afe7-9b88-4ca9-8dcb-6b69ea0a88c6 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:04.123842 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc9afe7-9b88-4ca9-8dcb-6b69ea0a88c6 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:04.342373 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:41:04.376047 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd922a30-7172-4d22-ba9e-5428af659287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:04.377003 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd922a30-7172-4d22-ba9e-5428af659287 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:04.377695 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd922a30-7172-4d22-ba9e-5428af659287 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:04.378245 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd922a30-7172-4d22-ba9e-5428af659287 admin admin] PATH_INFO: `/v3/users/0f1ce165f69645e4a94b2484118d638a` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:04.380152 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd922a30-7172-4d22-ba9e-5428af659287 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f1ce165f69645e4a94b2484118d638a)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:04.382016 dv-cinder-master-3-smb devstack@keystone.service[80535]: WARNING py.warnings [None req-cd922a30-7172-4d22-ba9e-5428af659287 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 11 14:41:04.382016 dv-cinder-master-3-smb devstack@keystone.service[80535]: warnings.warn(msg) Jul 11 14:41:04.382016 dv-cinder-master-3-smb devstack@keystone.service[80535]: Jul 11 14:41:04.387136 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd922a30-7172-4d22-ba9e-5428af659287 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:04.571947 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-cd922a30-7172-4d22-ba9e-5428af659287 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f1ce165f69645e4a94b2484118d638a'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:04.606486 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-cd922a30-7172-4d22-ba9e-5428af659287 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f1ce165f69645e4a94b2484118d638a'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:04.626995 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-cd922a30-7172-4d22-ba9e-5428af659287 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f1ce165f69645e4a94b2484118d638a'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:04.628157 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-cd922a30-7172-4d22-ba9e-5428af659287 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f1ce165f69645e4a94b2484118d638a'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:04.629104 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-cd922a30-7172-4d22-ba9e-5428af659287 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f1ce165f69645e4a94b2484118d638a'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:04.685503 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 825/1645] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jul 11 14:41:04 2022] DELETE /identity/v3/users/0f1ce165f69645e4a94b2484118d638a => generated 0 bytes in 583 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:41:04.691678 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07d2dfb-802d-42d1-b8a3-b938f5a560c4 None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:04.692589 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07d2dfb-802d-42d1-b8a3-b938f5a560c4 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:04.693316 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07d2dfb-802d-42d1-b8a3-b938f5a560c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:04.737506 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-e07d2dfb-802d-42d1-b8a3-b938f5a560c4 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:41:04.739242 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-e07d2dfb-802d-42d1-b8a3-b938f5a560c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:04.887533 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 821/1646] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:41:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:41:04.939450 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd922a30-7172-4d22-ba9e-5428af659287 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:04.941605 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-cd922a30-7172-4d22-ba9e-5428af659287 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:05.066683 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd922a30-7172-4d22-ba9e-5428af659287 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:05.075378 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c020f4-7257-4df5-adfa-eb025e07099c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20eede5ccd834862b00123310b5c3975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:05.076288 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c020f4-7257-4df5-adfa-eb025e07099c service neutron] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:05.076581 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c020f4-7257-4df5-adfa-eb025e07099c service neutron] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:05.077055 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c020f4-7257-4df5-adfa-eb025e07099c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:05.093900 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c020f4-7257-4df5-adfa-eb025e07099c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:05.095665 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c020f4-7257-4df5-adfa-eb025e07099c service neutron] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:05.150523 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 826/1647] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:41:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:41:06.076534 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07d2dfb-802d-42d1-b8a3-b938f5a560c4 None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:06.080125 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-e07d2dfb-802d-42d1-b8a3-b938f5a560c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:06.115504 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07d2dfb-802d-42d1-b8a3-b938f5a560c4 None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:06.134345 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a43293d-f290-4ba1-9e9e-95f5bfa986ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:06.136557 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a43293d-f290-4ba1-9e9e-95f5bfa986ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:06.137053 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a43293d-f290-4ba1-9e9e-95f5bfa986ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:06.138353 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a43293d-f290-4ba1-9e9e-95f5bfa986ff admin admin] PATH_INFO: `/v3/projects/177be2414e2b47b4914b218196d3d6aa` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:06.139995 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a43293d-f290-4ba1-9e9e-95f5bfa986ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=177be2414e2b47b4914b218196d3d6aa)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:06.141379 dv-cinder-master-3-smb devstack@keystone.service[80534]: WARNING py.warnings [None req-5a43293d-f290-4ba1-9e9e-95f5bfa986ff admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 11 14:41:06.141379 dv-cinder-master-3-smb devstack@keystone.service[80534]: warnings.warn(msg) Jul 11 14:41:06.141379 dv-cinder-master-3-smb devstack@keystone.service[80534]: Jul 11 14:41:06.143503 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a43293d-f290-4ba1-9e9e-95f5bfa986ff admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:06.432135 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-5a43293d-f290-4ba1-9e9e-95f5bfa986ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '177be2414e2b47b4914b218196d3d6aa', 'request_id': 'req-5a43293d-f290-4ba1-9e9e-95f5bfa986ff'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:06.514495 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-5a43293d-f290-4ba1-9e9e-95f5bfa986ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '177be2414e2b47b4914b218196d3d6aa', 'request_id': 'req-5a43293d-f290-4ba1-9e9e-95f5bfa986ff'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:06.528427 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=90,keystone:INSERT=6,keystone:DELETE=4 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:41:06.549593 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-5a43293d-f290-4ba1-9e9e-95f5bfa986ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '177be2414e2b47b4914b218196d3d6aa', 'request_id': 'req-5a43293d-f290-4ba1-9e9e-95f5bfa986ff'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:06.599031 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-5a43293d-f290-4ba1-9e9e-95f5bfa986ff admin admin] The token cache is being invalidate because project 177be2414e2b47b4914b218196d3d6aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80534) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:41:06.599419 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-5a43293d-f290-4ba1-9e9e-95f5bfa986ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:06.601709 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-5a43293d-f290-4ba1-9e9e-95f5bfa986ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:06.615707 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 822/1648] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jul 11 14:41:06 2022] DELETE /identity/v3/projects/177be2414e2b47b4914b218196d3d6aa => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:41:06.617865 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456ba3ad-66ae-4af8-ad9c-57458fb73fd8 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:06.618700 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456ba3ad-66ae-4af8-ad9c-57458fb73fd8 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:06.619532 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456ba3ad-66ae-4af8-ad9c-57458fb73fd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:06.707465 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-456ba3ad-66ae-4af8-ad9c-57458fb73fd8 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:41:06.714677 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-456ba3ad-66ae-4af8-ad9c-57458fb73fd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:06.850608 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 827/1649] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:41:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:41:06.860339 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5177198-f39b-4ec1-80c4-101ff458f6e6 None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:06.860632 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5177198-f39b-4ec1-80c4-101ff458f6e6 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:06.861080 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5177198-f39b-4ec1-80c4-101ff458f6e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:06.942232 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-b5177198-f39b-4ec1-80c4-101ff458f6e6 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:41:06.945234 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-b5177198-f39b-4ec1-80c4-101ff458f6e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:06.970720 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456ba3ad-66ae-4af8-ad9c-57458fb73fd8 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:06.973291 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-456ba3ad-66ae-4af8-ad9c-57458fb73fd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:06.973881 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 823/1650] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:41:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:41:06.977318 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5177198-f39b-4ec1-80c4-101ff458f6e6 None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:07.007970 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5177198-f39b-4ec1-80c4-101ff458f6e6 None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:07.031831 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456ba3ad-66ae-4af8-ad9c-57458fb73fd8 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:07.046069 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c24448-3972-474c-988e-4d32940b08d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:07.047515 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c24448-3972-474c-988e-4d32940b08d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:07.048522 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c24448-3972-474c-988e-4d32940b08d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:07.048522 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c24448-3972-474c-988e-4d32940b08d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:07.054197 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c24448-3972-474c-988e-4d32940b08d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:41:07.054595 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c24448-3972-474c-988e-4d32940b08d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:07.056307 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c24448-3972-474c-988e-4d32940b08d8 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:07.059304 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7843f67e-b8f2-4f01-8b2c-e00d0232694f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:07.060255 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7843f67e-b8f2-4f01-8b2c-e00d0232694f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:07.060544 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7843f67e-b8f2-4f01-8b2c-e00d0232694f admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:07.060823 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7843f67e-b8f2-4f01-8b2c-e00d0232694f admin admin] PATH_INFO: `/v3/users/a6012dc479f54ac5a6907a95cdc072a3` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:07.063270 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7843f67e-b8f2-4f01-8b2c-e00d0232694f admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6012dc479f54ac5a6907a95cdc072a3)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:07.065590 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7843f67e-b8f2-4f01-8b2c-e00d0232694f admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:07.108989 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 824/1651] 10.222.0.70 () {58 vars in 1152 bytes} [Mon Jul 11 14:41:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:41:07.110985 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c24448-3972-474c-988e-4d32940b08d8 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:07.127726 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:41:07.150425 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c24448-3972-474c-988e-4d32940b08d8 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:07.168122 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c96e0bf-51d3-4b3d-a7f7-9af6f0f32865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:07.170127 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c96e0bf-51d3-4b3d-a7f7-9af6f0f32865 admin admin] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:07.174724 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c96e0bf-51d3-4b3d-a7f7-9af6f0f32865 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:07.175750 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c96e0bf-51d3-4b3d-a7f7-9af6f0f32865 admin admin] PATH_INFO: `/v3/projects` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:07.179278 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c96e0bf-51d3-4b3d-a7f7-9af6f0f32865 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:07.185462 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c96e0bf-51d3-4b3d-a7f7-9af6f0f32865 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:07.216388 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-7843f67e-b8f2-4f01-8b2c-e00d0232694f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6012dc479f54ac5a6907a95cdc072a3'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:07.231084 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-7843f67e-b8f2-4f01-8b2c-e00d0232694f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6012dc479f54ac5a6907a95cdc072a3'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:07.248514 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-7843f67e-b8f2-4f01-8b2c-e00d0232694f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6012dc479f54ac5a6907a95cdc072a3'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:07.250938 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-7843f67e-b8f2-4f01-8b2c-e00d0232694f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6012dc479f54ac5a6907a95cdc072a3'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:07.251980 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-7843f67e-b8f2-4f01-8b2c-e00d0232694f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6012dc479f54ac5a6907a95cdc072a3'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:07.304840 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 825/1652] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jul 11 14:41:07 2022] POST /identity/v3/projects => generated 365 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:41:07.307281 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c96e0bf-51d3-4b3d-a7f7-9af6f0f32865 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:07.314086 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-6c96e0bf-51d3-4b3d-a7f7-9af6f0f32865 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:07.335988 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 828/1653] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jul 11 14:41:06 2022] DELETE /identity/v3/users/a6012dc479f54ac5a6907a95cdc072a3 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:41:07.341965 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cdc674-b05b-445a-a5b9-ae4c268b5c28 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:07.344494 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cdc674-b05b-445a-a5b9-ae4c268b5c28 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:07.345173 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cdc674-b05b-445a-a5b9-ae4c268b5c28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:07.453049 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-08cdc674-b05b-445a-a5b9-ae4c268b5c28 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:41:07.457202 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-08cdc674-b05b-445a-a5b9-ae4c268b5c28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:07.629433 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c96e0bf-51d3-4b3d-a7f7-9af6f0f32865 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:07.761841 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 829/1654] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:41:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 421 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:41:07.797263 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cdc674-b05b-445a-a5b9-ae4c268b5c28 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:07.799114 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-08cdc674-b05b-445a-a5b9-ae4c268b5c28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:07.929025 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759fb360-a817-47ae-b932-25c54d6c996e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:07.929852 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759fb360-a817-47ae-b932-25c54d6c996e admin admin] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:07.930255 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759fb360-a817-47ae-b932-25c54d6c996e admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:07.930635 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759fb360-a817-47ae-b932-25c54d6c996e admin admin] PATH_INFO: `/v3/users` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:07.934790 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759fb360-a817-47ae-b932-25c54d6c996e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:07.938985 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759fb360-a817-47ae-b932-25c54d6c996e admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:07.975597 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 826/1655] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jul 11 14:41:07 2022] POST /identity/v3/users => generated 283 bytes in 667 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:41:07.976887 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759fb360-a817-47ae-b932-25c54d6c996e admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:07.993942 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759fb360-a817-47ae-b932-25c54d6c996e admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:08.002616 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cdc674-b05b-445a-a5b9-ae4c268b5c28 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:08.019098 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf696dc-5223-4b30-89cc-5e79c0f02332 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20eede5ccd834862b00123310b5c3975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:08.022660 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf696dc-5223-4b30-89cc-5e79c0f02332 service neutron] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:08.023259 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf696dc-5223-4b30-89cc-5e79c0f02332 service neutron] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:08.023721 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf696dc-5223-4b30-89cc-5e79c0f02332 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:08.027783 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fae0d6-13be-42f1-ae3f-8c1cf03e8ebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:08.031607 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fae0d6-13be-42f1-ae3f-8c1cf03e8ebe admin admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:08.035208 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fae0d6-13be-42f1-ae3f-8c1cf03e8ebe admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:08.035977 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fae0d6-13be-42f1-ae3f-8c1cf03e8ebe admin admin] PATH_INFO: `/v3/roles` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:08.045127 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fae0d6-13be-42f1-ae3f-8c1cf03e8ebe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:08.047802 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fae0d6-13be-42f1-ae3f-8c1cf03e8ebe admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:08.050656 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf696dc-5223-4b30-89cc-5e79c0f02332 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:08.053096 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf696dc-5223-4b30-89cc-5e79c0f02332 service neutron] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:08.096434 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 827/1656] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:41:07 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:41:08.100531 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 830/1657] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:41:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:41:08.102223 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fae0d6-13be-42f1-ae3f-8c1cf03e8ebe admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:08.118734 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fae0d6-13be-42f1-ae3f-8c1cf03e8ebe admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:08.127105 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26d2033-eb0a-48cb-a3a2-e685dc285fbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:08.133560 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26d2033-eb0a-48cb-a3a2-e685dc285fbf admin admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:08.134084 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26d2033-eb0a-48cb-a3a2-e685dc285fbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:08.134708 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26d2033-eb0a-48cb-a3a2-e685dc285fbf admin admin] PATH_INFO: `/v3/roles` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:08.135869 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26d2033-eb0a-48cb-a3a2-e685dc285fbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:08.139249 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26d2033-eb0a-48cb-a3a2-e685dc285fbf admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:08.164255 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 828/1658] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:41:08 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:41:08.171448 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf696dc-5223-4b30-89cc-5e79c0f02332 service neutron] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:08.192691 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf696dc-5223-4b30-89cc-5e79c0f02332 service neutron] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:08.214574 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea499d3-e03b-434a-9d80-812296a71ed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:08.218727 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea499d3-e03b-434a-9d80-812296a71ed3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:08.219127 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea499d3-e03b-434a-9d80-812296a71ed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:08.221407 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea499d3-e03b-434a-9d80-812296a71ed3 admin admin] PATH_INFO: `/v3/projects/38a67544af1a4357b4bec300594dbbe2/users/561652aa25c446f4bf9e10be357b6804/roles/8eff41f243c843ed95505a488ca6eada` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:08.262735 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb0d650-a761-43a8-861e-a06665bd9ad3 None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:08.263256 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb0d650-a761-43a8-861e-a06665bd9ad3 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:08.263736 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb0d650-a761-43a8-861e-a06665bd9ad3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:08.280924 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea499d3-e03b-434a-9d80-812296a71ed3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38a67544af1a4357b4bec300594dbbe2, user_id=561652aa25c446f4bf9e10be357b6804, role_id=8eff41f243c843ed95505a488ca6eada)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:08.286548 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea499d3-e03b-434a-9d80-812296a71ed3 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:08.322783 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-bbb0d650-a761-43a8-861e-a06665bd9ad3 None None] MFA Rules not processed for user `11aa0ddfff96474c8f621100efa69911`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:41:08.334021 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-bbb0d650-a761-43a8-861e-a06665bd9ad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:08.337366 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 831/1659] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jul 11 14:41:08 2022] PUT /identity/v3/projects/38a67544af1a4357b4bec300594dbbe2/users/561652aa25c446f4bf9e10be357b6804/roles/8eff41f243c843ed95505a488ca6eada => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:41:08.343019 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:DELETE=3,keystone:SELECT=93,keystone:INSERT=4 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:41:08.349810 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffa0bdd-e352-400e-9408-b7c6b17d5716 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:08.350021 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffa0bdd-e352-400e-9408-b7c6b17d5716 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:08.350255 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffa0bdd-e352-400e-9408-b7c6b17d5716 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:08.375793 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:41:08.418961 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-dffa0bdd-e352-400e-9408-b7c6b17d5716 None None] MFA Rules not processed for user `561652aa25c446f4bf9e10be357b6804`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:41:08.421735 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-dffa0bdd-e352-400e-9408-b7c6b17d5716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:08.578827 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 829/1660] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:41:08 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:41:08.630442 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 832/1661] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:41:08 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:41:08.635956 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb0d650-a761-43a8-861e-a06665bd9ad3 None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:08.774887 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb0d650-a761-43a8-861e-a06665bd9ad3 None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:08.775617 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9002a103-eb5e-4965-8364-ffc492e6311e None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:08.776152 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9002a103-eb5e-4965-8364-ffc492e6311e None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:08.776152 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9002a103-eb5e-4965-8364-ffc492e6311e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:08.783618 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee69e0ce-48ab-4eba-8cc0-5f7b1fa6c359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:08.791083 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee69e0ce-48ab-4eba-8cc0-5f7b1fa6c359 admin admin] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:08.791379 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee69e0ce-48ab-4eba-8cc0-5f7b1fa6c359 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:08.791658 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee69e0ce-48ab-4eba-8cc0-5f7b1fa6c359 admin admin] PATH_INFO: `/v3/projects` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:08.793797 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee69e0ce-48ab-4eba-8cc0-5f7b1fa6c359 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:08.795240 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee69e0ce-48ab-4eba-8cc0-5f7b1fa6c359 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:08.867976 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-9002a103-eb5e-4965-8364-ffc492e6311e None None] MFA Rules not processed for user `fee6e5aa4b4947faa8b6f7937250986b`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:41:08.875139 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-9002a103-eb5e-4965-8364-ffc492e6311e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:08.878003 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 830/1662] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jul 11 14:41:08 2022] POST /identity/v3/projects => generated 367 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:41:08.882680 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee69e0ce-48ab-4eba-8cc0-5f7b1fa6c359 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:09.126772 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee69e0ce-48ab-4eba-8cc0-5f7b1fa6c359 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:09.145974 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 833/1663] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:41:08 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 371 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:41:09.154731 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcb95c3-ef6a-400a-b081-935a02181808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:09.157317 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcb95c3-ef6a-400a-b081-935a02181808 admin admin] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:09.157726 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bdf208-b311-4aea-94b4-b90089dcb8be None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:09.158759 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bdf208-b311-4aea-94b4-b90089dcb8be None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:09.159263 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bdf208-b311-4aea-94b4-b90089dcb8be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:09.159585 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcb95c3-ef6a-400a-b081-935a02181808 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:09.160074 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcb95c3-ef6a-400a-b081-935a02181808 admin admin] PATH_INFO: `/v3/users` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:09.161581 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcb95c3-ef6a-400a-b081-935a02181808 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:09.170063 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcb95c3-ef6a-400a-b081-935a02181808 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:09.203019 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-29bdf208-b311-4aea-94b4-b90089dcb8be None None] MFA Rules not processed for user `fee6e5aa4b4947faa8b6f7937250986b`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:41:09.204397 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-29bdf208-b311-4aea-94b4-b90089dcb8be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:09.212442 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 831/1664] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jul 11 14:41:08 2022] POST /identity/v3/users => generated 290 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:41:09.216464 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcb95c3-ef6a-400a-b081-935a02181808 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:09.235024 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 834/1665] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:41:09 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:41:09.237591 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcb95c3-ef6a-400a-b081-935a02181808 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:09.248949 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bdf208-b311-4aea-94b4-b90089dcb8be None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:09.251507 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-29bdf208-b311-4aea-94b4-b90089dcb8be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:09.261776 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3f6faa-673e-4f91-af64-e46f92929ba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:09.264854 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3f6faa-673e-4f91-af64-e46f92929ba6 admin admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:09.265122 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3f6faa-673e-4f91-af64-e46f92929ba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:09.265397 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3f6faa-673e-4f91-af64-e46f92929ba6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:09.266205 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3f6faa-673e-4f91-af64-e46f92929ba6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:09.267892 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3f6faa-673e-4f91-af64-e46f92929ba6 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:09.300098 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 832/1666] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:41:09 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 14:41:09.301464 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3f6faa-673e-4f91-af64-e46f92929ba6 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:09.320688 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3f6faa-673e-4f91-af64-e46f92929ba6 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:09.335020 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138ef827-fcad-4002-9f70-97de40159766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:09.336706 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138ef827-fcad-4002-9f70-97de40159766 admin admin] REQUEST_METHOD: `PUT` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:09.337360 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138ef827-fcad-4002-9f70-97de40159766 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:09.337815 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138ef827-fcad-4002-9f70-97de40159766 admin admin] PATH_INFO: `/v3/projects/a2611df563934127977756bf6840ef91/users/bcea677a1ff84448804711f2fd89ad9a/roles/b46df176b0fe479da63c318db225bed4` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:09.342278 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:41:09.403071 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138ef827-fcad-4002-9f70-97de40159766 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2611df563934127977756bf6840ef91, user_id=bcea677a1ff84448804711f2fd89ad9a, role_id=b46df176b0fe479da63c318db225bed4)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:09.421987 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138ef827-fcad-4002-9f70-97de40159766 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:09.478596 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bdf208-b311-4aea-94b4-b90089dcb8be None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:09.520394 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 833/1667] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jul 11 14:41:09 2022] PUT /identity/v3/projects/a2611df563934127977756bf6840ef91/users/bcea677a1ff84448804711f2fd89ad9a/roles/b46df176b0fe479da63c318db225bed4 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:41:09.521802 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:41:09.523709 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138ef827-fcad-4002-9f70-97de40159766 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:09.715822 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66eb4d3a-7ad3-452a-9f0f-3410ff23db31 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4f8c0d696af4bd5a205ca8e9110b8cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:09.717982 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eb4d3a-7ad3-452a-9f0f-3410ff23db31 service nova] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:09.719358 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eb4d3a-7ad3-452a-9f0f-3410ff23db31 service nova] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:09.720759 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eb4d3a-7ad3-452a-9f0f-3410ff23db31 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:09.751608 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138ef827-fcad-4002-9f70-97de40159766 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:09.762054 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8d5798-f002-487d-9904-021c394d8766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:09.763981 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8d5798-f002-487d-9904-021c394d8766 admin admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:09.764467 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8d5798-f002-487d-9904-021c394d8766 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:09.765234 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8d5798-f002-487d-9904-021c394d8766 admin admin] PATH_INFO: `/v3/roles` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:09.766730 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8d5798-f002-487d-9904-021c394d8766 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:09.769108 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8d5798-f002-487d-9904-021c394d8766 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:09.797926 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 834/1668] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:41:09 2022] GET /identity/v3/roles => generated 1420 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:41:09.800484 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8d5798-f002-487d-9904-021c394d8766 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:09.823011 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8d5798-f002-487d-9904-021c394d8766 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:09.839065 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85b5764-6739-4766-a8c0-2a26c260c8b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:09.843007 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85b5764-6739-4766-a8c0-2a26c260c8b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:09.844124 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85b5764-6739-4766-a8c0-2a26c260c8b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:09.845512 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85b5764-6739-4766-a8c0-2a26c260c8b5 admin admin] PATH_INFO: `/v3/projects/a2611df563934127977756bf6840ef91/users/bcea677a1ff84448804711f2fd89ad9a/roles/b46df176b0fe479da63c318db225bed4` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:09.853748 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85b5764-6739-4766-a8c0-2a26c260c8b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2611df563934127977756bf6840ef91, user_id=bcea677a1ff84448804711f2fd89ad9a, role_id=b46df176b0fe479da63c318db225bed4)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:09.860323 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85b5764-6739-4766-a8c0-2a26c260c8b5 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:09.864462 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66eb4d3a-7ad3-452a-9f0f-3410ff23db31 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:09.867648 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66eb4d3a-7ad3-452a-9f0f-3410ff23db31 service nova] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:09.880652 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 835/1669] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:41:09 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 632 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:41:09.886344 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 835/1670] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jul 11 14:41:09 2022] PUT /identity/v3/projects/a2611df563934127977756bf6840ef91/users/bcea677a1ff84448804711f2fd89ad9a/roles/b46df176b0fe479da63c318db225bed4 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:41:09.906739 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5489000-37db-42da-8334-7df6d9a414cc None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:09.907246 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5489000-37db-42da-8334-7df6d9a414cc None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:09.907658 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5489000-37db-42da-8334-7df6d9a414cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:09.959686 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-e5489000-37db-42da-8334-7df6d9a414cc None None] MFA Rules not processed for user `bcea677a1ff84448804711f2fd89ad9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:41:09.961371 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-e5489000-37db-42da-8334-7df6d9a414cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:10.180273 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 836/1671] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:41:09 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:41:10.190523 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85b5764-6739-4766-a8c0-2a26c260c8b5 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:10.193927 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-d85b5764-6739-4766-a8c0-2a26c260c8b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:10.381473 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85b5764-6739-4766-a8c0-2a26c260c8b5 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:10.405764 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5451ffa3-0f0e-4606-896a-69e7e9944fc5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '868e7c2dec264512b972c8736d659c34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:10.406443 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5451ffa3-0f0e-4606-896a-69e7e9944fc5 service cinder] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:10.406725 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5451ffa3-0f0e-4606-896a-69e7e9944fc5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:10.406999 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5451ffa3-0f0e-4606-896a-69e7e9944fc5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:10.441321 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5451ffa3-0f0e-4606-896a-69e7e9944fc5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:10.441321 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5451ffa3-0f0e-4606-896a-69e7e9944fc5 service cinder] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:10.455639 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 836/1672] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:41:10 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:41:10.618270 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5489000-37db-42da-8334-7df6d9a414cc None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:10.620723 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-e5489000-37db-42da-8334-7df6d9a414cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:10.720381 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:41:10.790762 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5489000-37db-42da-8334-7df6d9a414cc None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:10.799519 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d800257-bb3a-483a-b9e8-04bbeff0f97e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:10.800645 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d800257-bb3a-483a-b9e8-04bbeff0f97e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:10.802024 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d800257-bb3a-483a-b9e8-04bbeff0f97e admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:10.802024 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d800257-bb3a-483a-b9e8-04bbeff0f97e admin admin] PATH_INFO: `/v3/projects/1ee995ce48ba4215ae1c6c20a26434a5` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:10.803434 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d800257-bb3a-483a-b9e8-04bbeff0f97e admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ee995ce48ba4215ae1c6c20a26434a5)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:10.810564 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d800257-bb3a-483a-b9e8-04bbeff0f97e admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:10.971029 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-1d800257-bb3a-483a-b9e8-04bbeff0f97e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ee995ce48ba4215ae1c6c20a26434a5', 'request_id': 'req-1d800257-bb3a-483a-b9e8-04bbeff0f97e'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:10.991050 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-1d800257-bb3a-483a-b9e8-04bbeff0f97e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ee995ce48ba4215ae1c6c20a26434a5', 'request_id': 'req-1d800257-bb3a-483a-b9e8-04bbeff0f97e'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:11.025107 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-1d800257-bb3a-483a-b9e8-04bbeff0f97e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ee995ce48ba4215ae1c6c20a26434a5', 'request_id': 'req-1d800257-bb3a-483a-b9e8-04bbeff0f97e'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:11.071710 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-1d800257-bb3a-483a-b9e8-04bbeff0f97e admin admin] The token cache is being invalidate because project 1ee995ce48ba4215ae1c6c20a26434a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:41:11.071934 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-1d800257-bb3a-483a-b9e8-04bbeff0f97e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:11.074968 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-1d800257-bb3a-483a-b9e8-04bbeff0f97e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:11.087536 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 837/1673] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jul 11 14:41:10 2022] DELETE /identity/v3/projects/1ee995ce48ba4215ae1c6c20a26434a5 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:41:11.092832 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87906b0a-c0bd-4bf0-b6d4-5081906cb387 None None] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:11.093409 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87906b0a-c0bd-4bf0-b6d4-5081906cb387 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:11.093971 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87906b0a-c0bd-4bf0-b6d4-5081906cb387 None None] PATH_INFO: `/` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:11.094437 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a748294-0283-467d-ac5f-69ad255c182a None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:11.094812 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a748294-0283-467d-ac5f-69ad255c182a None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:11.095094 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a748294-0283-467d-ac5f-69ad255c182a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:11.098057 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 837/1674] 10.222.0.70 () {54 vars in 912 bytes} [Mon Jul 11 14:41:11 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:41:11.109547 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbc76a3-d3cb-4d22-82db-f11fde24de22 None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:11.110401 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbc76a3-d3cb-4d22-82db-f11fde24de22 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:11.110903 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbc76a3-d3cb-4d22-82db-f11fde24de22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:11.169999 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-5a748294-0283-467d-ac5f-69ad255c182a None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:41:11.173771 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-5a748294-0283-467d-ac5f-69ad255c182a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:11.259717 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-7fbc76a3-d3cb-4d22-82db-f11fde24de22 None None] MFA Rules not processed for user `20eede5ccd834862b00123310b5c3975`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:41:11.267089 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-7fbc76a3-d3cb-4d22-82db-f11fde24de22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:11.417677 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 838/1675] 10.222.0.70 () {58 vars in 1009 bytes} [Mon Jul 11 14:41:11 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Jul 11 14:41:11.426547 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db175950-dfb5-4739-b951-ed77f1c85955 None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:11.426837 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db175950-dfb5-4739-b951-ed77f1c85955 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:11.427397 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db175950-dfb5-4739-b951-ed77f1c85955 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:11.427961 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 838/1676] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:41:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:41:11.445373 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:41:11.471184 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-db175950-dfb5-4739-b951-ed77f1c85955 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:41:11.473212 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-db175950-dfb5-4739-b951-ed77f1c85955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:11.496900 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 839/1677] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:41:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:41:11.503725 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a748294-0283-467d-ac5f-69ad255c182a None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:11.518561 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a748294-0283-467d-ac5f-69ad255c182a None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:11.526459 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29322050-632b-4333-967f-eb9a17d48d0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:11.527359 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29322050-632b-4333-967f-eb9a17d48d0e admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:11.527655 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29322050-632b-4333-967f-eb9a17d48d0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:11.527940 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29322050-632b-4333-967f-eb9a17d48d0e admin admin] PATH_INFO: `/v3/domains` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:11.529025 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29322050-632b-4333-967f-eb9a17d48d0e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:41:11.529958 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29322050-632b-4333-967f-eb9a17d48d0e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:11.533688 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29322050-632b-4333-967f-eb9a17d48d0e admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:11.577403 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db175950-dfb5-4739-b951-ed77f1c85955 None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:11.593795 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 839/1678] 10.222.0.70 () {58 vars in 1152 bytes} [Mon Jul 11 14:41:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:41:11.598191 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db175950-dfb5-4739-b951-ed77f1c85955 None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:11.608113 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7e27f6-02c3-4c66-a9ec-9114ce61b08b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:11.608954 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7e27f6-02c3-4c66-a9ec-9114ce61b08b admin admin] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:11.609514 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7e27f6-02c3-4c66-a9ec-9114ce61b08b admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:11.609993 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7e27f6-02c3-4c66-a9ec-9114ce61b08b admin admin] PATH_INFO: `/v3/projects` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:11.611378 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7e27f6-02c3-4c66-a9ec-9114ce61b08b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:11.614326 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7e27f6-02c3-4c66-a9ec-9114ce61b08b admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:11.698710 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29322050-632b-4333-967f-eb9a17d48d0e admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:11.713602 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 840/1679] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jul 11 14:41:11 2022] POST /identity/v3/projects => generated 377 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:41:11.719743 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29322050-632b-4333-967f-eb9a17d48d0e admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:11.836902 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:41:11.857904 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114c89b5-e14a-4db0-8a6a-d6b6e36147c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:11.858619 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114c89b5-e14a-4db0-8a6a-d6b6e36147c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:11.858908 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114c89b5-e14a-4db0-8a6a-d6b6e36147c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:11.859199 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114c89b5-e14a-4db0-8a6a-d6b6e36147c8 admin admin] PATH_INFO: `/v3/users` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:11.862330 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114c89b5-e14a-4db0-8a6a-d6b6e36147c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:11.867542 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114c89b5-e14a-4db0-8a6a-d6b6e36147c8 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:11.908446 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 840/1680] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jul 11 14:41:11 2022] POST /identity/v3/users => generated 289 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:41:11.909359 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7e27f6-02c3-4c66-a9ec-9114ce61b08b admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:11.923026 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7e27f6-02c3-4c66-a9ec-9114ce61b08b admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:11.929507 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322c2a5d-50c5-4946-ac03-3e39a05871ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:11.930232 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322c2a5d-50c5-4946-ac03-3e39a05871ae admin admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:11.930521 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322c2a5d-50c5-4946-ac03-3e39a05871ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:11.931088 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322c2a5d-50c5-4946-ac03-3e39a05871ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:11.931602 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322c2a5d-50c5-4946-ac03-3e39a05871ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:11.946126 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322c2a5d-50c5-4946-ac03-3e39a05871ae admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:11.973382 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114c89b5-e14a-4db0-8a6a-d6b6e36147c8 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:11.984702 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 841/1681] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:41:11 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:41:11.987401 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114c89b5-e14a-4db0-8a6a-d6b6e36147c8 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:11.995445 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c3a2ea-201f-4530-b38c-ae3b87244fbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:11.995860 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c3a2ea-201f-4530-b38c-ae3b87244fbd admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:11.996152 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c3a2ea-201f-4530-b38c-ae3b87244fbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:11.996522 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c3a2ea-201f-4530-b38c-ae3b87244fbd admin admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:11.997361 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c3a2ea-201f-4530-b38c-ae3b87244fbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:11.999623 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c3a2ea-201f-4530-b38c-ae3b87244fbd admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:12.022499 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322c2a5d-50c5-4946-ac03-3e39a05871ae admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:12.044776 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 841/1682] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:41:11 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:41:12.050220 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322c2a5d-50c5-4946-ac03-3e39a05871ae admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:12.061800 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f692584-6921-4e6b-836e-6d6027430d6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:12.064131 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f692584-6921-4e6b-836e-6d6027430d6d admin admin] REQUEST_METHOD: `PUT` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:12.064804 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f692584-6921-4e6b-836e-6d6027430d6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:12.065621 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f692584-6921-4e6b-836e-6d6027430d6d admin admin] PATH_INFO: `/v3/projects/338a1d55cb3b4edbb5ea911dd2a90699/users/645bcd4cf8524c8e8ea59f4cff269f84/roles/8eff41f243c843ed95505a488ca6eada` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:12.109356 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f692584-6921-4e6b-836e-6d6027430d6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=338a1d55cb3b4edbb5ea911dd2a90699, user_id=645bcd4cf8524c8e8ea59f4cff269f84, role_id=8eff41f243c843ed95505a488ca6eada)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:12.116434 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f692584-6921-4e6b-836e-6d6027430d6d admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:12.144963 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 842/1683] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jul 11 14:41:12 2022] PUT /identity/v3/projects/338a1d55cb3b4edbb5ea911dd2a90699/users/645bcd4cf8524c8e8ea59f4cff269f84/roles/8eff41f243c843ed95505a488ca6eada => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:41:12.146696 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d054f0d-2e9f-4812-8ad1-ff2fa7ec927a None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:12.147002 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d054f0d-2e9f-4812-8ad1-ff2fa7ec927a None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:12.147292 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d054f0d-2e9f-4812-8ad1-ff2fa7ec927a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:12.208783 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-9d054f0d-2e9f-4812-8ad1-ff2fa7ec927a None None] MFA Rules not processed for user `645bcd4cf8524c8e8ea59f4cff269f84`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:41:12.212403 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-9d054f0d-2e9f-4812-8ad1-ff2fa7ec927a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:12.296268 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1bdbf9-536c-494b-8aa4-db62380f22fe None None] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:12.296707 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1bdbf9-536c-494b-8aa4-db62380f22fe None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:12.297385 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1bdbf9-536c-494b-8aa4-db62380f22fe None None] PATH_INFO: `/` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:12.300113 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 843/1684] 10.222.0.70 () {54 vars in 921 bytes} [Mon Jul 11 14:41:12 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:41:12.424321 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1bdbf9-536c-494b-8aa4-db62380f22fe None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:12.428231 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-be1bdbf9-536c-494b-8aa4-db62380f22fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:12.490721 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 842/1685] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:41:12 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 345 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:41:12.497579 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f064ca-ccc2-4fb1-a52a-81147e0ace03 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:12.498731 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f064ca-ccc2-4fb1-a52a-81147e0ace03 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:12.506757 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f064ca-ccc2-4fb1-a52a-81147e0ace03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:12.593713 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-e7f064ca-ccc2-4fb1-a52a-81147e0ace03 None None] MFA Rules not processed for user `4bf25c7951dc4182996335ca1f0e56ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:41:12.597390 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-e7f064ca-ccc2-4fb1-a52a-81147e0ace03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:12.715086 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1bdbf9-536c-494b-8aa4-db62380f22fe None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:12.733333 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c763db7-802e-4f12-a214-b03aa29adc09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20eede5ccd834862b00123310b5c3975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:12.734529 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c763db7-802e-4f12-a214-b03aa29adc09 service neutron] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:12.736990 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c763db7-802e-4f12-a214-b03aa29adc09 service neutron] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:12.738274 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c763db7-802e-4f12-a214-b03aa29adc09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:12.759358 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c763db7-802e-4f12-a214-b03aa29adc09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:12.763286 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c763db7-802e-4f12-a214-b03aa29adc09 service neutron] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:12.794309 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 844/1686] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:41:12 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:41:12.795386 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c763db7-802e-4f12-a214-b03aa29adc09 service neutron] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:12.828772 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 843/1687] 10.222.0.70 () {58 vars in 1018 bytes} [Mon Jul 11 14:41:12 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 337 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:41:12.907620 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46c195f-3782-4006-9a11-defa478de4a0 None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:12.908404 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46c195f-3782-4006-9a11-defa478de4a0 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:12.908956 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46c195f-3782-4006-9a11-defa478de4a0 None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:12.911205 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 844/1688] 10.222.0.70 () {54 vars in 960 bytes} [Mon Jul 11 14:41:12 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 14:41:12.918034 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3155de-8472-4fe8-848e-22b230e369a7 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:12.920052 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3155de-8472-4fe8-848e-22b230e369a7 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:12.920773 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3155de-8472-4fe8-848e-22b230e369a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:12.985752 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c763db7-802e-4f12-a214-b03aa29adc09 service neutron] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:12.994147 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-1d3155de-8472-4fe8-848e-22b230e369a7 None None] MFA Rules not processed for user `4bf25c7951dc4182996335ca1f0e56ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:41:12.995992 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26abd574-f09d-4f00-9f02-d6cae56fdcdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:12.996172 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-1d3155de-8472-4fe8-848e-22b230e369a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:12.999739 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26abd574-f09d-4f00-9f02-d6cae56fdcdf admin admin] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:13.007803 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26abd574-f09d-4f00-9f02-d6cae56fdcdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:13.008101 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26abd574-f09d-4f00-9f02-d6cae56fdcdf admin admin] PATH_INFO: `/v3/projects` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:13.008896 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26abd574-f09d-4f00-9f02-d6cae56fdcdf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:13.009559 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 845/1689] 10.222.0.70 () {58 vars in 1057 bytes} [Mon Jul 11 14:41:12 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:41:13.017639 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3155de-8472-4fe8-848e-22b230e369a7 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:13.018673 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26abd574-f09d-4f00-9f02-d6cae56fdcdf admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:13.051195 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3155de-8472-4fe8-848e-22b230e369a7 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:13.068040 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78003c06-aa39-4743-9e10-ccf65a6cdb03 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bf25c7951dc4182996335ca1f0e56ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:13.070247 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78003c06-aa39-4743-9e10-ccf65a6cdb03 service placement] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:13.073898 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78003c06-aa39-4743-9e10-ccf65a6cdb03 service placement] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:13.074570 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78003c06-aa39-4743-9e10-ccf65a6cdb03 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:13.093530 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 845/1690] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jul 11 14:41:12 2022] POST /identity/v3/projects => generated 377 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:41:13.099722 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26abd574-f09d-4f00-9f02-d6cae56fdcdf admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:13.102575 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78003c06-aa39-4743-9e10-ccf65a6cdb03 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:13.109392 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78003c06-aa39-4743-9e10-ccf65a6cdb03 service placement] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:13.183433 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 846/1691] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:41:13 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:41:13.185174 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:41:13.295983 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26abd574-f09d-4f00-9f02-d6cae56fdcdf admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:13.313236 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b975f03-ff03-40df-997e-6243d6fc6948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:13.314932 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b975f03-ff03-40df-997e-6243d6fc6948 admin admin] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:13.315510 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b975f03-ff03-40df-997e-6243d6fc6948 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:13.315818 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b975f03-ff03-40df-997e-6243d6fc6948 admin admin] PATH_INFO: `/v3/users` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:13.316632 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b975f03-ff03-40df-997e-6243d6fc6948 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:13.326049 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b975f03-ff03-40df-997e-6243d6fc6948 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:13.387077 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78003c06-aa39-4743-9e10-ccf65a6cdb03 service placement] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:13.387249 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 846/1692] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jul 11 14:41:13 2022] POST /identity/v3/users => generated 295 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:41:13.406828 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78003c06-aa39-4743-9e10-ccf65a6cdb03 service placement] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:13.413516 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b85712-d3f2-4fd8-be73-5265be8c75a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:13.414531 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b85712-d3f2-4fd8-be73-5265be8c75a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:13.415046 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b85712-d3f2-4fd8-be73-5265be8c75a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:13.415517 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b85712-d3f2-4fd8-be73-5265be8c75a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:13.416571 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b85712-d3f2-4fd8-be73-5265be8c75a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:13.418534 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b85712-d3f2-4fd8-be73-5265be8c75a0 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:13.435926 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 847/1693] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:41:13 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 14:41:13.437196 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b975f03-ff03-40df-997e-6243d6fc6948 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:13.465554 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b975f03-ff03-40df-997e-6243d6fc6948 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:13.477836 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2896f55f-ac4b-4957-aab4-0fcfd226286f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:13.481846 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2896f55f-ac4b-4957-aab4-0fcfd226286f admin admin] REQUEST_METHOD: `PUT` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:13.482146 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2896f55f-ac4b-4957-aab4-0fcfd226286f admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:13.482440 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2896f55f-ac4b-4957-aab4-0fcfd226286f admin admin] PATH_INFO: `/v3/projects/a14f2e5d21324d81a969002e7df95c08/users/c840582b218347bcae44bf400f6211a2/roles/b46df176b0fe479da63c318db225bed4` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:13.532771 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2896f55f-ac4b-4957-aab4-0fcfd226286f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a14f2e5d21324d81a969002e7df95c08, user_id=c840582b218347bcae44bf400f6211a2, role_id=b46df176b0fe479da63c318db225bed4)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:13.540505 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2896f55f-ac4b-4957-aab4-0fcfd226286f admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:13.582909 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 847/1694] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jul 11 14:41:13 2022] PUT /identity/v3/projects/a14f2e5d21324d81a969002e7df95c08/users/c840582b218347bcae44bf400f6211a2/roles/b46df176b0fe479da63c318db225bed4 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:41:13.586652 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b85712-d3f2-4fd8-be73-5265be8c75a0 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:13.619147 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b85712-d3f2-4fd8-be73-5265be8c75a0 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:13.670316 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:41:13.709304 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7286d2a5-331e-4aa9-954a-9c0aaacce152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:13.710290 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7286d2a5-331e-4aa9-954a-9c0aaacce152 admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:13.710826 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7286d2a5-331e-4aa9-954a-9c0aaacce152 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:13.711111 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7286d2a5-331e-4aa9-954a-9c0aaacce152 admin admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:13.711936 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7286d2a5-331e-4aa9-954a-9c0aaacce152 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:13.714830 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7286d2a5-331e-4aa9-954a-9c0aaacce152 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:13.751467 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 848/1695] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:41:13 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:41:13.753986 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2896f55f-ac4b-4957-aab4-0fcfd226286f admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:13.772495 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7286d2a5-331e-4aa9-954a-9c0aaacce152 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:13.775890 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-7286d2a5-331e-4aa9-954a-9c0aaacce152 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:13.777901 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2896f55f-ac4b-4957-aab4-0fcfd226286f admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:13.791314 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06efd770-16a2-4927-986e-30108f46f2c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:13.795323 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06efd770-16a2-4927-986e-30108f46f2c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:13.796477 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06efd770-16a2-4927-986e-30108f46f2c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:13.796770 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06efd770-16a2-4927-986e-30108f46f2c0 admin admin] PATH_INFO: `/v3/projects/a14f2e5d21324d81a969002e7df95c08/users/c840582b218347bcae44bf400f6211a2/roles/b46df176b0fe479da63c318db225bed4` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:13.805252 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06efd770-16a2-4927-986e-30108f46f2c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a14f2e5d21324d81a969002e7df95c08, user_id=c840582b218347bcae44bf400f6211a2, role_id=b46df176b0fe479da63c318db225bed4)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:13.808237 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7286d2a5-331e-4aa9-954a-9c0aaacce152 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:13.813518 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06efd770-16a2-4927-986e-30108f46f2c0 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:13.815348 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35180c0-3bb1-42a1-abeb-9b1964fd0918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:13.816445 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35180c0-3bb1-42a1-abeb-9b1964fd0918 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:13.816561 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35180c0-3bb1-42a1-abeb-9b1964fd0918 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:13.816811 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35180c0-3bb1-42a1-abeb-9b1964fd0918 admin admin] PATH_INFO: `/v3/users/561652aa25c446f4bf9e10be357b6804` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:13.818557 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35180c0-3bb1-42a1-abeb-9b1964fd0918 admin admin] RBAC: Authorizing `identity:delete_user(user_id=561652aa25c446f4bf9e10be357b6804)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:13.821604 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35180c0-3bb1-42a1-abeb-9b1964fd0918 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:13.853128 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 848/1696] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jul 11 14:41:13 2022] PUT /identity/v3/projects/a14f2e5d21324d81a969002e7df95c08/users/c840582b218347bcae44bf400f6211a2/roles/b46df176b0fe479da63c318db225bed4 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:41:13.854701 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10a2cee-7fdf-4f27-b405-98f2914c3c62 None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:13.855207 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10a2cee-7fdf-4f27-b405-98f2914c3c62 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:13.855595 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10a2cee-7fdf-4f27-b405-98f2914c3c62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:13.910375 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-f35180c0-3bb1-42a1-abeb-9b1964fd0918 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '561652aa25c446f4bf9e10be357b6804'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:13.928048 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-d10a2cee-7fdf-4f27-b405-98f2914c3c62 None None] MFA Rules not processed for user `c840582b218347bcae44bf400f6211a2`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:41:13.930286 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-f35180c0-3bb1-42a1-abeb-9b1964fd0918 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '561652aa25c446f4bf9e10be357b6804'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:13.931756 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-d10a2cee-7fdf-4f27-b405-98f2914c3c62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:13.942617 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-f35180c0-3bb1-42a1-abeb-9b1964fd0918 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '561652aa25c446f4bf9e10be357b6804'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:13.943182 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-f35180c0-3bb1-42a1-abeb-9b1964fd0918 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '561652aa25c446f4bf9e10be357b6804'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:13.943934 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-f35180c0-3bb1-42a1-abeb-9b1964fd0918 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '561652aa25c446f4bf9e10be357b6804'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:13.982111 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 849/1697] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jul 11 14:41:13 2022] DELETE /identity/v3/users/561652aa25c446f4bf9e10be357b6804 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:41:13.984502 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70edfae3-9353-4d2e-a345-52acdead029b None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:13.984502 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70edfae3-9353-4d2e-a345-52acdead029b None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:13.984834 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70edfae3-9353-4d2e-a345-52acdead029b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:14.023859 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-70edfae3-9353-4d2e-a345-52acdead029b None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:41:14.025150 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-70edfae3-9353-4d2e-a345-52acdead029b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:14.157640 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 850/1698] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:41:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:41:14.206840 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 849/1699] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:41:13 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 353 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:41:14.222883 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70edfae3-9353-4d2e-a345-52acdead029b None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:14.225000 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-70edfae3-9353-4d2e-a345-52acdead029b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:14.301503 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10a2cee-7fdf-4f27-b405-98f2914c3c62 None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:14.305003 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-d10a2cee-7fdf-4f27-b405-98f2914c3c62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:14.327655 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:41:14.378937 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70edfae3-9353-4d2e-a345-52acdead029b None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:14.390699 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b180a6-1ad6-4c37-9c8e-ac97f157fcb5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '868e7c2dec264512b972c8736d659c34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:14.392097 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b180a6-1ad6-4c37-9c8e-ac97f157fcb5 service cinder] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:14.392634 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b180a6-1ad6-4c37-9c8e-ac97f157fcb5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:14.393120 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b180a6-1ad6-4c37-9c8e-ac97f157fcb5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:14.397411 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-18b180a6-1ad6-4c37-9c8e-ac97f157fcb5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:14.469986 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10a2cee-7fdf-4f27-b405-98f2914c3c62 None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:14.521974 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:41:14.590743 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b180a6-1ad6-4c37-9c8e-ac97f157fcb5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:14.592679 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b180a6-1ad6-4c37-9c8e-ac97f157fcb5 service cinder] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:14.626176 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 851/1700] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:41:14 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:41:14.628218 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b180a6-1ad6-4c37-9c8e-ac97f157fcb5 service cinder] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:14.632914 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-18b180a6-1ad6-4c37-9c8e-ac97f157fcb5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:14.634513 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7b9ece-dca0-4b9d-a20f-ab35b472be13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20eede5ccd834862b00123310b5c3975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:14.638716 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7b9ece-dca0-4b9d-a20f-ab35b472be13 service neutron] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:14.639116 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7b9ece-dca0-4b9d-a20f-ab35b472be13 service neutron] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:14.641980 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7b9ece-dca0-4b9d-a20f-ab35b472be13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:14.673495 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7b9ece-dca0-4b9d-a20f-ab35b472be13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:14.677583 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7b9ece-dca0-4b9d-a20f-ab35b472be13 service neutron] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:14.714717 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 850/1701] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:41:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:41:14.726580 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7792f9c6-8465-4f42-9f53-4edbf7b7eef3 None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:14.727049 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7792f9c6-8465-4f42-9f53-4edbf7b7eef3 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:14.727445 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7792f9c6-8465-4f42-9f53-4edbf7b7eef3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:14.806588 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-7792f9c6-8465-4f42-9f53-4edbf7b7eef3 None None] MFA Rules not processed for user `fee6e5aa4b4947faa8b6f7937250986b`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:41:14.814296 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-7792f9c6-8465-4f42-9f53-4edbf7b7eef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:14.912644 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b180a6-1ad6-4c37-9c8e-ac97f157fcb5 service cinder] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:14.926915 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eb8bcd-8272-4601-98d5-58d053a902d5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bf25c7951dc4182996335ca1f0e56ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:14.927664 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eb8bcd-8272-4601-98d5-58d053a902d5 service placement] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:14.928399 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eb8bcd-8272-4601-98d5-58d053a902d5 service placement] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:14.928766 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eb8bcd-8272-4601-98d5-58d053a902d5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:14.936633 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-47eb8bcd-8272-4601-98d5-58d053a902d5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:14.966397 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47eb8bcd-8272-4601-98d5-58d053a902d5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:14.968953 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47eb8bcd-8272-4601-98d5-58d053a902d5 service placement] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:15.001525 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 852/1702] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:41:14 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:41:15.003557 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae3063e-3a84-4cd7-a35f-bfa7bebf5b09 None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:15.003557 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae3063e-3a84-4cd7-a35f-bfa7bebf5b09 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:15.010096 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae3063e-3a84-4cd7-a35f-bfa7bebf5b09 None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:15.014687 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 853/1703] 10.222.0.70 () {54 vars in 921 bytes} [Mon Jul 11 14:41:15 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:41:15.030933 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 851/1704] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:41:14 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:41:15.060805 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be2a629-fe64-4824-a571-44d7be8a1e0c None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:15.061654 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be2a629-fe64-4824-a571-44d7be8a1e0c None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:15.061654 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be2a629-fe64-4824-a571-44d7be8a1e0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:15.080032 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7792f9c6-8465-4f42-9f53-4edbf7b7eef3 None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:15.083494 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-7792f9c6-8465-4f42-9f53-4edbf7b7eef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:15.123507 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-5be2a629-fe64-4824-a571-44d7be8a1e0c None None] MFA Rules not processed for user `4bf25c7951dc4182996335ca1f0e56ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:41:15.125173 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7792f9c6-8465-4f42-9f53-4edbf7b7eef3 None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:15.126553 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-5be2a629-fe64-4824-a571-44d7be8a1e0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:15.139967 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20869650-22ef-4c8c-a92d-6fa570f41cbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:15.142532 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20869650-22ef-4c8c-a92d-6fa570f41cbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:15.143344 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20869650-22ef-4c8c-a92d-6fa570f41cbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:15.144344 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20869650-22ef-4c8c-a92d-6fa570f41cbe admin admin] PATH_INFO: `/v3/users/c992e0de17eb4db983a163ec4db77620` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:15.148271 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20869650-22ef-4c8c-a92d-6fa570f41cbe admin admin] RBAC: Authorizing `identity:delete_user(user_id=c992e0de17eb4db983a163ec4db77620)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:15.150654 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20869650-22ef-4c8c-a92d-6fa570f41cbe admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:15.162956 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 854/1705] 10.222.0.70 () {58 vars in 1018 bytes} [Mon Jul 11 14:41:15 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:41:15.263193 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-20869650-22ef-4c8c-a92d-6fa570f41cbe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c992e0de17eb4db983a163ec4db77620'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:15.284039 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-20869650-22ef-4c8c-a92d-6fa570f41cbe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c992e0de17eb4db983a163ec4db77620'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:15.301666 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-20869650-22ef-4c8c-a92d-6fa570f41cbe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c992e0de17eb4db983a163ec4db77620'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:15.302776 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-20869650-22ef-4c8c-a92d-6fa570f41cbe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c992e0de17eb4db983a163ec4db77620'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:15.303631 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-20869650-22ef-4c8c-a92d-6fa570f41cbe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c992e0de17eb4db983a163ec4db77620'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:15.345277 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 852/1706] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jul 11 14:41:15 2022] DELETE /identity/v3/users/c992e0de17eb4db983a163ec4db77620 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:41:15.505807 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be2a629-fe64-4824-a571-44d7be8a1e0c None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:15.507594 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-5be2a629-fe64-4824-a571-44d7be8a1e0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:15.529825 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be2a629-fe64-4824-a571-44d7be8a1e0c None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:15.684265 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d5db66-6129-4a09-96c8-a23a8b42fc23 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bf25c7951dc4182996335ca1f0e56ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:15.684775 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d5db66-6129-4a09-96c8-a23a8b42fc23 service placement] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:15.685061 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d5db66-6129-4a09-96c8-a23a8b42fc23 service placement] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:15.685331 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d5db66-6129-4a09-96c8-a23a8b42fc23 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:15.689197 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-a7d5db66-6129-4a09-96c8-a23a8b42fc23 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:15.730914 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d5db66-6129-4a09-96c8-a23a8b42fc23 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:15.734343 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d5db66-6129-4a09-96c8-a23a8b42fc23 service placement] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:15.777838 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 855/1707] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:41:15 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:41:16.813160 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20869650-22ef-4c8c-a92d-6fa570f41cbe admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:16.814631 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-20869650-22ef-4c8c-a92d-6fa570f41cbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:16.952890 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:41:16.990667 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20869650-22ef-4c8c-a92d-6fa570f41cbe admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:17.003834 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc26afd-e50e-4278-9cd4-0d8b6466f1e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:17.009510 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc26afd-e50e-4278-9cd4-0d8b6466f1e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:17.009826 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc26afd-e50e-4278-9cd4-0d8b6466f1e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:17.010426 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc26afd-e50e-4278-9cd4-0d8b6466f1e8 admin admin] PATH_INFO: `/v3/projects/2dcc139831c34b80a133956d11abfdb8` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:17.013756 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc26afd-e50e-4278-9cd4-0d8b6466f1e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2dcc139831c34b80a133956d11abfdb8)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:17.028813 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc26afd-e50e-4278-9cd4-0d8b6466f1e8 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:17.263902 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-cbc26afd-e50e-4278-9cd4-0d8b6466f1e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2dcc139831c34b80a133956d11abfdb8', 'request_id': 'req-cbc26afd-e50e-4278-9cd4-0d8b6466f1e8'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:17.287818 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-cbc26afd-e50e-4278-9cd4-0d8b6466f1e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2dcc139831c34b80a133956d11abfdb8', 'request_id': 'req-cbc26afd-e50e-4278-9cd4-0d8b6466f1e8'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:17.316247 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-cbc26afd-e50e-4278-9cd4-0d8b6466f1e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2dcc139831c34b80a133956d11abfdb8', 'request_id': 'req-cbc26afd-e50e-4278-9cd4-0d8b6466f1e8'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:17.352130 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-cbc26afd-e50e-4278-9cd4-0d8b6466f1e8 admin admin] The token cache is being invalidate because project 2dcc139831c34b80a133956d11abfdb8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80534) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:41:17.353161 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-cbc26afd-e50e-4278-9cd4-0d8b6466f1e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:17.357395 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-cbc26afd-e50e-4278-9cd4-0d8b6466f1e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:17.364452 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d5db66-6129-4a09-96c8-a23a8b42fc23 service placement] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:17.364933 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 853/1708] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jul 11 14:41:16 2022] DELETE /identity/v3/projects/2dcc139831c34b80a133956d11abfdb8 => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:41:17.395777 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d5db66-6129-4a09-96c8-a23a8b42fc23 service placement] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:17.418063 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:41:17.538555 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc26afd-e50e-4278-9cd4-0d8b6466f1e8 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:17.540795 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-cbc26afd-e50e-4278-9cd4-0d8b6466f1e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:17.655338 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a99565d-b42a-4380-8a1b-b41d4d14b039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:17.657048 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a99565d-b42a-4380-8a1b-b41d4d14b039 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:17.661826 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a99565d-b42a-4380-8a1b-b41d4d14b039 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:17.662458 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a99565d-b42a-4380-8a1b-b41d4d14b039 admin admin] PATH_INFO: `/v3/users/11aa0ddfff96474c8f621100efa69911` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:17.667524 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a99565d-b42a-4380-8a1b-b41d4d14b039 admin admin] RBAC: Authorizing `identity:delete_user(user_id=11aa0ddfff96474c8f621100efa69911)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:17.681890 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a99565d-b42a-4380-8a1b-b41d4d14b039 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:17.863263 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-7a99565d-b42a-4380-8a1b-b41d4d14b039 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11aa0ddfff96474c8f621100efa69911'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:17.890431 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc26afd-e50e-4278-9cd4-0d8b6466f1e8 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:17.895403 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-7a99565d-b42a-4380-8a1b-b41d4d14b039 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11aa0ddfff96474c8f621100efa69911'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:17.908827 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39456390-a263-4e90-b589-5410c1c9b0b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:17.912708 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39456390-a263-4e90-b589-5410c1c9b0b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:17.915127 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39456390-a263-4e90-b589-5410c1c9b0b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:17.916697 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39456390-a263-4e90-b589-5410c1c9b0b8 admin admin] PATH_INFO: `/v3/projects/38a67544af1a4357b4bec300594dbbe2` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:17.923848 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39456390-a263-4e90-b589-5410c1c9b0b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=38a67544af1a4357b4bec300594dbbe2)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:17.931277 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-7a99565d-b42a-4380-8a1b-b41d4d14b039 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11aa0ddfff96474c8f621100efa69911'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:17.931914 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39456390-a263-4e90-b589-5410c1c9b0b8 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:17.933182 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-7a99565d-b42a-4380-8a1b-b41d4d14b039 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11aa0ddfff96474c8f621100efa69911'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:17.934037 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-7a99565d-b42a-4380-8a1b-b41d4d14b039 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11aa0ddfff96474c8f621100efa69911'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:18.017497 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 856/1709] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jul 11 14:41:17 2022] DELETE /identity/v3/users/11aa0ddfff96474c8f621100efa69911 => generated 0 bytes in 654 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:41:18.088138 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-39456390-a263-4e90-b589-5410c1c9b0b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38a67544af1a4357b4bec300594dbbe2', 'request_id': 'req-39456390-a263-4e90-b589-5410c1c9b0b8'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:18.117839 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-39456390-a263-4e90-b589-5410c1c9b0b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38a67544af1a4357b4bec300594dbbe2', 'request_id': 'req-39456390-a263-4e90-b589-5410c1c9b0b8'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:18.152465 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-39456390-a263-4e90-b589-5410c1c9b0b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38a67544af1a4357b4bec300594dbbe2', 'request_id': 'req-39456390-a263-4e90-b589-5410c1c9b0b8'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:18.188048 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a99565d-b42a-4380-8a1b-b41d4d14b039 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:18.189621 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-7a99565d-b42a-4380-8a1b-b41d4d14b039 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:18.191409 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-39456390-a263-4e90-b589-5410c1c9b0b8 admin admin] The token cache is being invalidate because project 38a67544af1a4357b4bec300594dbbe2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80534) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:41:18.191745 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-39456390-a263-4e90-b589-5410c1c9b0b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:18.193408 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-39456390-a263-4e90-b589-5410c1c9b0b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:18.202240 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 854/1710] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jul 11 14:41:17 2022] DELETE /identity/v3/projects/38a67544af1a4357b4bec300594dbbe2 => generated 0 bytes in 662 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:41:18.206747 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39456390-a263-4e90-b589-5410c1c9b0b8 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:18.210555 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-39456390-a263-4e90-b589-5410c1c9b0b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:18.233443 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:41:18.412340 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39456390-a263-4e90-b589-5410c1c9b0b8 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:18.426931 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde664cb-4f06-4e55-9ccf-5796c5f355a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:18.429227 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde664cb-4f06-4e55-9ccf-5796c5f355a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:18.429516 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde664cb-4f06-4e55-9ccf-5796c5f355a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:18.429798 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde664cb-4f06-4e55-9ccf-5796c5f355a5 admin admin] PATH_INFO: `/v3/users/bcea677a1ff84448804711f2fd89ad9a` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:18.436469 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde664cb-4f06-4e55-9ccf-5796c5f355a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bcea677a1ff84448804711f2fd89ad9a)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:18.443153 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde664cb-4f06-4e55-9ccf-5796c5f355a5 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:18.523807 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a99565d-b42a-4380-8a1b-b41d4d14b039 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:18.599011 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-bde664cb-4f06-4e55-9ccf-5796c5f355a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bcea677a1ff84448804711f2fd89ad9a'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:18.617942 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-bde664cb-4f06-4e55-9ccf-5796c5f355a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bcea677a1ff84448804711f2fd89ad9a'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:18.632815 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-bde664cb-4f06-4e55-9ccf-5796c5f355a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bcea677a1ff84448804711f2fd89ad9a'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:18.633673 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-bde664cb-4f06-4e55-9ccf-5796c5f355a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bcea677a1ff84448804711f2fd89ad9a'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:18.634450 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-bde664cb-4f06-4e55-9ccf-5796c5f355a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bcea677a1ff84448804711f2fd89ad9a'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:18.712675 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 855/1711] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jul 11 14:41:18 2022] DELETE /identity/v3/users/bcea677a1ff84448804711f2fd89ad9a => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:41:18.741405 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:41:18.762273 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bfca06-3b16-4129-8c73-3167cb0acc58 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '868e7c2dec264512b972c8736d659c34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:18.763417 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bfca06-3b16-4129-8c73-3167cb0acc58 service cinder] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:18.770054 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bfca06-3b16-4129-8c73-3167cb0acc58 service cinder] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:18.770818 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bfca06-3b16-4129-8c73-3167cb0acc58 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:18.777484 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-31bfca06-3b16-4129-8c73-3167cb0acc58 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:19.060655 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bfca06-3b16-4129-8c73-3167cb0acc58 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:19.073922 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bfca06-3b16-4129-8c73-3167cb0acc58 service cinder] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:19.123435 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 857/1712] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:41:18 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 936 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:41:19.483592 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8c3e77-e426-4376-be60-fc7cba2e2e38 None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:19.484176 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8c3e77-e426-4376-be60-fc7cba2e2e38 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:19.484312 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8c3e77-e426-4376-be60-fc7cba2e2e38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:19.629890 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-9d8c3e77-e426-4376-be60-fc7cba2e2e38 None None] MFA Rules not processed for user `2ef7b195b623456aa0b12dac0a4bf4d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:41:19.630571 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-9d8c3e77-e426-4376-be60-fc7cba2e2e38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:19.852145 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:41:19.886643 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bfca06-3b16-4129-8c73-3167cb0acc58 service cinder] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:19.888003 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-31bfca06-3b16-4129-8c73-3167cb0acc58 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:19.911868 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 856/1713] 10.222.0.70 () {58 vars in 1009 bytes} [Mon Jul 11 14:41:19 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 424 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:41:19.936859 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bfca06-3b16-4129-8c73-3167cb0acc58 service cinder] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:20.180102 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819c2742-3e7f-4740-aaf8-9c203dc7d7ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:20.184681 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819c2742-3e7f-4740-aaf8-9c203dc7d7ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:20.185177 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819c2742-3e7f-4740-aaf8-9c203dc7d7ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:20.185578 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819c2742-3e7f-4740-aaf8-9c203dc7d7ee admin admin] PATH_INFO: `/v3/projects/9e3081dc595f49aca38c228be376e03b` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:20.222368 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819c2742-3e7f-4740-aaf8-9c203dc7d7ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e3081dc595f49aca38c228be376e03b)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:20.225437 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819c2742-3e7f-4740-aaf8-9c203dc7d7ee admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:20.232613 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8c3e77-e426-4376-be60-fc7cba2e2e38 None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:20.235957 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-9d8c3e77-e426-4376-be60-fc7cba2e2e38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:20.491887 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-819c2742-3e7f-4740-aaf8-9c203dc7d7ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e3081dc595f49aca38c228be376e03b', 'request_id': 'req-819c2742-3e7f-4740-aaf8-9c203dc7d7ee'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:20.514253 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-819c2742-3e7f-4740-aaf8-9c203dc7d7ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e3081dc595f49aca38c228be376e03b', 'request_id': 'req-819c2742-3e7f-4740-aaf8-9c203dc7d7ee'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:20.530025 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-819c2742-3e7f-4740-aaf8-9c203dc7d7ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e3081dc595f49aca38c228be376e03b', 'request_id': 'req-819c2742-3e7f-4740-aaf8-9c203dc7d7ee'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:20.550212 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8c3e77-e426-4376-be60-fc7cba2e2e38 None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:20.559830 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-819c2742-3e7f-4740-aaf8-9c203dc7d7ee admin admin] The token cache is being invalidate because project 9e3081dc595f49aca38c228be376e03b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:41:20.560133 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-819c2742-3e7f-4740-aaf8-9c203dc7d7ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:20.562018 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-819c2742-3e7f-4740-aaf8-9c203dc7d7ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:20.573443 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 858/1714] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jul 11 14:41:19 2022] DELETE /identity/v3/projects/9e3081dc595f49aca38c228be376e03b => generated 0 bytes in 680 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:41:20.575304 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bf869e-5627-4b64-bfa3-8e05de9aa57f None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:20.577038 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bf869e-5627-4b64-bfa3-8e05de9aa57f None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:20.577916 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bf869e-5627-4b64-bfa3-8e05de9aa57f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:20.637566 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-a9bf869e-5627-4b64-bfa3-8e05de9aa57f None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:41:20.641861 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-a9bf869e-5627-4b64-bfa3-8e05de9aa57f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:20.708269 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:41:20.856880 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d00eda-24ef-44b3-b2aa-8b849d9045eb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0217add2f5e74a80a1a33b160cc57a2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:20.857572 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d00eda-24ef-44b3-b2aa-8b849d9045eb service swift] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:20.857862 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d00eda-24ef-44b3-b2aa-8b849d9045eb service swift] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:20.858146 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d00eda-24ef-44b3-b2aa-8b849d9045eb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:20.869849 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-e4d00eda-24ef-44b3-b2aa-8b849d9045eb service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:20.890216 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 859/1715] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:41:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:41:20.902447 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171443da-6085-4d5d-bd85-4a49fd5cf6b2 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:20.902745 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171443da-6085-4d5d-bd85-4a49fd5cf6b2 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:20.903027 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171443da-6085-4d5d-bd85-4a49fd5cf6b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:20.966536 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-171443da-6085-4d5d-bd85-4a49fd5cf6b2 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:41:20.976492 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-171443da-6085-4d5d-bd85-4a49fd5cf6b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:21.006513 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 860/1716] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:41:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:41:21.013935 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171443da-6085-4d5d-bd85-4a49fd5cf6b2 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:21.028587 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171443da-6085-4d5d-bd85-4a49fd5cf6b2 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:21.033991 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3cfddc-2437-4c20-b751-9a30d66beafd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:21.034681 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3cfddc-2437-4c20-b751-9a30d66beafd admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:21.035150 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3cfddc-2437-4c20-b751-9a30d66beafd admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:21.035380 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3cfddc-2437-4c20-b751-9a30d66beafd admin admin] PATH_INFO: `/v3/domains` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:21.036459 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3cfddc-2437-4c20-b751-9a30d66beafd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:41:21.036773 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3cfddc-2437-4c20-b751-9a30d66beafd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:21.039291 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3cfddc-2437-4c20-b751-9a30d66beafd admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:21.053775 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d00eda-24ef-44b3-b2aa-8b849d9045eb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:21.066830 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 861/1717] 10.222.0.70 () {58 vars in 1152 bytes} [Mon Jul 11 14:41:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:41:21.067611 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3cfddc-2437-4c20-b751-9a30d66beafd admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:21.075299 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d00eda-24ef-44b3-b2aa-8b849d9045eb service swift] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:21.081477 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3cfddc-2437-4c20-b751-9a30d66beafd admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:21.098350 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cd28a8-7308-4009-94c9-992f7e9b571b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:21.099650 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cd28a8-7308-4009-94c9-992f7e9b571b admin admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:21.100776 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cd28a8-7308-4009-94c9-992f7e9b571b admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:21.101650 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cd28a8-7308-4009-94c9-992f7e9b571b admin admin] PATH_INFO: `/v3/projects` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:21.103420 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cd28a8-7308-4009-94c9-992f7e9b571b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:21.110438 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cd28a8-7308-4009-94c9-992f7e9b571b admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:21.111149 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 857/1718] 10.222.0.70 () {60 vars in 1384 bytes} [Mon Jul 11 14:41:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 879 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 11 14:41:21.208267 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 862/1719] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jul 11 14:41:21 2022] POST /identity/v3/projects => generated 373 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:41:21.213061 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d00eda-24ef-44b3-b2aa-8b849d9045eb service swift] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:21.253220 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d00eda-24ef-44b3-b2aa-8b849d9045eb service swift] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:21.318477 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4168efec-7c32-46e7-9d8f-86933f61f3d0 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:21.318679 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4168efec-7c32-46e7-9d8f-86933f61f3d0 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:21.318964 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4168efec-7c32-46e7-9d8f-86933f61f3d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:21.326881 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:41:21.430134 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-4168efec-7c32-46e7-9d8f-86933f61f3d0 None None] MFA Rules not processed for user `caa770e36e624905b2e23610e901e22d`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:41:21.435526 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-4168efec-7c32-46e7-9d8f-86933f61f3d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:21.535427 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a210316b-1d25-4df3-8c7c-a0152411e7b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:21.537650 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a210316b-1d25-4df3-8c7c-a0152411e7b2 admin admin] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:21.540702 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a210316b-1d25-4df3-8c7c-a0152411e7b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:21.541746 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a210316b-1d25-4df3-8c7c-a0152411e7b2 admin admin] PATH_INFO: `/v3/users` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:21.544536 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a210316b-1d25-4df3-8c7c-a0152411e7b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:21.561362 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a210316b-1d25-4df3-8c7c-a0152411e7b2 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:21.677217 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 858/1720] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jul 11 14:41:21 2022] POST /identity/v3/users => generated 287 bytes in 464 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:41:21.679972 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a210316b-1d25-4df3-8c7c-a0152411e7b2 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:21.697026 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a210316b-1d25-4df3-8c7c-a0152411e7b2 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:21.703270 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5542b0-bb03-4b3b-9e15-bebc762fe49c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:21.704017 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5542b0-bb03-4b3b-9e15-bebc762fe49c admin admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:21.704335 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5542b0-bb03-4b3b-9e15-bebc762fe49c admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:21.705104 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5542b0-bb03-4b3b-9e15-bebc762fe49c admin admin] PATH_INFO: `/v3/roles` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:21.707346 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5542b0-bb03-4b3b-9e15-bebc762fe49c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:21.710568 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5542b0-bb03-4b3b-9e15-bebc762fe49c admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:21.736998 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 859/1721] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:41:21 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:41:21.738089 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5542b0-bb03-4b3b-9e15-bebc762fe49c admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:21.753436 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5542b0-bb03-4b3b-9e15-bebc762fe49c admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:21.762702 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93f57bb-22b5-4ace-8b27-55a2efc6c99f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:21.765047 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93f57bb-22b5-4ace-8b27-55a2efc6c99f admin admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:21.765515 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93f57bb-22b5-4ace-8b27-55a2efc6c99f admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:21.765938 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93f57bb-22b5-4ace-8b27-55a2efc6c99f admin admin] PATH_INFO: `/v3/roles` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:21.769992 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93f57bb-22b5-4ace-8b27-55a2efc6c99f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:21.779721 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93f57bb-22b5-4ace-8b27-55a2efc6c99f admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:21.808559 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 860/1722] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:41:21 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:41:21.822425 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93f57bb-22b5-4ace-8b27-55a2efc6c99f admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:21.840968 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 863/1723] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:41:21 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 517 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:41:21.850004 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4168efec-7c32-46e7-9d8f-86933f61f3d0 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:21.852557 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-4168efec-7c32-46e7-9d8f-86933f61f3d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:21.869576 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93f57bb-22b5-4ace-8b27-55a2efc6c99f admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:21.876717 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342856de-0a2f-4ca0-b761-de81973afe42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:21.877637 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342856de-0a2f-4ca0-b761-de81973afe42 admin admin] REQUEST_METHOD: `PUT` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:21.877974 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342856de-0a2f-4ca0-b761-de81973afe42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:21.878523 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342856de-0a2f-4ca0-b761-de81973afe42 admin admin] PATH_INFO: `/v3/projects/c5e2b2947d414879a5610f2b533b8fc0/users/cdf12f92311246d5b615682d452780b7/roles/8eff41f243c843ed95505a488ca6eada` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:21.904804 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342856de-0a2f-4ca0-b761-de81973afe42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5e2b2947d414879a5610f2b533b8fc0, user_id=cdf12f92311246d5b615682d452780b7, role_id=8eff41f243c843ed95505a488ca6eada)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:21.935590 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342856de-0a2f-4ca0-b761-de81973afe42 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:22.006892 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 861/1724] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jul 11 14:41:21 2022] PUT /identity/v3/projects/c5e2b2947d414879a5610f2b533b8fc0/users/cdf12f92311246d5b615682d452780b7/roles/8eff41f243c843ed95505a488ca6eada => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:41:22.020783 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d46b877-035b-4543-94c4-1784ae5b956d None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:22.031058 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d46b877-035b-4543-94c4-1784ae5b956d None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:22.035924 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d46b877-035b-4543-94c4-1784ae5b956d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:22.199391 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-5d46b877-035b-4543-94c4-1784ae5b956d None None] MFA Rules not processed for user `cdf12f92311246d5b615682d452780b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:41:22.201050 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-5d46b877-035b-4543-94c4-1784ae5b956d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:22.228700 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4168efec-7c32-46e7-9d8f-86933f61f3d0 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:22.239920 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:41:22.345180 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 862/1725] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:41:22 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:41:22.347895 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d46b877-035b-4543-94c4-1784ae5b956d None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:22.393199 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36729ac7-15a1-481f-9143-c174586c5627 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4f8c0d696af4bd5a205ca8e9110b8cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:22.393908 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36729ac7-15a1-481f-9143-c174586c5627 service nova] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:22.395509 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36729ac7-15a1-481f-9143-c174586c5627 service nova] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:22.396187 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36729ac7-15a1-481f-9143-c174586c5627 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:22.579118 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:41:22.624882 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d46b877-035b-4543-94c4-1784ae5b956d None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:22.644660 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c332179-15a8-4863-af4f-c62d085ee810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:22.645671 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c332179-15a8-4863-af4f-c62d085ee810 admin admin] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:22.646073 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c332179-15a8-4863-af4f-c62d085ee810 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:22.646664 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c332179-15a8-4863-af4f-c62d085ee810 admin admin] PATH_INFO: `/v3/projects` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:22.648226 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c332179-15a8-4863-af4f-c62d085ee810 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:22.651825 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c332179-15a8-4863-af4f-c62d085ee810 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:22.746742 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 863/1726] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jul 11 14:41:22 2022] POST /identity/v3/projects => generated 371 bytes in 399 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:41:22.772140 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c332179-15a8-4863-af4f-c62d085ee810 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:22.863947 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36729ac7-15a1-481f-9143-c174586c5627 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:22.870149 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36729ac7-15a1-481f-9143-c174586c5627 service nova] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:22.921730 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 864/1727] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:41:21 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 1072 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:41:22.995240 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c332179-15a8-4863-af4f-c62d085ee810 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:23.005674 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1900989f-4b66-488b-802a-f7232c8b5e60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:23.009668 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1900989f-4b66-488b-802a-f7232c8b5e60 admin admin] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:23.010437 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1900989f-4b66-488b-802a-f7232c8b5e60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:23.010964 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1900989f-4b66-488b-802a-f7232c8b5e60 admin admin] PATH_INFO: `/v3/users` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:23.013272 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1900989f-4b66-488b-802a-f7232c8b5e60 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:23.016128 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1900989f-4b66-488b-802a-f7232c8b5e60 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:23.099195 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 864/1728] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jul 11 14:41:22 2022] POST /identity/v3/users => generated 292 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:41:23.103872 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36729ac7-15a1-481f-9143-c174586c5627 service nova] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:23.183355 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1900989f-4b66-488b-802a-f7232c8b5e60 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:23.185233 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-1900989f-4b66-488b-802a-f7232c8b5e60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:23.204770 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36729ac7-15a1-481f-9143-c174586c5627 service nova] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:23.246269 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257d5d6c-8aa8-43bd-8370-c4313f8d346d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:23.247108 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257d5d6c-8aa8-43bd-8370-c4313f8d346d admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:23.260775 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257d5d6c-8aa8-43bd-8370-c4313f8d346d admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:23.261084 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257d5d6c-8aa8-43bd-8370-c4313f8d346d admin admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:23.286811 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257d5d6c-8aa8-43bd-8370-c4313f8d346d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:23.288504 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1900989f-4b66-488b-802a-f7232c8b5e60 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:23.317709 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257d5d6c-8aa8-43bd-8370-c4313f8d346d admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:23.342926 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1b4ac1-0473-4293-b15e-1c82f4e55c59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:23.365149 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1b4ac1-0473-4293-b15e-1c82f4e55c59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:23.367364 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1b4ac1-0473-4293-b15e-1c82f4e55c59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:23.367965 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1b4ac1-0473-4293-b15e-1c82f4e55c59 admin admin] PATH_INFO: `/v3/projects/a2611df563934127977756bf6840ef91` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:23.373499 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1b4ac1-0473-4293-b15e-1c82f4e55c59 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2611df563934127977756bf6840ef91)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:23.390447 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1b4ac1-0473-4293-b15e-1c82f4e55c59 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:23.415028 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 865/1729] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:41:23 2022] GET /identity/v3/roles => generated 1420 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:41:23.420052 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257d5d6c-8aa8-43bd-8370-c4313f8d346d admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:23.522253 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257d5d6c-8aa8-43bd-8370-c4313f8d346d admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:23.555936 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1a2b69-8a45-4696-b7e9-ba3409b139a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:23.559596 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1a2b69-8a45-4696-b7e9-ba3409b139a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:23.569844 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1a2b69-8a45-4696-b7e9-ba3409b139a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:23.570267 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1a2b69-8a45-4696-b7e9-ba3409b139a2 admin admin] PATH_INFO: `/v3/projects/13038f14e19d4eb7b8c5aa85cab08b86/users/fa3f0361f96c4ba5967327cdfcd9bd0e/roles/b46df176b0fe479da63c318db225bed4` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:23.753120 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1a2b69-8a45-4696-b7e9-ba3409b139a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13038f14e19d4eb7b8c5aa85cab08b86, user_id=fa3f0361f96c4ba5967327cdfcd9bd0e, role_id=b46df176b0fe479da63c318db225bed4)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:23.758712 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-0f1b4ac1-0473-4293-b15e-1c82f4e55c59 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2611df563934127977756bf6840ef91', 'request_id': 'req-0f1b4ac1-0473-4293-b15e-1c82f4e55c59'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:23.767159 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1a2b69-8a45-4696-b7e9-ba3409b139a2 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:23.795498 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-0f1b4ac1-0473-4293-b15e-1c82f4e55c59 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2611df563934127977756bf6840ef91', 'request_id': 'req-0f1b4ac1-0473-4293-b15e-1c82f4e55c59'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:23.826628 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-0f1b4ac1-0473-4293-b15e-1c82f4e55c59 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2611df563934127977756bf6840ef91', 'request_id': 'req-0f1b4ac1-0473-4293-b15e-1c82f4e55c59'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:23.843725 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 866/1730] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jul 11 14:41:23 2022] PUT /identity/v3/projects/13038f14e19d4eb7b8c5aa85cab08b86/users/fa3f0361f96c4ba5967327cdfcd9bd0e/roles/b46df176b0fe479da63c318db225bed4 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:41:23.854640 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1a2b69-8a45-4696-b7e9-ba3409b139a2 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:23.864388 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-0f1b4ac1-0473-4293-b15e-1c82f4e55c59 admin admin] The token cache is being invalidate because project a2611df563934127977756bf6840ef91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80534) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:41:23.864787 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-0f1b4ac1-0473-4293-b15e-1c82f4e55c59 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:23.876131 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-0f1b4ac1-0473-4293-b15e-1c82f4e55c59 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:23.881449 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 865/1731] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jul 11 14:41:23 2022] DELETE /identity/v3/projects/a2611df563934127977756bf6840ef91 => generated 0 bytes in 704 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:41:23.883505 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c33b63-0676-4def-b4e7-ddf56e746bab None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:23.883916 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c33b63-0676-4def-b4e7-ddf56e746bab None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:23.884387 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c33b63-0676-4def-b4e7-ddf56e746bab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:23.950364 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-50c33b63-0676-4def-b4e7-ddf56e746bab None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:41:23.958344 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-50c33b63-0676-4def-b4e7-ddf56e746bab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:24.134041 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:41:24.169670 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1a2b69-8a45-4696-b7e9-ba3409b139a2 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:24.193702 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a352cf-a560-42c1-89a5-bcf0dce6b4a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:24.194765 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a352cf-a560-42c1-89a5-bcf0dce6b4a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:24.195545 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a352cf-a560-42c1-89a5-bcf0dce6b4a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:24.199187 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a352cf-a560-42c1-89a5-bcf0dce6b4a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:24.200471 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a352cf-a560-42c1-89a5-bcf0dce6b4a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:24.203987 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 866/1732] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:41:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:41:24.206961 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a352cf-a560-42c1-89a5-bcf0dce6b4a6 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:24.210099 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704a1837-da6a-4d02-8d4c-a1fce0373f9d None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:24.215671 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704a1837-da6a-4d02-8d4c-a1fce0373f9d None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:24.217123 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704a1837-da6a-4d02-8d4c-a1fce0373f9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:24.268985 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 867/1733] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:41:23 2022] GET /identity/v3/roles => generated 1420 bytes in 419 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:41:24.270971 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a352cf-a560-42c1-89a5-bcf0dce6b4a6 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:24.279568 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-f8a352cf-a560-42c1-89a5-bcf0dce6b4a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:24.343338 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-704a1837-da6a-4d02-8d4c-a1fce0373f9d None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:41:24.350799 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-704a1837-da6a-4d02-8d4c-a1fce0373f9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:24.369938 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a352cf-a560-42c1-89a5-bcf0dce6b4a6 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:24.415735 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004b7d3a-3556-466f-b2b7-9f9c1bb927a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:24.417579 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004b7d3a-3556-466f-b2b7-9f9c1bb927a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:24.418046 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004b7d3a-3556-466f-b2b7-9f9c1bb927a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:24.418485 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004b7d3a-3556-466f-b2b7-9f9c1bb927a3 admin admin] PATH_INFO: `/v3/projects/13038f14e19d4eb7b8c5aa85cab08b86/users/fa3f0361f96c4ba5967327cdfcd9bd0e/roles/b46df176b0fe479da63c318db225bed4` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:24.420905 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004b7d3a-3556-466f-b2b7-9f9c1bb927a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13038f14e19d4eb7b8c5aa85cab08b86, user_id=fa3f0361f96c4ba5967327cdfcd9bd0e, role_id=b46df176b0fe479da63c318db225bed4)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:24.424370 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004b7d3a-3556-466f-b2b7-9f9c1bb927a3 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:24.425335 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 867/1734] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:41:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:41:24.427907 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:41:24.428063 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704a1837-da6a-4d02-8d4c-a1fce0373f9d None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:24.465133 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 868/1735] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jul 11 14:41:24 2022] PUT /identity/v3/projects/13038f14e19d4eb7b8c5aa85cab08b86/users/fa3f0361f96c4ba5967327cdfcd9bd0e/roles/b46df176b0fe479da63c318db225bed4 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:41:24.469566 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704a1837-da6a-4d02-8d4c-a1fce0373f9d None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:24.483274 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4061216-2e79-428a-ad9f-54a63db4b0e5 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:24.483828 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4061216-2e79-428a-ad9f-54a63db4b0e5 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:24.487486 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4061216-2e79-428a-ad9f-54a63db4b0e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:24.584675 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-a4061216-2e79-428a-ad9f-54a63db4b0e5 None None] MFA Rules not processed for user `fa3f0361f96c4ba5967327cdfcd9bd0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:41:24.586709 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-a4061216-2e79-428a-ad9f-54a63db4b0e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:24.599570 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63eb6fa9-97d9-47f5-99c8-edd04985330f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:24.600517 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eb6fa9-97d9-47f5-99c8-edd04985330f admin admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:24.600805 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eb6fa9-97d9-47f5-99c8-edd04985330f admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:24.601124 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eb6fa9-97d9-47f5-99c8-edd04985330f admin admin] PATH_INFO: `/v3/domains` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:24.601904 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63eb6fa9-97d9-47f5-99c8-edd04985330f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:41:24.602612 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63eb6fa9-97d9-47f5-99c8-edd04985330f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:24.605770 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63eb6fa9-97d9-47f5-99c8-edd04985330f admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:24.627201 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 868/1736] 10.222.0.70 () {58 vars in 1152 bytes} [Mon Jul 11 14:41:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:41:24.633076 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63eb6fa9-97d9-47f5-99c8-edd04985330f admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:24.654571 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63eb6fa9-97d9-47f5-99c8-edd04985330f admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:24.661382 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129560cf-ae81-459b-b0a4-b6a11b5174d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:24.662075 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129560cf-ae81-459b-b0a4-b6a11b5174d3 admin admin] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:24.662425 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129560cf-ae81-459b-b0a4-b6a11b5174d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:24.662633 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129560cf-ae81-459b-b0a4-b6a11b5174d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:24.663457 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129560cf-ae81-459b-b0a4-b6a11b5174d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:24.666412 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129560cf-ae81-459b-b0a4-b6a11b5174d3 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:24.723914 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 869/1737] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jul 11 14:41:24 2022] POST /identity/v3/projects => generated 379 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:41:24.732872 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129560cf-ae81-459b-b0a4-b6a11b5174d3 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:24.895511 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 869/1738] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:41:24 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 415 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:41:24.907048 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4061216-2e79-428a-ad9f-54a63db4b0e5 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:24.908309 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-a4061216-2e79-428a-ad9f-54a63db4b0e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:24.996506 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129560cf-ae81-459b-b0a4-b6a11b5174d3 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:25.007971 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d8fa87-ed0a-4185-ab92-84424aeeae02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:25.009387 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d8fa87-ed0a-4185-ab92-84424aeeae02 admin admin] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:25.010499 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d8fa87-ed0a-4185-ab92-84424aeeae02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:25.014365 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d8fa87-ed0a-4185-ab92-84424aeeae02 admin admin] PATH_INFO: `/v3/users` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:25.018267 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d8fa87-ed0a-4185-ab92-84424aeeae02 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:25.025404 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d8fa87-ed0a-4185-ab92-84424aeeae02 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:25.090399 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 870/1739] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jul 11 14:41:24 2022] POST /identity/v3/users => generated 290 bytes in 362 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:41:25.093341 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d8fa87-ed0a-4185-ab92-84424aeeae02 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:25.110302 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4061216-2e79-428a-ad9f-54a63db4b0e5 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:25.121762 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d8fa87-ed0a-4185-ab92-84424aeeae02 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:25.136678 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be0ec6c-495c-4970-8bc2-41ee8432eddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:25.138793 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be0ec6c-495c-4970-8bc2-41ee8432eddd admin admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:25.140255 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be0ec6c-495c-4970-8bc2-41ee8432eddd admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:25.140974 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be0ec6c-495c-4970-8bc2-41ee8432eddd admin admin] PATH_INFO: `/v3/roles` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:25.143293 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be0ec6c-495c-4970-8bc2-41ee8432eddd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:25.146865 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be0ec6c-495c-4970-8bc2-41ee8432eddd admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:25.181583 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 871/1740] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:41:25 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:41:25.183968 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be0ec6c-495c-4970-8bc2-41ee8432eddd admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:25.203765 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be0ec6c-495c-4970-8bc2-41ee8432eddd admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:25.219673 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9032ab4-536d-4ccd-829e-90bf9544b680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:25.220399 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9032ab4-536d-4ccd-829e-90bf9544b680 admin admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:25.220686 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9032ab4-536d-4ccd-829e-90bf9544b680 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:25.220972 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9032ab4-536d-4ccd-829e-90bf9544b680 admin admin] PATH_INFO: `/v3/roles` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:25.221722 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9032ab4-536d-4ccd-829e-90bf9544b680 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:25.223333 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9032ab4-536d-4ccd-829e-90bf9544b680 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:25.234736 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da63d3a2-596b-4709-a1a4-d0355fdb2ce1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '868e7c2dec264512b972c8736d659c34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:25.236536 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da63d3a2-596b-4709-a1a4-d0355fdb2ce1 service cinder] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:25.236829 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da63d3a2-596b-4709-a1a4-d0355fdb2ce1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:25.237400 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da63d3a2-596b-4709-a1a4-d0355fdb2ce1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:25.246721 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 872/1741] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:41:25 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 14:41:25.251271 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9032ab4-536d-4ccd-829e-90bf9544b680 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:25.277967 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9032ab4-536d-4ccd-829e-90bf9544b680 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:25.292146 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b4aa1a-9919-4dc7-99ef-b361b4bd93f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:25.293281 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b4aa1a-9919-4dc7-99ef-b361b4bd93f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:25.293678 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b4aa1a-9919-4dc7-99ef-b361b4bd93f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:25.293964 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b4aa1a-9919-4dc7-99ef-b361b4bd93f7 admin admin] PATH_INFO: `/v3/projects/fc370a5ce59f452e820e56219828e487/users/f4d7f99285244624988c3d91b001dc3f/roles/8eff41f243c843ed95505a488ca6eada` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:25.342122 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b4aa1a-9919-4dc7-99ef-b361b4bd93f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc370a5ce59f452e820e56219828e487, user_id=f4d7f99285244624988c3d91b001dc3f, role_id=8eff41f243c843ed95505a488ca6eada)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:25.345461 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b4aa1a-9919-4dc7-99ef-b361b4bd93f7 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:25.372913 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:41:25.394907 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 873/1742] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jul 11 14:41:25 2022] PUT /identity/v3/projects/fc370a5ce59f452e820e56219828e487/users/f4d7f99285244624988c3d91b001dc3f/roles/8eff41f243c843ed95505a488ca6eada => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:41:25.394907 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19513e80-f03c-48cf-827f-b3e1ae26a691 None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:25.394907 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19513e80-f03c-48cf-827f-b3e1ae26a691 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:25.394907 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19513e80-f03c-48cf-827f-b3e1ae26a691 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:25.468540 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-19513e80-f03c-48cf-827f-b3e1ae26a691 None None] MFA Rules not processed for user `8d5ccf016a41426cb589005da57bbf6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:41:25.471150 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-19513e80-f03c-48cf-827f-b3e1ae26a691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:25.499135 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:41:25.559545 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 874/1743] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:41:25 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:41:25.561104 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6356af-37fb-4e77-9fdc-0fe03efeb289 None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:25.561408 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6356af-37fb-4e77-9fdc-0fe03efeb289 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:25.561908 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6356af-37fb-4e77-9fdc-0fe03efeb289 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:25.595708 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da63d3a2-596b-4709-a1a4-d0355fdb2ce1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:25.597218 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da63d3a2-596b-4709-a1a4-d0355fdb2ce1 service cinder] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:25.637857 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 870/1744] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:41:24 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 732 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:41:25.638834 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da63d3a2-596b-4709-a1a4-d0355fdb2ce1 service cinder] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:25.645449 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-da63d3a2-596b-4709-a1a4-d0355fdb2ce1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:25.649958 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-5d6356af-37fb-4e77-9fdc-0fe03efeb289 None None] MFA Rules not processed for user `f4d7f99285244624988c3d91b001dc3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:41:25.654946 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-5d6356af-37fb-4e77-9fdc-0fe03efeb289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:25.896426 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 875/1745] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:41:25 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 333 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:41:25.898171 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6356af-37fb-4e77-9fdc-0fe03efeb289 None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:26.026242 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da63d3a2-596b-4709-a1a4-d0355fdb2ce1 service cinder] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:26.125621 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6356af-37fb-4e77-9fdc-0fe03efeb289 None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:26.141467 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1217497d-2d7f-47f2-96b9-c6f407bca748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:26.142210 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1217497d-2d7f-47f2-96b9-c6f407bca748 admin admin] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:26.142449 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1217497d-2d7f-47f2-96b9-c6f407bca748 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:26.142746 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1217497d-2d7f-47f2-96b9-c6f407bca748 admin admin] PATH_INFO: `/v3/projects` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:26.147840 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1217497d-2d7f-47f2-96b9-c6f407bca748 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:26.154546 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1217497d-2d7f-47f2-96b9-c6f407bca748 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:26.271054 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 876/1746] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jul 11 14:41:25 2022] POST /identity/v3/projects => generated 379 bytes in 371 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:41:26.275245 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1217497d-2d7f-47f2-96b9-c6f407bca748 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:26.296671 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:41:26.346814 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b00a03-246f-4ed0-937e-c26d08510327 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4f8c0d696af4bd5a205ca8e9110b8cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:26.348326 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b00a03-246f-4ed0-937e-c26d08510327 service nova] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:26.348790 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b00a03-246f-4ed0-937e-c26d08510327 service nova] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:26.349220 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b00a03-246f-4ed0-937e-c26d08510327 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:26.376067 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b00a03-246f-4ed0-937e-c26d08510327 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:26.384478 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b00a03-246f-4ed0-937e-c26d08510327 service nova] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:26.464888 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 871/1747] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:41:25 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 826 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:41:26.596452 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1217497d-2d7f-47f2-96b9-c6f407bca748 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:26.631402 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159537f4-4281-45bb-b809-cdee0f0a1724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:26.634790 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159537f4-4281-45bb-b809-cdee0f0a1724 admin admin] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:26.639214 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159537f4-4281-45bb-b809-cdee0f0a1724 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:26.643818 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159537f4-4281-45bb-b809-cdee0f0a1724 admin admin] PATH_INFO: `/v3/users` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:26.644714 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159537f4-4281-45bb-b809-cdee0f0a1724 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:26.663572 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159537f4-4281-45bb-b809-cdee0f0a1724 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:26.745066 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 877/1748] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jul 11 14:41:26 2022] POST /identity/v3/users => generated 296 bytes in 470 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:41:26.749772 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b00a03-246f-4ed0-937e-c26d08510327 service nova] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:26.763261 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b00a03-246f-4ed0-937e-c26d08510327 service nova] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:26.772830 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad41917b-5889-4cb4-8af9-3aad1c2ec44c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:26.773595 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad41917b-5889-4cb4-8af9-3aad1c2ec44c admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:26.773882 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad41917b-5889-4cb4-8af9-3aad1c2ec44c admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:26.774263 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad41917b-5889-4cb4-8af9-3aad1c2ec44c admin admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:26.775160 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad41917b-5889-4cb4-8af9-3aad1c2ec44c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:26.777613 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad41917b-5889-4cb4-8af9-3aad1c2ec44c admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:26.853755 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 872/1749] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:41:26 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:41:26.854546 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159537f4-4281-45bb-b809-cdee0f0a1724 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:26.879313 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159537f4-4281-45bb-b809-cdee0f0a1724 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:26.907504 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c04cb03-3611-4c50-81a2-24e14f566f7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:26.912482 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c04cb03-3611-4c50-81a2-24e14f566f7c admin admin] REQUEST_METHOD: `PUT` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:26.915925 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c04cb03-3611-4c50-81a2-24e14f566f7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:26.921318 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c04cb03-3611-4c50-81a2-24e14f566f7c admin admin] PATH_INFO: `/v3/projects/dda5273c464e4e2ebb3d6b011ce9631b/users/77e81c3e22db4044b3cec9f536c06987/roles/b46df176b0fe479da63c318db225bed4` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:27.000502 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c04cb03-3611-4c50-81a2-24e14f566f7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=dda5273c464e4e2ebb3d6b011ce9631b, user_id=77e81c3e22db4044b3cec9f536c06987, role_id=b46df176b0fe479da63c318db225bed4)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:27.014476 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c04cb03-3611-4c50-81a2-24e14f566f7c admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:27.077265 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 878/1750] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jul 11 14:41:26 2022] PUT /identity/v3/projects/dda5273c464e4e2ebb3d6b011ce9631b/users/77e81c3e22db4044b3cec9f536c06987/roles/b46df176b0fe479da63c318db225bed4 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:41:27.079405 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad41917b-5889-4cb4-8af9-3aad1c2ec44c admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:27.099882 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad41917b-5889-4cb4-8af9-3aad1c2ec44c admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:27.364428 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:41:27.399076 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b6568f-669e-4062-b9ad-52ade81bba95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:27.403892 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b6568f-669e-4062-b9ad-52ade81bba95 admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:27.404402 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b6568f-669e-4062-b9ad-52ade81bba95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:27.404726 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b6568f-669e-4062-b9ad-52ade81bba95 admin admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:27.406259 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b6568f-669e-4062-b9ad-52ade81bba95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:27.407919 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b6568f-669e-4062-b9ad-52ade81bba95 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:27.434898 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a96b4b3-b8da-487c-a69c-1364bb51b011 None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:27.435545 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a96b4b3-b8da-487c-a69c-1364bb51b011 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:27.441324 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a96b4b3-b8da-487c-a69c-1364bb51b011 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:27.468080 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 873/1751] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:41:27 2022] GET /identity/v3/roles => generated 1420 bytes in 389 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:41:27.469209 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b6568f-669e-4062-b9ad-52ade81bba95 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:27.522666 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b6568f-669e-4062-b9ad-52ade81bba95 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:27.537802 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124a4841-1913-422d-894e-78739c640e8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:27.538752 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124a4841-1913-422d-894e-78739c640e8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:27.539117 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124a4841-1913-422d-894e-78739c640e8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:27.539395 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124a4841-1913-422d-894e-78739c640e8c admin admin] PATH_INFO: `/v3/users/cdf12f92311246d5b615682d452780b7` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:27.553784 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-2a96b4b3-b8da-487c-a69c-1364bb51b011 None None] MFA Rules not processed for user `20eede5ccd834862b00123310b5c3975`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:41:27.566822 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124a4841-1913-422d-894e-78739c640e8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=cdf12f92311246d5b615682d452780b7)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:27.572782 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-2a96b4b3-b8da-487c-a69c-1364bb51b011 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:27.575961 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124a4841-1913-422d-894e-78739c640e8c admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:27.730501 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-124a4841-1913-422d-894e-78739c640e8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cdf12f92311246d5b615682d452780b7'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:27.757455 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-124a4841-1913-422d-894e-78739c640e8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cdf12f92311246d5b615682d452780b7'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:27.782795 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-124a4841-1913-422d-894e-78739c640e8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cdf12f92311246d5b615682d452780b7'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:27.784702 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-124a4841-1913-422d-894e-78739c640e8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cdf12f92311246d5b615682d452780b7'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:27.786798 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-124a4841-1913-422d-894e-78739c640e8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cdf12f92311246d5b615682d452780b7'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:27.833796 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 879/1752] 10.222.0.62 () {58 vars in 1015 bytes} [Mon Jul 11 14:41:27 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 402 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:41:27.835465 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a96b4b3-b8da-487c-a69c-1364bb51b011 None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:27.838587 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-2a96b4b3-b8da-487c-a69c-1364bb51b011 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:27.876407 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 874/1753] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jul 11 14:41:27 2022] DELETE /identity/v3/users/cdf12f92311246d5b615682d452780b7 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:41:27.878382 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a96b4b3-b8da-487c-a69c-1364bb51b011 None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:27.879273 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f2a0bf-fb36-453a-9981-2251fa01f986 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:27.879574 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f2a0bf-fb36-453a-9981-2251fa01f986 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:27.879862 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f2a0bf-fb36-453a-9981-2251fa01f986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:27.963778 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-19f2a0bf-fb36-453a-9981-2251fa01f986 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:41:27.968491 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-19f2a0bf-fb36-453a-9981-2251fa01f986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:28.066451 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392cb825-5339-474d-ac1c-9d4af64231f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:28.067380 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392cb825-5339-474d-ac1c-9d4af64231f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:28.067668 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392cb825-5339-474d-ac1c-9d4af64231f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:28.069922 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392cb825-5339-474d-ac1c-9d4af64231f3 admin admin] PATH_INFO: `/v3/projects/dda5273c464e4e2ebb3d6b011ce9631b/users/77e81c3e22db4044b3cec9f536c06987/roles/b46df176b0fe479da63c318db225bed4` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:28.073145 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392cb825-5339-474d-ac1c-9d4af64231f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dda5273c464e4e2ebb3d6b011ce9631b, user_id=77e81c3e22db4044b3cec9f536c06987, role_id=b46df176b0fe479da63c318db225bed4)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:28.090387 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392cb825-5339-474d-ac1c-9d4af64231f3 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:28.130624 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 880/1754] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jul 11 14:41:27 2022] PUT /identity/v3/projects/dda5273c464e4e2ebb3d6b011ce9631b/users/77e81c3e22db4044b3cec9f536c06987/roles/b46df176b0fe479da63c318db225bed4 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:41:28.132387 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392cb825-5339-474d-ac1c-9d4af64231f3 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:28.134407 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-392cb825-5339-474d-ac1c-9d4af64231f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:28.208329 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:41:28.212432 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 875/1755] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:41:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 333 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:41:28.218775 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda88e08-0f4b-4bba-87f9-645f3dbef29a None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:28.218966 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda88e08-0f4b-4bba-87f9-645f3dbef29a None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:28.221069 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda88e08-0f4b-4bba-87f9-645f3dbef29a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:28.383202 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-dda88e08-0f4b-4bba-87f9-645f3dbef29a None None] MFA Rules not processed for user `77e81c3e22db4044b3cec9f536c06987`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:41:28.386225 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-dda88e08-0f4b-4bba-87f9-645f3dbef29a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:28.511272 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392cb825-5339-474d-ac1c-9d4af64231f3 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:28.529711 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55a35b6-53c8-444c-b20f-323a3a8cf261 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20eede5ccd834862b00123310b5c3975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:28.543992 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:41:28.551753 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55a35b6-53c8-444c-b20f-323a3a8cf261 service neutron] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:28.554671 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55a35b6-53c8-444c-b20f-323a3a8cf261 service neutron] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:28.556461 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55a35b6-53c8-444c-b20f-323a3a8cf261 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:28.585855 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55a35b6-53c8-444c-b20f-323a3a8cf261 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:28.592709 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55a35b6-53c8-444c-b20f-323a3a8cf261 service neutron] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:28.615810 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 881/1756] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:41:28 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 485 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:41:28.616810 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 876/1757] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:41:28 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 404 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:41:28.617047 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55a35b6-53c8-444c-b20f-323a3a8cf261 service neutron] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:28.618821 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-e55a35b6-53c8-444c-b20f-323a3a8cf261 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:28.621178 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc70e1f-fbbb-4b44-a31b-25dacec5e861 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:28.622549 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc70e1f-fbbb-4b44-a31b-25dacec5e861 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:28.623082 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc70e1f-fbbb-4b44-a31b-25dacec5e861 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:28.651173 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55a35b6-53c8-444c-b20f-323a3a8cf261 service neutron] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:28.657527 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b061ac7-e442-48f8-803a-902064c0223d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20eede5ccd834862b00123310b5c3975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:28.658498 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b061ac7-e442-48f8-803a-902064c0223d service neutron] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:28.659109 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b061ac7-e442-48f8-803a-902064c0223d service neutron] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:28.659655 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b061ac7-e442-48f8-803a-902064c0223d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:28.719377 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-fdc70e1f-fbbb-4b44-a31b-25dacec5e861 None None] MFA Rules not processed for user `61a806b41a1442188b56d371cbf713d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:41:28.720970 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-fdc70e1f-fbbb-4b44-a31b-25dacec5e861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:28.934803 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b061ac7-e442-48f8-803a-902064c0223d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:28.941185 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b061ac7-e442-48f8-803a-902064c0223d service neutron] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:29.006066 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 882/1758] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:41:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:41:29.007090 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b061ac7-e442-48f8-803a-902064c0223d service neutron] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:29.030072 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 877/1759] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:41:28 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 411 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:41:29.030834 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc70e1f-fbbb-4b44-a31b-25dacec5e861 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:29.043471 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-fdc70e1f-fbbb-4b44-a31b-25dacec5e861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:29.049170 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b061ac7-e442-48f8-803a-902064c0223d service neutron] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:29.081066 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fc478a-1a3b-4262-86ce-58d8b848bdd6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20eede5ccd834862b00123310b5c3975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:29.088969 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fc478a-1a3b-4262-86ce-58d8b848bdd6 service neutron] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:29.089361 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fc478a-1a3b-4262-86ce-58d8b848bdd6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:29.089766 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fc478a-1a3b-4262-86ce-58d8b848bdd6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:29.124948 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fc478a-1a3b-4262-86ce-58d8b848bdd6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:29.124948 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fc478a-1a3b-4262-86ce-58d8b848bdd6 service neutron] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:29.164905 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 883/1760] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:41:29 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:41:29.167021 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4f2eb5-e036-4a23-b189-f6a366123ecc None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:29.167423 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4f2eb5-e036-4a23-b189-f6a366123ecc None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:29.167857 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4f2eb5-e036-4a23-b189-f6a366123ecc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:29.207799 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-2e4f2eb5-e036-4a23-b189-f6a366123ecc None None] MFA Rules not processed for user `61a806b41a1442188b56d371cbf713d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:41:29.209959 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-2e4f2eb5-e036-4a23-b189-f6a366123ecc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:29.226209 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc70e1f-fbbb-4b44-a31b-25dacec5e861 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:29.235766 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 884/1761] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:41:29 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:41:29.242322 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1da6089-0a16-437a-b7c9-3ba15d1bbbef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '868e7c2dec264512b972c8736d659c34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:29.243283 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1da6089-0a16-437a-b7c9-3ba15d1bbbef service cinder] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:29.243863 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1da6089-0a16-437a-b7c9-3ba15d1bbbef service cinder] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:29.245032 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1da6089-0a16-437a-b7c9-3ba15d1bbbef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:29.249092 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4f2eb5-e036-4a23-b189-f6a366123ecc None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:29.251190 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-2e4f2eb5-e036-4a23-b189-f6a366123ecc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:29.252498 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-f1da6089-0a16-437a-b7c9-3ba15d1bbbef service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:29.500781 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1da6089-0a16-437a-b7c9-3ba15d1bbbef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:29.507975 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1da6089-0a16-437a-b7c9-3ba15d1bbbef service cinder] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:29.560546 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4f2eb5-e036-4a23-b189-f6a366123ecc None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:29.561157 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 878/1762] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:41:29 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 524 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:41:29.587888 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9966f759-8296-4ae2-bcc9-6339828236e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4f8c0d696af4bd5a205ca8e9110b8cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:29.588953 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9966f759-8296-4ae2-bcc9-6339828236e9 service nova] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:29.589242 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9966f759-8296-4ae2-bcc9-6339828236e9 service nova] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:29.589555 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9966f759-8296-4ae2-bcc9-6339828236e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:29.627113 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9966f759-8296-4ae2-bcc9-6339828236e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:29.628805 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9966f759-8296-4ae2-bcc9-6339828236e9 service nova] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:29.668767 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 885/1763] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:41:29 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:41:31.691567 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1da6089-0a16-437a-b7c9-3ba15d1bbbef service cinder] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:31.693576 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-f1da6089-0a16-437a-b7c9-3ba15d1bbbef service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:31.712190 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1da6089-0a16-437a-b7c9-3ba15d1bbbef service cinder] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:31.727565 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4128930b-4050-4414-ba3e-d9cc085ee933 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '868e7c2dec264512b972c8736d659c34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:31.729121 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4128930b-4050-4414-ba3e-d9cc085ee933 service cinder] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:31.730865 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4128930b-4050-4414-ba3e-d9cc085ee933 service cinder] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:31.731959 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4128930b-4050-4414-ba3e-d9cc085ee933 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:31.757241 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4128930b-4050-4414-ba3e-d9cc085ee933 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:31.763406 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4128930b-4050-4414-ba3e-d9cc085ee933 service cinder] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:31.798824 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 879/1764] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:41:31 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:41:33.589896 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92b50c6-4b53-42df-bbc6-2ed0a11e5987 None None] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:33.590437 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92b50c6-4b53-42df-bbc6-2ed0a11e5987 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:33.590712 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92b50c6-4b53-42df-bbc6-2ed0a11e5987 None None] PATH_INFO: `/` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:33.592917 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 886/1765] 10.222.0.70 () {54 vars in 912 bytes} [Mon Jul 11 14:41:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:41:33.617001 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104d67ea-06b5-433b-a1bb-4f4bd8c96391 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:33.618488 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104d67ea-06b5-433b-a1bb-4f4bd8c96391 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:33.619058 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104d67ea-06b5-433b-a1bb-4f4bd8c96391 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:33.676958 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-104d67ea-06b5-433b-a1bb-4f4bd8c96391 None None] MFA Rules not processed for user `20eede5ccd834862b00123310b5c3975`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:41:33.682873 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-104d67ea-06b5-433b-a1bb-4f4bd8c96391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:33.733394 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 880/1766] 10.222.0.70 () {58 vars in 1009 bytes} [Mon Jul 11 14:41:33 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:41:33.881901 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6831c3d-b48b-4f25-850b-71e83914b464 None None] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:33.882437 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6831c3d-b48b-4f25-850b-71e83914b464 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:33.882909 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6831c3d-b48b-4f25-850b-71e83914b464 None None] PATH_INFO: `/` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:33.886097 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 887/1767] 10.222.0.70 () {54 vars in 921 bytes} [Mon Jul 11 14:41:33 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:41:34.086247 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a6a0c2-dd09-4367-a0fa-aa17c471ea16 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:34.086796 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a6a0c2-dd09-4367-a0fa-aa17c471ea16 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:34.087300 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a6a0c2-dd09-4367-a0fa-aa17c471ea16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:34.127991 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-57a6a0c2-dd09-4367-a0fa-aa17c471ea16 None None] MFA Rules not processed for user `f4f8c0d696af4bd5a205ca8e9110b8cc`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:41:34.130384 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-57a6a0c2-dd09-4367-a0fa-aa17c471ea16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:34.159455 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 881/1768] 10.222.0.70 () {58 vars in 1018 bytes} [Mon Jul 11 14:41:34 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:41:34.325770 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6831c3d-b48b-4f25-850b-71e83914b464 None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:34.360553 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6831c3d-b48b-4f25-850b-71e83914b464 None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:34.376912 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3760e202-c094-4dae-a23f-24be10998f74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20eede5ccd834862b00123310b5c3975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:34.377589 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3760e202-c094-4dae-a23f-24be10998f74 service neutron] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:34.377874 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3760e202-c094-4dae-a23f-24be10998f74 service neutron] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:34.378154 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3760e202-c094-4dae-a23f-24be10998f74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:34.426577 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3760e202-c094-4dae-a23f-24be10998f74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:34.429767 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3760e202-c094-4dae-a23f-24be10998f74 service neutron] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:34.450958 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:41:34.477912 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 888/1769] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:41:34 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:41:34.822825 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a6a0c2-dd09-4367-a0fa-aa17c471ea16 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:34.824281 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-57a6a0c2-dd09-4367-a0fa-aa17c471ea16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:34.865223 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a6a0c2-dd09-4367-a0fa-aa17c471ea16 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:34.909460 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91739bbf-06a6-4347-ad90-17b714b0ceb3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4f8c0d696af4bd5a205ca8e9110b8cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:34.909460 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91739bbf-06a6-4347-ad90-17b714b0ceb3 service nova] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:34.909460 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91739bbf-06a6-4347-ad90-17b714b0ceb3 service nova] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:34.909460 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91739bbf-06a6-4347-ad90-17b714b0ceb3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:34.941695 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:41:34.952016 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91739bbf-06a6-4347-ad90-17b714b0ceb3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:34.958095 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91739bbf-06a6-4347-ad90-17b714b0ceb3 service nova] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:34.999595 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 882/1770] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:41:34 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:41:35.528488 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3760e202-c094-4dae-a23f-24be10998f74 service neutron] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:35.529979 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-3760e202-c094-4dae-a23f-24be10998f74 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:35.560716 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3760e202-c094-4dae-a23f-24be10998f74 service neutron] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:35.581567 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7823b8-2a86-4bc3-b01a-653d5951562d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:35.582056 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7823b8-2a86-4bc3-b01a-653d5951562d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:35.582536 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7823b8-2a86-4bc3-b01a-653d5951562d admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:35.582816 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7823b8-2a86-4bc3-b01a-653d5951562d admin admin] PATH_INFO: `/v3/projects/c5e2b2947d414879a5610f2b533b8fc0` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:35.585725 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7823b8-2a86-4bc3-b01a-653d5951562d admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5e2b2947d414879a5610f2b533b8fc0)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:35.592529 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7823b8-2a86-4bc3-b01a-653d5951562d admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:35.784438 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-bb7823b8-2a86-4bc3-b01a-653d5951562d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5e2b2947d414879a5610f2b533b8fc0', 'request_id': 'req-bb7823b8-2a86-4bc3-b01a-653d5951562d'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:35.825175 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-bb7823b8-2a86-4bc3-b01a-653d5951562d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5e2b2947d414879a5610f2b533b8fc0', 'request_id': 'req-bb7823b8-2a86-4bc3-b01a-653d5951562d'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:35.846598 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-bb7823b8-2a86-4bc3-b01a-653d5951562d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5e2b2947d414879a5610f2b533b8fc0', 'request_id': 'req-bb7823b8-2a86-4bc3-b01a-653d5951562d'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:35.878729 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-bb7823b8-2a86-4bc3-b01a-653d5951562d admin admin] The token cache is being invalidate because project c5e2b2947d414879a5610f2b533b8fc0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80534) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:41:35.879057 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-bb7823b8-2a86-4bc3-b01a-653d5951562d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:35.880801 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-bb7823b8-2a86-4bc3-b01a-653d5951562d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:35.894454 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 889/1771] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jul 11 14:41:35 2022] DELETE /identity/v3/projects/c5e2b2947d414879a5610f2b533b8fc0 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:41:35.895642 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91739bbf-06a6-4347-ad90-17b714b0ceb3 service nova] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:35.919851 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91739bbf-06a6-4347-ad90-17b714b0ceb3 service nova] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:36.103982 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9a21f4-eda3-4338-885a-079fbd640efe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:36.105258 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9a21f4-eda3-4338-885a-079fbd640efe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:36.105920 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9a21f4-eda3-4338-885a-079fbd640efe admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:36.106409 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9a21f4-eda3-4338-885a-079fbd640efe admin admin] PATH_INFO: `/v3/users/fa3f0361f96c4ba5967327cdfcd9bd0e` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:36.111979 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9a21f4-eda3-4338-885a-079fbd640efe admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa3f0361f96c4ba5967327cdfcd9bd0e)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:36.120914 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9a21f4-eda3-4338-885a-079fbd640efe admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:36.127779 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e742cb24-d3d4-4c0f-83df-5172124e02ef None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:36.128352 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e742cb24-d3d4-4c0f-83df-5172124e02ef None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:36.128783 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e742cb24-d3d4-4c0f-83df-5172124e02ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:36.169861 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-e742cb24-d3d4-4c0f-83df-5172124e02ef None None] MFA Rules not processed for user `8d5ccf016a41426cb589005da57bbf6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:41:36.171976 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-e742cb24-d3d4-4c0f-83df-5172124e02ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:36.246385 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-fd9a21f4-eda3-4338-885a-079fbd640efe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa3f0361f96c4ba5967327cdfcd9bd0e'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:36.270815 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-fd9a21f4-eda3-4338-885a-079fbd640efe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa3f0361f96c4ba5967327cdfcd9bd0e'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:36.284837 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-fd9a21f4-eda3-4338-885a-079fbd640efe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa3f0361f96c4ba5967327cdfcd9bd0e'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:36.286201 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-fd9a21f4-eda3-4338-885a-079fbd640efe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa3f0361f96c4ba5967327cdfcd9bd0e'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:36.287358 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-fd9a21f4-eda3-4338-885a-079fbd640efe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa3f0361f96c4ba5967327cdfcd9bd0e'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:36.335707 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 890/1772] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:41:36 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:41:36.337493 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e742cb24-d3d4-4c0f-83df-5172124e02ef None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:36.340814 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-e742cb24-d3d4-4c0f-83df-5172124e02ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:36.341328 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 883/1773] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jul 11 14:41:35 2022] DELETE /identity/v3/users/fa3f0361f96c4ba5967327cdfcd9bd0e => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:41:36.367673 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e742cb24-d3d4-4c0f-83df-5172124e02ef None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:36.461676 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95543f0e-e6aa-4ba5-80c7-ac76574e48f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:36.462991 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95543f0e-e6aa-4ba5-80c7-ac76574e48f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:36.463274 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95543f0e-e6aa-4ba5-80c7-ac76574e48f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:36.463623 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95543f0e-e6aa-4ba5-80c7-ac76574e48f9 admin admin] PATH_INFO: `/v3/users/f4d7f99285244624988c3d91b001dc3f` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:36.465069 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95543f0e-e6aa-4ba5-80c7-ac76574e48f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4d7f99285244624988c3d91b001dc3f)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:36.467208 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95543f0e-e6aa-4ba5-80c7-ac76574e48f9 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:36.527661 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:41:36.605387 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-95543f0e-e6aa-4ba5-80c7-ac76574e48f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4d7f99285244624988c3d91b001dc3f'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:36.629883 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-95543f0e-e6aa-4ba5-80c7-ac76574e48f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4d7f99285244624988c3d91b001dc3f'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:36.656369 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-95543f0e-e6aa-4ba5-80c7-ac76574e48f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4d7f99285244624988c3d91b001dc3f'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:36.660509 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-95543f0e-e6aa-4ba5-80c7-ac76574e48f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4d7f99285244624988c3d91b001dc3f'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:36.663462 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-95543f0e-e6aa-4ba5-80c7-ac76574e48f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4d7f99285244624988c3d91b001dc3f'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:36.729417 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 891/1774] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jul 11 14:41:36 2022] DELETE /identity/v3/users/f4d7f99285244624988c3d91b001dc3f => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:41:36.736439 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265aff08-0799-431d-8032-0c8ab466de2c None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:36.737025 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265aff08-0799-431d-8032-0c8ab466de2c None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:36.737715 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265aff08-0799-431d-8032-0c8ab466de2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:36.793684 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-265aff08-0799-431d-8032-0c8ab466de2c None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:41:36.794949 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-265aff08-0799-431d-8032-0c8ab466de2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:36.912489 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 884/1775] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:41:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:41:36.927289 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95543f0e-e6aa-4ba5-80c7-ac76574e48f9 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:36.929380 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-95543f0e-e6aa-4ba5-80c7-ac76574e48f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:37.061606 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95543f0e-e6aa-4ba5-80c7-ac76574e48f9 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:37.073419 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa6b22f-4e7c-4e10-ac4b-19cf2882dc37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20eede5ccd834862b00123310b5c3975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:37.074791 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa6b22f-4e7c-4e10-ac4b-19cf2882dc37 service neutron] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:37.075019 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa6b22f-4e7c-4e10-ac4b-19cf2882dc37 service neutron] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:37.075305 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa6b22f-4e7c-4e10-ac4b-19cf2882dc37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:37.078731 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055e3014-8030-4ff5-bcc5-18aa64e5c6de None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:37.079165 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055e3014-8030-4ff5-bcc5-18aa64e5c6de None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:37.079812 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055e3014-8030-4ff5-bcc5-18aa64e5c6de None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:37.083216 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 885/1776] 10.222.0.70 () {54 vars in 921 bytes} [Mon Jul 11 14:41:37 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:41:37.102010 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa6b22f-4e7c-4e10-ac4b-19cf2882dc37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:37.103964 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa6b22f-4e7c-4e10-ac4b-19cf2882dc37 service neutron] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:37.141670 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7312c0c-3d96-48e8-991d-60083ce5cbf8 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:37.142274 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7312c0c-3d96-48e8-991d-60083ce5cbf8 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:37.142836 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7312c0c-3d96-48e8-991d-60083ce5cbf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:37.173677 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 892/1777] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:41:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:41:37.182039 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa6b22f-4e7c-4e10-ac4b-19cf2882dc37 service neutron] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:37.185815 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-2aa6b22f-4e7c-4e10-ac4b-19cf2882dc37 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:37.189388 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-c7312c0c-3d96-48e8-991d-60083ce5cbf8 None None] MFA Rules not processed for user `f4f8c0d696af4bd5a205ca8e9110b8cc`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:41:37.199325 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-c7312c0c-3d96-48e8-991d-60083ce5cbf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:37.231778 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa6b22f-4e7c-4e10-ac4b-19cf2882dc37 service neutron] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:37.253624 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:41:37.272595 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b56615-5c6f-429b-85d3-ad8231ad7d52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:37.274446 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b56615-5c6f-429b-85d3-ad8231ad7d52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:37.281211 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b56615-5c6f-429b-85d3-ad8231ad7d52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:37.300428 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b56615-5c6f-429b-85d3-ad8231ad7d52 admin admin] PATH_INFO: `/v3/projects/13038f14e19d4eb7b8c5aa85cab08b86` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:37.306113 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b56615-5c6f-429b-85d3-ad8231ad7d52 admin admin] RBAC: Authorizing `identity:delete_project(project_id=13038f14e19d4eb7b8c5aa85cab08b86)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:37.331074 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b56615-5c6f-429b-85d3-ad8231ad7d52 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:37.517306 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-33b56615-5c6f-429b-85d3-ad8231ad7d52 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13038f14e19d4eb7b8c5aa85cab08b86', 'request_id': 'req-33b56615-5c6f-429b-85d3-ad8231ad7d52'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:37.526350 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 886/1778] 10.222.0.70 () {58 vars in 1018 bytes} [Mon Jul 11 14:41:37 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 397 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:41:37.526553 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-33b56615-5c6f-429b-85d3-ad8231ad7d52 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13038f14e19d4eb7b8c5aa85cab08b86', 'request_id': 'req-33b56615-5c6f-429b-85d3-ad8231ad7d52'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:37.542981 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-33b56615-5c6f-429b-85d3-ad8231ad7d52 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13038f14e19d4eb7b8c5aa85cab08b86', 'request_id': 'req-33b56615-5c6f-429b-85d3-ad8231ad7d52'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:37.613755 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-33b56615-5c6f-429b-85d3-ad8231ad7d52 admin admin] The token cache is being invalidate because project 13038f14e19d4eb7b8c5aa85cab08b86 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80534) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:41:37.614417 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-33b56615-5c6f-429b-85d3-ad8231ad7d52 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:37.617250 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-33b56615-5c6f-429b-85d3-ad8231ad7d52 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:37.628893 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 893/1779] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jul 11 14:41:37 2022] DELETE /identity/v3/projects/13038f14e19d4eb7b8c5aa85cab08b86 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:41:37.634574 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73ddc80-6e79-423f-88b5-899e7cfa295d None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:37.635045 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73ddc80-6e79-423f-88b5-899e7cfa295d None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:37.635565 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73ddc80-6e79-423f-88b5-899e7cfa295d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:37.676525 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-d73ddc80-6e79-423f-88b5-899e7cfa295d None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:41:37.690653 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-d73ddc80-6e79-423f-88b5-899e7cfa295d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:37.862731 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 887/1780] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:41:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:41:37.874473 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a7d801-7ba8-42c0-935a-c470a5f7ab48 None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:37.874765 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a7d801-7ba8-42c0-935a-c470a5f7ab48 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:37.875048 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a7d801-7ba8-42c0-935a-c470a5f7ab48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:37.921788 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-f6a7d801-7ba8-42c0-935a-c470a5f7ab48 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:41:37.923534 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-f6a7d801-7ba8-42c0-935a-c470a5f7ab48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:37.975508 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73ddc80-6e79-423f-88b5-899e7cfa295d None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:37.980685 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 894/1781] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:41:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:41:37.994942 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73ddc80-6e79-423f-88b5-899e7cfa295d None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:38.037195 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e37be12-3b6e-4f47-9eef-abdf8521ba41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:38.041206 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e37be12-3b6e-4f47-9eef-abdf8521ba41 admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:38.041817 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e37be12-3b6e-4f47-9eef-abdf8521ba41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:38.042407 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e37be12-3b6e-4f47-9eef-abdf8521ba41 admin admin] PATH_INFO: `/v3/domains` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:38.046212 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e37be12-3b6e-4f47-9eef-abdf8521ba41 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:41:38.046882 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e37be12-3b6e-4f47-9eef-abdf8521ba41 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:38.053242 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e37be12-3b6e-4f47-9eef-abdf8521ba41 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:38.058968 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a7d801-7ba8-42c0-935a-c470a5f7ab48 None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:38.064328 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-f6a7d801-7ba8-42c0-935a-c470a5f7ab48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:38.122408 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 888/1782] 10.222.0.70 () {58 vars in 1152 bytes} [Mon Jul 11 14:41:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:41:38.138819 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e37be12-3b6e-4f47-9eef-abdf8521ba41 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:38.139449 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a7d801-7ba8-42c0-935a-c470a5f7ab48 None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:38.175281 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e37be12-3b6e-4f47-9eef-abdf8521ba41 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:38.180478 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122be9ce-b108-4376-9fa1-b4665a999a7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:38.182011 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122be9ce-b108-4376-9fa1-b4665a999a7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:38.183000 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122be9ce-b108-4376-9fa1-b4665a999a7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:38.183286 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122be9ce-b108-4376-9fa1-b4665a999a7a admin admin] PATH_INFO: `/v3/projects/fc370a5ce59f452e820e56219828e487` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:38.184591 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e53347-278a-4092-b3d0-cb9187464508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:38.185654 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e53347-278a-4092-b3d0-cb9187464508 admin admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:38.186093 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e53347-278a-4092-b3d0-cb9187464508 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:38.186522 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e53347-278a-4092-b3d0-cb9187464508 admin admin] PATH_INFO: `/v3/projects` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:38.187890 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e53347-278a-4092-b3d0-cb9187464508 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:38.190210 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122be9ce-b108-4376-9fa1-b4665a999a7a admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc370a5ce59f452e820e56219828e487)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:38.190665 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e53347-278a-4092-b3d0-cb9187464508 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:38.192431 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122be9ce-b108-4376-9fa1-b4665a999a7a admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:38.271640 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:41:38.342617 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 889/1783] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jul 11 14:41:38 2022] POST /identity/v3/projects => generated 387 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:41:38.349898 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e53347-278a-4092-b3d0-cb9187464508 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:38.397988 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-122be9ce-b108-4376-9fa1-b4665a999a7a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc370a5ce59f452e820e56219828e487', 'request_id': 'req-122be9ce-b108-4376-9fa1-b4665a999a7a'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:38.417696 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-122be9ce-b108-4376-9fa1-b4665a999a7a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc370a5ce59f452e820e56219828e487', 'request_id': 'req-122be9ce-b108-4376-9fa1-b4665a999a7a'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:38.438806 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-122be9ce-b108-4376-9fa1-b4665a999a7a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc370a5ce59f452e820e56219828e487', 'request_id': 'req-122be9ce-b108-4376-9fa1-b4665a999a7a'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:38.484332 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-122be9ce-b108-4376-9fa1-b4665a999a7a admin admin] The token cache is being invalidate because project fc370a5ce59f452e820e56219828e487 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80534) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:41:38.484635 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-122be9ce-b108-4376-9fa1-b4665a999a7a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:38.489937 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-122be9ce-b108-4376-9fa1-b4665a999a7a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:38.493255 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 895/1784] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jul 11 14:41:38 2022] DELETE /identity/v3/projects/fc370a5ce59f452e820e56219828e487 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:41:38.494652 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122be9ce-b108-4376-9fa1-b4665a999a7a admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:38.503133 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-122be9ce-b108-4376-9fa1-b4665a999a7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:38.707813 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e53347-278a-4092-b3d0-cb9187464508 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:38.766913 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:41:38.821599 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122be9ce-b108-4376-9fa1-b4665a999a7a admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:38.856648 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf71fcd-1f61-4018-aaba-1a26e140bbf9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4f8c0d696af4bd5a205ca8e9110b8cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:38.857346 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf71fcd-1f61-4018-aaba-1a26e140bbf9 service nova] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:38.857632 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf71fcd-1f61-4018-aaba-1a26e140bbf9 service nova] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:38.857911 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf71fcd-1f61-4018-aaba-1a26e140bbf9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:38.859914 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-acf71fcd-1f61-4018-aaba-1a26e140bbf9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:38.894484 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde5409a-db66-4cf9-9fea-290753ad855d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:38.895508 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde5409a-db66-4cf9-9fea-290753ad855d admin admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:38.895804 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde5409a-db66-4cf9-9fea-290753ad855d admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:38.896087 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde5409a-db66-4cf9-9fea-290753ad855d admin admin] PATH_INFO: `/v3/users` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:38.896912 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde5409a-db66-4cf9-9fea-290753ad855d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:38.898966 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde5409a-db66-4cf9-9fea-290753ad855d admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:38.917807 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf71fcd-1f61-4018-aaba-1a26e140bbf9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:38.919887 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf71fcd-1f61-4018-aaba-1a26e140bbf9 service nova] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:38.945712 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 896/1785] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:41:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:41:38.947725 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf71fcd-1f61-4018-aaba-1a26e140bbf9 service nova] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:38.949744 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-acf71fcd-1f61-4018-aaba-1a26e140bbf9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:38.955632 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 890/1786] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jul 11 14:41:38 2022] POST /identity/v3/users => generated 294 bytes in 605 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:41:38.957207 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde5409a-db66-4cf9-9fea-290753ad855d admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:38.966131 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-fde5409a-db66-4cf9-9fea-290753ad855d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:38.988937 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf71fcd-1f61-4018-aaba-1a26e140bbf9 service nova] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:39.015713 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2ff9e6-c928-4e57-8f58-9c017bc08fbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:39.016866 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2ff9e6-c928-4e57-8f58-9c017bc08fbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:39.018486 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde5409a-db66-4cf9-9fea-290753ad855d admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:39.019405 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2ff9e6-c928-4e57-8f58-9c017bc08fbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:39.020492 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2ff9e6-c928-4e57-8f58-9c017bc08fbf admin admin] PATH_INFO: `/v3/users/77e81c3e22db4044b3cec9f536c06987` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:39.024556 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2ff9e6-c928-4e57-8f58-9c017bc08fbf admin admin] RBAC: Authorizing `identity:delete_user(user_id=77e81c3e22db4044b3cec9f536c06987)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:39.035204 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff0310c-79a5-470d-b5f7-6cff582efb96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:39.036346 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff0310c-79a5-470d-b5f7-6cff582efb96 admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:39.036848 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff0310c-79a5-470d-b5f7-6cff582efb96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:39.037281 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff0310c-79a5-470d-b5f7-6cff582efb96 admin admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:39.038525 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff0310c-79a5-470d-b5f7-6cff582efb96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:39.041668 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2ff9e6-c928-4e57-8f58-9c017bc08fbf admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:39.047569 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff0310c-79a5-470d-b5f7-6cff582efb96 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:39.085774 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 891/1787] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:41:38 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:41:39.092820 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff0310c-79a5-470d-b5f7-6cff582efb96 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:39.124732 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff0310c-79a5-470d-b5f7-6cff582efb96 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:39.131066 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f550b9-ea10-4a0e-9f69-a3e97f72948a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:39.132108 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f550b9-ea10-4a0e-9f69-a3e97f72948a admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:39.132616 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f550b9-ea10-4a0e-9f69-a3e97f72948a admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:39.133469 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f550b9-ea10-4a0e-9f69-a3e97f72948a admin admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:39.134554 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f550b9-ea10-4a0e-9f69-a3e97f72948a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:39.136986 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f550b9-ea10-4a0e-9f69-a3e97f72948a admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:39.160014 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 892/1788] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:41:39 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:41:39.170560 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f550b9-ea10-4a0e-9f69-a3e97f72948a admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:39.208074 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-ad2ff9e6-c928-4e57-8f58-9c017bc08fbf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77e81c3e22db4044b3cec9f536c06987'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:39.224934 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f550b9-ea10-4a0e-9f69-a3e97f72948a admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:39.233237 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-ad2ff9e6-c928-4e57-8f58-9c017bc08fbf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77e81c3e22db4044b3cec9f536c06987'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:39.252274 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f56c89-0aac-4695-9c70-b6215a76daf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:39.259446 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f56c89-0aac-4695-9c70-b6215a76daf0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:39.261636 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-ad2ff9e6-c928-4e57-8f58-9c017bc08fbf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77e81c3e22db4044b3cec9f536c06987'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:39.262873 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-ad2ff9e6-c928-4e57-8f58-9c017bc08fbf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77e81c3e22db4044b3cec9f536c06987'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:39.263969 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-ad2ff9e6-c928-4e57-8f58-9c017bc08fbf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77e81c3e22db4044b3cec9f536c06987'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:39.265926 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f56c89-0aac-4695-9c70-b6215a76daf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:39.267858 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f56c89-0aac-4695-9c70-b6215a76daf0 admin admin] PATH_INFO: `/v3/projects/586d2ff891d243878c48838a22997773/users/088cd90c445e42c583d5ec66170f6764/roles/8eff41f243c843ed95505a488ca6eada` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:39.334791 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f56c89-0aac-4695-9c70-b6215a76daf0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=586d2ff891d243878c48838a22997773, user_id=088cd90c445e42c583d5ec66170f6764, role_id=8eff41f243c843ed95505a488ca6eada)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:39.338296 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f56c89-0aac-4695-9c70-b6215a76daf0 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:39.344171 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 897/1789] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jul 11 14:41:38 2022] DELETE /identity/v3/users/77e81c3e22db4044b3cec9f536c06987 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:41:39.345196 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2ff9e6-c928-4e57-8f58-9c017bc08fbf admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:39.347410 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-ad2ff9e6-c928-4e57-8f58-9c017bc08fbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:39.379607 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 893/1790] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jul 11 14:41:39 2022] PUT /identity/v3/projects/586d2ff891d243878c48838a22997773/users/088cd90c445e42c583d5ec66170f6764/roles/8eff41f243c843ed95505a488ca6eada => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:41:39.393584 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e3b0ce-b5e4-4576-b30f-e1358a73adcc None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:39.394104 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e3b0ce-b5e4-4576-b30f-e1358a73adcc None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:39.394575 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e3b0ce-b5e4-4576-b30f-e1358a73adcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:39.396501 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:41:39.464006 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-62e3b0ce-b5e4-4576-b30f-e1358a73adcc None None] MFA Rules not processed for user `088cd90c445e42c583d5ec66170f6764`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:41:39.470919 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-62e3b0ce-b5e4-4576-b30f-e1358a73adcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:39.534714 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2ff9e6-c928-4e57-8f58-9c017bc08fbf admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:39.651221 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0424921e-6c50-4ec4-a5e5-571501f3ef5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:39.652684 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0424921e-6c50-4ec4-a5e5-571501f3ef5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:39.652974 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0424921e-6c50-4ec4-a5e5-571501f3ef5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:39.653260 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0424921e-6c50-4ec4-a5e5-571501f3ef5a admin admin] PATH_INFO: `/v3/users/645bcd4cf8524c8e8ea59f4cff269f84` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:39.655152 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0424921e-6c50-4ec4-a5e5-571501f3ef5a admin admin] RBAC: Authorizing `identity:delete_user(user_id=645bcd4cf8524c8e8ea59f4cff269f84)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:39.657769 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0424921e-6c50-4ec4-a5e5-571501f3ef5a admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:39.747987 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-0424921e-6c50-4ec4-a5e5-571501f3ef5a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '645bcd4cf8524c8e8ea59f4cff269f84'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:39.757410 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-0424921e-6c50-4ec4-a5e5-571501f3ef5a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '645bcd4cf8524c8e8ea59f4cff269f84'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:39.777393 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 894/1791] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:41:39 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 385 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:41:39.779187 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a76427-2713-47a1-b69c-9c54e8b2fd83 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:39.779439 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a76427-2713-47a1-b69c-9c54e8b2fd83 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:39.779784 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a76427-2713-47a1-b69c-9c54e8b2fd83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:39.789585 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-0424921e-6c50-4ec4-a5e5-571501f3ef5a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '645bcd4cf8524c8e8ea59f4cff269f84'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:39.793341 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-0424921e-6c50-4ec4-a5e5-571501f3ef5a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '645bcd4cf8524c8e8ea59f4cff269f84'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:39.794276 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-0424921e-6c50-4ec4-a5e5-571501f3ef5a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '645bcd4cf8524c8e8ea59f4cff269f84'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:39.804684 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-d1a76427-2713-47a1-b69c-9c54e8b2fd83 None None] MFA Rules not processed for user `caa770e36e624905b2e23610e901e22d`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:41:39.806539 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-d1a76427-2713-47a1-b69c-9c54e8b2fd83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:39.876022 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 898/1792] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jul 11 14:41:39 2022] DELETE /identity/v3/users/645bcd4cf8524c8e8ea59f4cff269f84 => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:41:39.880231 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0424921e-6c50-4ec4-a5e5-571501f3ef5a admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:39.883488 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-0424921e-6c50-4ec4-a5e5-571501f3ef5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:39.943038 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:41:39.969336 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 895/1793] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:41:39 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:41:39.973138 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1332f9a2-1d92-42f9-8c66-06ecf7d645ad None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:39.977379 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1332f9a2-1d92-42f9-8c66-06ecf7d645ad None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:39.977536 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1332f9a2-1d92-42f9-8c66-06ecf7d645ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:40.023564 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-1332f9a2-1d92-42f9-8c66-06ecf7d645ad None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:41:40.024574 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:41:40.025782 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-1332f9a2-1d92-42f9-8c66-06ecf7d645ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:40.100424 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0424921e-6c50-4ec4-a5e5-571501f3ef5a admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:40.107735 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0b3236-9247-42a0-92f9-b979eefbc374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:40.109421 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0b3236-9247-42a0-92f9-b979eefbc374 admin admin] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:40.109762 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0b3236-9247-42a0-92f9-b979eefbc374 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:40.110107 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0b3236-9247-42a0-92f9-b979eefbc374 admin admin] PATH_INFO: `/v3/projects` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:40.110911 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0b3236-9247-42a0-92f9-b979eefbc374 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:40.113680 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0b3236-9247-42a0-92f9-b979eefbc374 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:40.168653 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 896/1794] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:41:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:41:40.232684 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1332f9a2-1d92-42f9-8c66-06ecf7d645ad None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:40.234650 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-1332f9a2-1d92-42f9-8c66-06ecf7d645ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:40.234888 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 899/1795] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jul 11 14:41:39 2022] POST /identity/v3/projects => generated 387 bytes in 357 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:41:40.235730 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0b3236-9247-42a0-92f9-b979eefbc374 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:40.398460 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1332f9a2-1d92-42f9-8c66-06ecf7d645ad None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:40.450109 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0b3236-9247-42a0-92f9-b979eefbc374 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:40.470301 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5a066a-1404-4a4f-8742-caca38c4f267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:40.470301 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5a066a-1404-4a4f-8742-caca38c4f267 admin admin] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:40.488790 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5a066a-1404-4a4f-8742-caca38c4f267 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:40.489126 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5a066a-1404-4a4f-8742-caca38c4f267 admin admin] PATH_INFO: `/v3/users` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:40.489896 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5a066a-1404-4a4f-8742-caca38c4f267 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:40.491935 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5a066a-1404-4a4f-8742-caca38c4f267 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:40.526429 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7494206c-7034-4d2c-8935-4f4486cff168 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20eede5ccd834862b00123310b5c3975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:40.527962 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7494206c-7034-4d2c-8935-4f4486cff168 service neutron] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:40.528422 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7494206c-7034-4d2c-8935-4f4486cff168 service neutron] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:40.528810 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7494206c-7034-4d2c-8935-4f4486cff168 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:40.536600 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 900/1796] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jul 11 14:41:40 2022] POST /identity/v3/users => generated 300 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:41:40.541038 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5a066a-1404-4a4f-8742-caca38c4f267 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:40.544094 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-ca5a066a-1404-4a4f-8742-caca38c4f267 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:40.545637 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7494206c-7034-4d2c-8935-4f4486cff168 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:40.547320 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7494206c-7034-4d2c-8935-4f4486cff168 service neutron] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:40.580107 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 897/1797] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:41:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:41:40.581095 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7494206c-7034-4d2c-8935-4f4486cff168 service neutron] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:40.601708 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5a066a-1404-4a4f-8742-caca38c4f267 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:40.606904 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7494206c-7034-4d2c-8935-4f4486cff168 service neutron] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:40.614846 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e113269b-6198-46d7-939a-ccc1d83bc744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:40.624779 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e113269b-6198-46d7-939a-ccc1d83bc744 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:40.626309 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e113269b-6198-46d7-939a-ccc1d83bc744 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:40.626791 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e113269b-6198-46d7-939a-ccc1d83bc744 admin admin] PATH_INFO: `/v3/projects/dda5273c464e4e2ebb3d6b011ce9631b` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:40.628176 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e113269b-6198-46d7-939a-ccc1d83bc744 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dda5273c464e4e2ebb3d6b011ce9631b)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:40.635329 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e113269b-6198-46d7-939a-ccc1d83bc744 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:40.636988 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83795790-aa72-4a80-a76a-e358d8447b5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:40.637780 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83795790-aa72-4a80-a76a-e358d8447b5a admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:40.638125 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83795790-aa72-4a80-a76a-e358d8447b5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:40.638465 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83795790-aa72-4a80-a76a-e358d8447b5a admin admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:40.641293 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83795790-aa72-4a80-a76a-e358d8447b5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:40.643020 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83795790-aa72-4a80-a76a-e358d8447b5a admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:40.667203 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 898/1798] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:41:40 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:41:40.673460 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83795790-aa72-4a80-a76a-e358d8447b5a admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:40.700332 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83795790-aa72-4a80-a76a-e358d8447b5a admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:40.712051 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d56747-9a65-494d-aa1d-ae6ca370c333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:40.715196 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d56747-9a65-494d-aa1d-ae6ca370c333 admin admin] REQUEST_METHOD: `PUT` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:40.716961 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d56747-9a65-494d-aa1d-ae6ca370c333 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:40.716961 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d56747-9a65-494d-aa1d-ae6ca370c333 admin admin] PATH_INFO: `/v3/projects/59c53191c6704cc39cc691f8ed5a8aae/users/952f05c9a2734d83bc56479358f2199d/roles/b46df176b0fe479da63c318db225bed4` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:40.751765 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-e113269b-6198-46d7-939a-ccc1d83bc744 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dda5273c464e4e2ebb3d6b011ce9631b', 'request_id': 'req-e113269b-6198-46d7-939a-ccc1d83bc744'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:40.757055 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d56747-9a65-494d-aa1d-ae6ca370c333 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59c53191c6704cc39cc691f8ed5a8aae, user_id=952f05c9a2734d83bc56479358f2199d, role_id=b46df176b0fe479da63c318db225bed4)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:40.763030 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d56747-9a65-494d-aa1d-ae6ca370c333 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:40.768342 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-e113269b-6198-46d7-939a-ccc1d83bc744 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dda5273c464e4e2ebb3d6b011ce9631b', 'request_id': 'req-e113269b-6198-46d7-939a-ccc1d83bc744'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:40.789116 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-e113269b-6198-46d7-939a-ccc1d83bc744 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dda5273c464e4e2ebb3d6b011ce9631b', 'request_id': 'req-e113269b-6198-46d7-939a-ccc1d83bc744'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:40.809214 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 899/1799] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jul 11 14:41:40 2022] PUT /identity/v3/projects/59c53191c6704cc39cc691f8ed5a8aae/users/952f05c9a2734d83bc56479358f2199d/roles/b46df176b0fe479da63c318db225bed4 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:41:40.811199 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d56747-9a65-494d-aa1d-ae6ca370c333 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:40.831835 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-e113269b-6198-46d7-939a-ccc1d83bc744 admin admin] The token cache is being invalidate because project dda5273c464e4e2ebb3d6b011ce9631b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80534) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:41:40.832133 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-e113269b-6198-46d7-939a-ccc1d83bc744 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:40.836799 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-e113269b-6198-46d7-939a-ccc1d83bc744 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:40.858531 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 901/1800] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jul 11 14:41:40 2022] DELETE /identity/v3/projects/dda5273c464e4e2ebb3d6b011ce9631b => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:41:40.861589 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c180159-5c5e-40be-87f4-1e1637283864 None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:40.861877 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c180159-5c5e-40be-87f4-1e1637283864 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:40.862157 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c180159-5c5e-40be-87f4-1e1637283864 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:40.900652 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:41:40.905018 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-9c180159-5c5e-40be-87f4-1e1637283864 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:41:40.906661 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-9c180159-5c5e-40be-87f4-1e1637283864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:40.999807 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:41:41.016252 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d56747-9a65-494d-aa1d-ae6ca370c333 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:41.051571 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8616ea4d-d34f-4715-8b9e-5753dda66463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:41.052390 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8616ea4d-d34f-4715-8b9e-5753dda66463 admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:41.052684 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8616ea4d-d34f-4715-8b9e-5753dda66463 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:41.052818 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8616ea4d-d34f-4715-8b9e-5753dda66463 admin admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:41.053988 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8616ea4d-d34f-4715-8b9e-5753dda66463 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:41.055795 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8616ea4d-d34f-4715-8b9e-5753dda66463 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:41.085930 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 900/1801] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:41:40 2022] GET /identity/v3/roles => generated 1420 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 14:41:41.093467 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8616ea4d-d34f-4715-8b9e-5753dda66463 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:41.106245 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-8616ea4d-d34f-4715-8b9e-5753dda66463 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:41.126322 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 902/1802] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:41:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:41:41.134472 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3822f1bc-fb95-49ce-9de7-769d51fed8d4 None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:41.135207 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3822f1bc-fb95-49ce-9de7-769d51fed8d4 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:41.135735 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3822f1bc-fb95-49ce-9de7-769d51fed8d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:41.150426 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8616ea4d-d34f-4715-8b9e-5753dda66463 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:41.175134 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2551ec8c-5a1b-4f02-980a-e68eb1e7bd01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:41.176246 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2551ec8c-5a1b-4f02-980a-e68eb1e7bd01 admin admin] REQUEST_METHOD: `PUT` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:41.176689 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2551ec8c-5a1b-4f02-980a-e68eb1e7bd01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:41.177086 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2551ec8c-5a1b-4f02-980a-e68eb1e7bd01 admin admin] PATH_INFO: `/v3/projects/59c53191c6704cc39cc691f8ed5a8aae/users/952f05c9a2734d83bc56479358f2199d/roles/b46df176b0fe479da63c318db225bed4` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:41.187894 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2551ec8c-5a1b-4f02-980a-e68eb1e7bd01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59c53191c6704cc39cc691f8ed5a8aae, user_id=952f05c9a2734d83bc56479358f2199d, role_id=b46df176b0fe479da63c318db225bed4)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:41.202343 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2551ec8c-5a1b-4f02-980a-e68eb1e7bd01 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:41.213083 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-3822f1bc-fb95-49ce-9de7-769d51fed8d4 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:41:41.214792 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-3822f1bc-fb95-49ce-9de7-769d51fed8d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:41.247251 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 901/1803] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jul 11 14:41:41 2022] PUT /identity/v3/projects/59c53191c6704cc39cc691f8ed5a8aae/users/952f05c9a2734d83bc56479358f2199d/roles/b46df176b0fe479da63c318db225bed4 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:41:41.248320 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2551ec8c-5a1b-4f02-980a-e68eb1e7bd01 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:41.250962 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 903/1804] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:41:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:41:41.252491 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b09e388-3165-4238-8ab4-c892873f1961 None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:41.252617 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b09e388-3165-4238-8ab4-c892873f1961 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:41.252900 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b09e388-3165-4238-8ab4-c892873f1961 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:41.263568 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-2551ec8c-5a1b-4f02-980a-e68eb1e7bd01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:41.315334 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-1b09e388-3165-4238-8ab4-c892873f1961 None None] MFA Rules not processed for user `952f05c9a2734d83bc56479358f2199d`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:41:41.316854 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-1b09e388-3165-4238-8ab4-c892873f1961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:41.414283 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2551ec8c-5a1b-4f02-980a-e68eb1e7bd01 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:41.421171 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2da8a6-79c7-4ac4-93b1-3c6810bc6e45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:41.422396 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2da8a6-79c7-4ac4-93b1-3c6810bc6e45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:41.422883 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2da8a6-79c7-4ac4-93b1-3c6810bc6e45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:41.423370 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2da8a6-79c7-4ac4-93b1-3c6810bc6e45 admin admin] PATH_INFO: `/v3/projects/338a1d55cb3b4edbb5ea911dd2a90699` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:41.425244 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2da8a6-79c7-4ac4-93b1-3c6810bc6e45 admin admin] RBAC: Authorizing `identity:delete_project(project_id=338a1d55cb3b4edbb5ea911dd2a90699)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:41.427842 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2da8a6-79c7-4ac4-93b1-3c6810bc6e45 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:41.527933 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 904/1805] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:41:41 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:41:41.529048 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b09e388-3165-4238-8ab4-c892873f1961 None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:41.532724 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-8f2da8a6-79c7-4ac4-93b1-3c6810bc6e45 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '338a1d55cb3b4edbb5ea911dd2a90699', 'request_id': 'req-8f2da8a6-79c7-4ac4-93b1-3c6810bc6e45'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:41.542180 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b09e388-3165-4238-8ab4-c892873f1961 None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:41.543097 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-8f2da8a6-79c7-4ac4-93b1-3c6810bc6e45 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '338a1d55cb3b4edbb5ea911dd2a90699', 'request_id': 'req-8f2da8a6-79c7-4ac4-93b1-3c6810bc6e45'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:41.556865 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-8f2da8a6-79c7-4ac4-93b1-3c6810bc6e45 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '338a1d55cb3b4edbb5ea911dd2a90699', 'request_id': 'req-8f2da8a6-79c7-4ac4-93b1-3c6810bc6e45'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:41.584130 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-8f2da8a6-79c7-4ac4-93b1-3c6810bc6e45 admin admin] The token cache is being invalidate because project 338a1d55cb3b4edbb5ea911dd2a90699 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:41:41.584771 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-8f2da8a6-79c7-4ac4-93b1-3c6810bc6e45 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:41.587920 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-8f2da8a6-79c7-4ac4-93b1-3c6810bc6e45 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:41.591795 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 902/1806] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jul 11 14:41:41 2022] DELETE /identity/v3/projects/338a1d55cb3b4edbb5ea911dd2a90699 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:41:41.594002 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2da8a6-79c7-4ac4-93b1-3c6810bc6e45 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:41.596740 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-8f2da8a6-79c7-4ac4-93b1-3c6810bc6e45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:41.720777 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4803fe-2e8e-45d1-a69e-fc9582084dfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:41.721468 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4803fe-2e8e-45d1-a69e-fc9582084dfd admin admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:41.721750 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4803fe-2e8e-45d1-a69e-fc9582084dfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:41.722022 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4803fe-2e8e-45d1-a69e-fc9582084dfd admin admin] PATH_INFO: `/v3/domains` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:41.722840 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4803fe-2e8e-45d1-a69e-fc9582084dfd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:41:41.723146 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4803fe-2e8e-45d1-a69e-fc9582084dfd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:41.724791 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4803fe-2e8e-45d1-a69e-fc9582084dfd admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:41.734282 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:41:41.767892 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 905/1807] 10.222.0.70 () {58 vars in 1152 bytes} [Mon Jul 11 14:41:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:41:41.768881 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4803fe-2e8e-45d1-a69e-fc9582084dfd admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:41.770979 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-8b4803fe-2e8e-45d1-a69e-fc9582084dfd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:41.789819 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2da8a6-79c7-4ac4-93b1-3c6810bc6e45 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:41.805127 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ac4dba-5c88-473e-9b43-29aa6bb9431a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '868e7c2dec264512b972c8736d659c34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:41.806200 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ac4dba-5c88-473e-9b43-29aa6bb9431a service cinder] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:41.806674 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ac4dba-5c88-473e-9b43-29aa6bb9431a service cinder] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:41.807250 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ac4dba-5c88-473e-9b43-29aa6bb9431a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:41.817418 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-c4ac4dba-5c88-473e-9b43-29aa6bb9431a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:41.833478 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4803fe-2e8e-45d1-a69e-fc9582084dfd admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:41.852998 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1018bb-b659-42be-bff9-ce9be5ca1359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:41.854139 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1018bb-b659-42be-bff9-ce9be5ca1359 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:41.854416 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1018bb-b659-42be-bff9-ce9be5ca1359 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:41.854709 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1018bb-b659-42be-bff9-ce9be5ca1359 admin admin] PATH_INFO: `/v3/users/c840582b218347bcae44bf400f6211a2` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:41.858016 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1018bb-b659-42be-bff9-ce9be5ca1359 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c840582b218347bcae44bf400f6211a2)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:41.859976 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1018bb-b659-42be-bff9-ce9be5ca1359 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:41.984918 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:41:42.010129 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-6f1018bb-b659-42be-bff9-ce9be5ca1359 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c840582b218347bcae44bf400f6211a2'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:42.032755 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-6f1018bb-b659-42be-bff9-ce9be5ca1359 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c840582b218347bcae44bf400f6211a2'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:42.051006 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-6f1018bb-b659-42be-bff9-ce9be5ca1359 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c840582b218347bcae44bf400f6211a2'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:42.052533 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-6f1018bb-b659-42be-bff9-ce9be5ca1359 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c840582b218347bcae44bf400f6211a2'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:42.053613 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-6f1018bb-b659-42be-bff9-ce9be5ca1359 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c840582b218347bcae44bf400f6211a2'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:42.066529 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ac4dba-5c88-473e-9b43-29aa6bb9431a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:42.068170 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ac4dba-5c88-473e-9b43-29aa6bb9431a service cinder] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:42.108959 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 903/1808] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:41:41 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 516 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:41:42.110625 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ac4dba-5c88-473e-9b43-29aa6bb9431a service cinder] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:42.115306 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-c4ac4dba-5c88-473e-9b43-29aa6bb9431a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:42.156615 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 906/1809] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jul 11 14:41:41 2022] DELETE /identity/v3/users/c840582b218347bcae44bf400f6211a2 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:41:42.156821 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ac4dba-5c88-473e-9b43-29aa6bb9431a service cinder] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:42.164995 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1018bb-b659-42be-bff9-ce9be5ca1359 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:42.169559 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-6f1018bb-b659-42be-bff9-ce9be5ca1359 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:42.348243 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6845377c-10b1-46dd-abde-a1b4ab77449a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:42.349688 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6845377c-10b1-46dd-abde-a1b4ab77449a admin admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:42.350413 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6845377c-10b1-46dd-abde-a1b4ab77449a admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:42.359036 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1018bb-b659-42be-bff9-ce9be5ca1359 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:42.368558 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6845377c-10b1-46dd-abde-a1b4ab77449a admin admin] PATH_INFO: `/v3/projects` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:42.370608 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6845377c-10b1-46dd-abde-a1b4ab77449a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:42.373343 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a479fe4-f779-4e23-ba9c-5e0ef8729aed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:42.374259 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a479fe4-f779-4e23-ba9c-5e0ef8729aed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:42.374546 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a479fe4-f779-4e23-ba9c-5e0ef8729aed admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:42.374882 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a479fe4-f779-4e23-ba9c-5e0ef8729aed admin admin] PATH_INFO: `/v3/users/088cd90c445e42c583d5ec66170f6764` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:42.376058 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6845377c-10b1-46dd-abde-a1b4ab77449a admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:42.383063 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a479fe4-f779-4e23-ba9c-5e0ef8729aed admin admin] RBAC: Authorizing `identity:delete_user(user_id=088cd90c445e42c583d5ec66170f6764)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:42.385650 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a479fe4-f779-4e23-ba9c-5e0ef8729aed admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:42.465453 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 904/1810] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jul 11 14:41:42 2022] POST /identity/v3/projects => generated 383 bytes in 355 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:41:42.473291 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6845377c-10b1-46dd-abde-a1b4ab77449a admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:42.479105 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-6845377c-10b1-46dd-abde-a1b4ab77449a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:42.528981 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-3a479fe4-f779-4e23-ba9c-5e0ef8729aed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '088cd90c445e42c583d5ec66170f6764'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:42.541901 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-3a479fe4-f779-4e23-ba9c-5e0ef8729aed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '088cd90c445e42c583d5ec66170f6764'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:42.557256 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-3a479fe4-f779-4e23-ba9c-5e0ef8729aed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '088cd90c445e42c583d5ec66170f6764'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:42.559265 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-3a479fe4-f779-4e23-ba9c-5e0ef8729aed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '088cd90c445e42c583d5ec66170f6764'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:42.560577 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-3a479fe4-f779-4e23-ba9c-5e0ef8729aed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '088cd90c445e42c583d5ec66170f6764'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:42.620550 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 907/1811] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jul 11 14:41:42 2022] DELETE /identity/v3/users/088cd90c445e42c583d5ec66170f6764 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:41:42.625475 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a845e12a-8341-4b3a-afc4-df646b5e3238 None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:42.626008 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a845e12a-8341-4b3a-afc4-df646b5e3238 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:42.627115 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a845e12a-8341-4b3a-afc4-df646b5e3238 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:42.632513 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6845377c-10b1-46dd-abde-a1b4ab77449a admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:42.650100 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:41:42.658293 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-a845e12a-8341-4b3a-afc4-df646b5e3238 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:41:42.659549 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-a845e12a-8341-4b3a-afc4-df646b5e3238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:42.716378 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:41:42.734199 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c8edd2-d62a-43b4-ac94-6d1b33fb2bdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:42.735071 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c8edd2-d62a-43b4-ac94-6d1b33fb2bdb admin admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:42.735355 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c8edd2-d62a-43b4-ac94-6d1b33fb2bdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:42.735635 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c8edd2-d62a-43b4-ac94-6d1b33fb2bdb admin admin] PATH_INFO: `/v3/users` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:42.736365 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c8edd2-d62a-43b4-ac94-6d1b33fb2bdb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:42.738326 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c8edd2-d62a-43b4-ac94-6d1b33fb2bdb admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:42.772439 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 905/1812] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jul 11 14:41:42 2022] POST /identity/v3/users => generated 292 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:41:42.777490 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c8edd2-d62a-43b4-ac94-6d1b33fb2bdb admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:42.782838 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-f8c8edd2-d62a-43b4-ac94-6d1b33fb2bdb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:42.790058 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 908/1813] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:41:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:41:42.800853 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a845e12a-8341-4b3a-afc4-df646b5e3238 None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:42.802665 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-a845e12a-8341-4b3a-afc4-df646b5e3238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:42.804873 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c8edd2-d62a-43b4-ac94-6d1b33fb2bdb admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:42.810489 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9afd54f-d629-4cac-b991-ad18facc889b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:42.811521 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9afd54f-d629-4cac-b991-ad18facc889b admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:42.813398 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9afd54f-d629-4cac-b991-ad18facc889b admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:42.813738 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9afd54f-d629-4cac-b991-ad18facc889b admin admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:42.815063 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9afd54f-d629-4cac-b991-ad18facc889b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:42.817648 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9afd54f-d629-4cac-b991-ad18facc889b admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:42.830681 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 906/1814] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:41:42 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:41:42.835454 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9afd54f-d629-4cac-b991-ad18facc889b admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:42.853985 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9afd54f-d629-4cac-b991-ad18facc889b admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:42.860833 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde7c1c4-5770-4abe-9bc3-f414eaf3b68d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:42.861964 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde7c1c4-5770-4abe-9bc3-f414eaf3b68d admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:42.862666 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde7c1c4-5770-4abe-9bc3-f414eaf3b68d admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:42.863332 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde7c1c4-5770-4abe-9bc3-f414eaf3b68d admin admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:42.864552 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde7c1c4-5770-4abe-9bc3-f414eaf3b68d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:42.867171 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde7c1c4-5770-4abe-9bc3-f414eaf3b68d admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:42.885982 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 907/1815] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:41:42 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 14:41:42.891278 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde7c1c4-5770-4abe-9bc3-f414eaf3b68d admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:42.910837 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde7c1c4-5770-4abe-9bc3-f414eaf3b68d admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:42.918311 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec7f735-25c2-4331-bc25-e8a8b67862b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:42.920351 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec7f735-25c2-4331-bc25-e8a8b67862b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:42.920723 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec7f735-25c2-4331-bc25-e8a8b67862b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:42.921374 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec7f735-25c2-4331-bc25-e8a8b67862b2 admin admin] PATH_INFO: `/v3/projects/690b095f0a79431d99d52bedc3a82bf5/users/4c79b4b0b87b475c8fb6adcd339d6e53/roles/8eff41f243c843ed95505a488ca6eada` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:42.956863 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec7f735-25c2-4331-bc25-e8a8b67862b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=690b095f0a79431d99d52bedc3a82bf5, user_id=4c79b4b0b87b475c8fb6adcd339d6e53, role_id=8eff41f243c843ed95505a488ca6eada)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:42.963264 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec7f735-25c2-4331-bc25-e8a8b67862b2 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:43.004584 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 908/1816] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jul 11 14:41:42 2022] PUT /identity/v3/projects/690b095f0a79431d99d52bedc3a82bf5/users/4c79b4b0b87b475c8fb6adcd339d6e53/roles/8eff41f243c843ed95505a488ca6eada => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:41:43.012829 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58229bb5-561d-46d3-bd28-ab5fdf15bdf9 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:43.013677 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58229bb5-561d-46d3-bd28-ab5fdf15bdf9 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:43.014211 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58229bb5-561d-46d3-bd28-ab5fdf15bdf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:43.029194 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a845e12a-8341-4b3a-afc4-df646b5e3238 None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:43.105734 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-58229bb5-561d-46d3-bd28-ab5fdf15bdf9 None None] MFA Rules not processed for user `4c79b4b0b87b475c8fb6adcd339d6e53`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:41:43.107189 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-58229bb5-561d-46d3-bd28-ab5fdf15bdf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:43.197737 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c944293-d139-447d-bdb8-4afc2e9d4e20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20eede5ccd834862b00123310b5c3975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:43.199042 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c944293-d139-447d-bdb8-4afc2e9d4e20 service neutron] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:43.201946 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c944293-d139-447d-bdb8-4afc2e9d4e20 service neutron] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:43.205160 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c944293-d139-447d-bdb8-4afc2e9d4e20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:43.293446 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 909/1817] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:41:43 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:41:43.298235 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58229bb5-561d-46d3-bd28-ab5fdf15bdf9 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:43.372500 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c944293-d139-447d-bdb8-4afc2e9d4e20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:43.375346 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c944293-d139-447d-bdb8-4afc2e9d4e20 service neutron] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:43.393918 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 909/1818] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:41:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 594 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:41:43.458224 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:41:43.483361 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58229bb5-561d-46d3-bd28-ab5fdf15bdf9 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:43.490794 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f3ac8a-6152-4c8b-b3cf-99e4ecb7521a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:43.492092 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f3ac8a-6152-4c8b-b3cf-99e4ecb7521a admin admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:43.492865 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f3ac8a-6152-4c8b-b3cf-99e4ecb7521a admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:43.493872 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f3ac8a-6152-4c8b-b3cf-99e4ecb7521a admin admin] PATH_INFO: `/v3/projects` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:43.495968 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f3ac8a-6152-4c8b-b3cf-99e4ecb7521a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:43.500765 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f3ac8a-6152-4c8b-b3cf-99e4ecb7521a admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:43.554787 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c944293-d139-447d-bdb8-4afc2e9d4e20 service neutron] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:43.588325 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 910/1819] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jul 11 14:41:43 2022] POST /identity/v3/projects => generated 383 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:41:43.595999 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c944293-d139-447d-bdb8-4afc2e9d4e20 service neutron] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:43.744108 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:41:43.788752 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a17d1a-98bf-4d8e-ae05-73c159738c71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:43.789471 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a17d1a-98bf-4d8e-ae05-73c159738c71 admin admin] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:43.789817 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a17d1a-98bf-4d8e-ae05-73c159738c71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:43.790359 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a17d1a-98bf-4d8e-ae05-73c159738c71 admin admin] PATH_INFO: `/v3/users` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:43.791644 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a17d1a-98bf-4d8e-ae05-73c159738c71 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:43.795505 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a17d1a-98bf-4d8e-ae05-73c159738c71 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:43.844189 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 910/1820] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jul 11 14:41:43 2022] POST /identity/v3/users => generated 298 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:41:43.848706 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f3ac8a-6152-4c8b-b3cf-99e4ecb7521a admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:43.867267 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f3ac8a-6152-4c8b-b3cf-99e4ecb7521a admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:43.875372 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f995e763-25e9-4070-b38d-022ac5646933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:43.876569 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f995e763-25e9-4070-b38d-022ac5646933 admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:43.877066 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f995e763-25e9-4070-b38d-022ac5646933 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:43.877695 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f995e763-25e9-4070-b38d-022ac5646933 admin admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:43.878829 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f995e763-25e9-4070-b38d-022ac5646933 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:43.880880 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f995e763-25e9-4070-b38d-022ac5646933 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:43.906064 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 911/1821] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:41:43 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:41:43.910100 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a17d1a-98bf-4d8e-ae05-73c159738c71 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:43.929579 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a17d1a-98bf-4d8e-ae05-73c159738c71 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:43.942469 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375f2632-4655-4731-b2f5-ece9509630fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:43.944214 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375f2632-4655-4731-b2f5-ece9509630fd admin admin] REQUEST_METHOD: `PUT` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:43.944839 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375f2632-4655-4731-b2f5-ece9509630fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:43.945338 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375f2632-4655-4731-b2f5-ece9509630fd admin admin] PATH_INFO: `/v3/projects/941589f19a364b14936591b9bf22ac18/users/4a1a65b0784d474ab01b710b7e482afd/roles/b46df176b0fe479da63c318db225bed4` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:43.982336 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375f2632-4655-4731-b2f5-ece9509630fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=941589f19a364b14936591b9bf22ac18, user_id=4a1a65b0784d474ab01b710b7e482afd, role_id=b46df176b0fe479da63c318db225bed4)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:43.985980 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375f2632-4655-4731-b2f5-ece9509630fd admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:44.016673 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f995e763-25e9-4070-b38d-022ac5646933 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:44.019376 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 911/1822] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jul 11 14:41:43 2022] PUT /identity/v3/projects/941589f19a364b14936591b9bf22ac18/users/4a1a65b0784d474ab01b710b7e482afd/roles/b46df176b0fe479da63c318db225bed4 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:41:44.029886 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f995e763-25e9-4070-b38d-022ac5646933 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:44.148395 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620a3e86-ed2d-4ccc-92ba-20513723fcda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:44.149110 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620a3e86-ed2d-4ccc-92ba-20513723fcda admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:44.149438 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620a3e86-ed2d-4ccc-92ba-20513723fcda admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:44.151083 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620a3e86-ed2d-4ccc-92ba-20513723fcda admin admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:44.151197 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620a3e86-ed2d-4ccc-92ba-20513723fcda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:44.153788 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620a3e86-ed2d-4ccc-92ba-20513723fcda admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:44.184599 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 912/1823] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:41:44 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 14:41:44.188363 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375f2632-4655-4731-b2f5-ece9509630fd admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:44.201291 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375f2632-4655-4731-b2f5-ece9509630fd admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:44.206565 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c074c6-9a8a-463d-a501-2a471b47a25b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:44.207452 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c074c6-9a8a-463d-a501-2a471b47a25b admin admin] REQUEST_METHOD: `PUT` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:44.207730 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c074c6-9a8a-463d-a501-2a471b47a25b admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:44.208004 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c074c6-9a8a-463d-a501-2a471b47a25b admin admin] PATH_INFO: `/v3/projects/941589f19a364b14936591b9bf22ac18/users/4a1a65b0784d474ab01b710b7e482afd/roles/b46df176b0fe479da63c318db225bed4` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:44.210087 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c074c6-9a8a-463d-a501-2a471b47a25b admin admin] RBAC: Authorizing `identity:create_grant(project_id=941589f19a364b14936591b9bf22ac18, user_id=4a1a65b0784d474ab01b710b7e482afd, role_id=b46df176b0fe479da63c318db225bed4)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:44.224849 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c074c6-9a8a-463d-a501-2a471b47a25b admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:44.238729 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 912/1824] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jul 11 14:41:44 2022] PUT /identity/v3/projects/941589f19a364b14936591b9bf22ac18/users/4a1a65b0784d474ab01b710b7e482afd/roles/b46df176b0fe479da63c318db225bed4 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:41:44.251067 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a78bda9-0687-47c8-a920-ca3d502e05c0 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:44.251067 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a78bda9-0687-47c8-a920-ca3d502e05c0 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:44.251067 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a78bda9-0687-47c8-a920-ca3d502e05c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:44.266389 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c074c6-9a8a-463d-a501-2a471b47a25b admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:44.270223 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-d0c074c6-9a8a-463d-a501-2a471b47a25b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:44.314075 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-7a78bda9-0687-47c8-a920-ca3d502e05c0 None None] MFA Rules not processed for user `4a1a65b0784d474ab01b710b7e482afd`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:41:44.315628 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-7a78bda9-0687-47c8-a920-ca3d502e05c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:44.528755 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c074c6-9a8a-463d-a501-2a471b47a25b admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:44.531097 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 913/1825] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:41:44 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:41:44.549617 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a78bda9-0687-47c8-a920-ca3d502e05c0 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:44.551730 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-7a78bda9-0687-47c8-a920-ca3d502e05c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:44.552940 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c749f3f0-9250-4bd6-8fcd-a3cc643c5fc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:44.554329 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c749f3f0-9250-4bd6-8fcd-a3cc643c5fc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:44.554617 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c749f3f0-9250-4bd6-8fcd-a3cc643c5fc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:44.554898 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c749f3f0-9250-4bd6-8fcd-a3cc643c5fc7 admin admin] PATH_INFO: `/v3/users/84d965347a8e4ebfbd6f9b3af9a8c7c7` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:44.564544 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c749f3f0-9250-4bd6-8fcd-a3cc643c5fc7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=84d965347a8e4ebfbd6f9b3af9a8c7c7)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:44.566791 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c749f3f0-9250-4bd6-8fcd-a3cc643c5fc7 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:44.706856 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-c749f3f0-9250-4bd6-8fcd-a3cc643c5fc7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84d965347a8e4ebfbd6f9b3af9a8c7c7'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:44.728833 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:41:44.729689 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-c749f3f0-9250-4bd6-8fcd-a3cc643c5fc7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84d965347a8e4ebfbd6f9b3af9a8c7c7'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:44.742819 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a78bda9-0687-47c8-a920-ca3d502e05c0 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:44.747117 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-c749f3f0-9250-4bd6-8fcd-a3cc643c5fc7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84d965347a8e4ebfbd6f9b3af9a8c7c7'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:44.748161 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-c749f3f0-9250-4bd6-8fcd-a3cc643c5fc7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84d965347a8e4ebfbd6f9b3af9a8c7c7'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:44.748954 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-c749f3f0-9250-4bd6-8fcd-a3cc643c5fc7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84d965347a8e4ebfbd6f9b3af9a8c7c7'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:44.767666 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa551e3f-6569-44d3-a7c5-05ef14aa489c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '868e7c2dec264512b972c8736d659c34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:44.768556 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa551e3f-6569-44d3-a7c5-05ef14aa489c service cinder] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:44.768965 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa551e3f-6569-44d3-a7c5-05ef14aa489c service cinder] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:44.769389 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa551e3f-6569-44d3-a7c5-05ef14aa489c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:44.778153 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-aa551e3f-6569-44d3-a7c5-05ef14aa489c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:44.809237 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa551e3f-6569-44d3-a7c5-05ef14aa489c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:44.811094 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa551e3f-6569-44d3-a7c5-05ef14aa489c service cinder] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:44.823681 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 914/1826] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:41:44 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:41:44.824865 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa551e3f-6569-44d3-a7c5-05ef14aa489c service cinder] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:44.826723 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-aa551e3f-6569-44d3-a7c5-05ef14aa489c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:44.845097 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 913/1827] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jul 11 14:41:44 2022] DELETE /identity/v3/users/84d965347a8e4ebfbd6f9b3af9a8c7c7 => generated 0 bytes in 580 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:41:44.851504 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a3e7b5-2638-4e16-bfff-906d659cff32 None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:44.851783 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a3e7b5-2638-4e16-bfff-906d659cff32 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:44.851879 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa551e3f-6569-44d3-a7c5-05ef14aa489c service cinder] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:44.852228 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a3e7b5-2638-4e16-bfff-906d659cff32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:44.892596 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-66a3e7b5-2638-4e16-bfff-906d659cff32 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:41:44.893945 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-66a3e7b5-2638-4e16-bfff-906d659cff32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:44.922108 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=84,keystone:INSERT=6,keystone:DELETE=10 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:41:45.015009 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 914/1828] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:41:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:41:45.016249 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a3e7b5-2638-4e16-bfff-906d659cff32 None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:45.028232 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63611dc-776d-4c9d-b088-8408b7af411d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:45.029501 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63611dc-776d-4c9d-b088-8408b7af411d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:45.029916 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63611dc-776d-4c9d-b088-8408b7af411d admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:45.030275 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-66a3e7b5-2638-4e16-bfff-906d659cff32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:45.030578 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63611dc-776d-4c9d-b088-8408b7af411d admin admin] PATH_INFO: `/v3/projects/586d2ff891d243878c48838a22997773` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:45.032130 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63611dc-776d-4c9d-b088-8408b7af411d admin admin] RBAC: Authorizing `identity:delete_project(project_id=586d2ff891d243878c48838a22997773)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:45.034458 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63611dc-776d-4c9d-b088-8408b7af411d admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:45.046556 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a3e7b5-2638-4e16-bfff-906d659cff32 None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:45.052180 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7040f6dd-52c1-49e6-ba09-0b49bd9a57e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:45.053634 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7040f6dd-52c1-49e6-ba09-0b49bd9a57e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:45.053634 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7040f6dd-52c1-49e6-ba09-0b49bd9a57e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:45.053863 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7040f6dd-52c1-49e6-ba09-0b49bd9a57e2 admin admin] PATH_INFO: `/v3/projects/a14f2e5d21324d81a969002e7df95c08` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:45.055139 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7040f6dd-52c1-49e6-ba09-0b49bd9a57e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a14f2e5d21324d81a969002e7df95c08)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:45.058168 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7040f6dd-52c1-49e6-ba09-0b49bd9a57e2 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:45.119473 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-7040f6dd-52c1-49e6-ba09-0b49bd9a57e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a14f2e5d21324d81a969002e7df95c08', 'request_id': 'req-7040f6dd-52c1-49e6-ba09-0b49bd9a57e2'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:45.127900 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-7040f6dd-52c1-49e6-ba09-0b49bd9a57e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a14f2e5d21324d81a969002e7df95c08', 'request_id': 'req-7040f6dd-52c1-49e6-ba09-0b49bd9a57e2'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:45.138817 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-e63611dc-776d-4c9d-b088-8408b7af411d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '586d2ff891d243878c48838a22997773', 'request_id': 'req-e63611dc-776d-4c9d-b088-8408b7af411d'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:45.139871 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-7040f6dd-52c1-49e6-ba09-0b49bd9a57e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a14f2e5d21324d81a969002e7df95c08', 'request_id': 'req-7040f6dd-52c1-49e6-ba09-0b49bd9a57e2'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:45.147993 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-e63611dc-776d-4c9d-b088-8408b7af411d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '586d2ff891d243878c48838a22997773', 'request_id': 'req-e63611dc-776d-4c9d-b088-8408b7af411d'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:45.155424 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-e63611dc-776d-4c9d-b088-8408b7af411d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '586d2ff891d243878c48838a22997773', 'request_id': 'req-e63611dc-776d-4c9d-b088-8408b7af411d'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:45.157855 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-7040f6dd-52c1-49e6-ba09-0b49bd9a57e2 admin admin] The token cache is being invalidate because project a14f2e5d21324d81a969002e7df95c08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80534) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:41:45.158935 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-7040f6dd-52c1-49e6-ba09-0b49bd9a57e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:45.161431 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-7040f6dd-52c1-49e6-ba09-0b49bd9a57e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:45.163303 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 915/1829] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jul 11 14:41:45 2022] DELETE /identity/v3/projects/a14f2e5d21324d81a969002e7df95c08 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:41:45.164752 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7040f6dd-52c1-49e6-ba09-0b49bd9a57e2 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:45.180751 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-e63611dc-776d-4c9d-b088-8408b7af411d admin admin] The token cache is being invalidate because project 586d2ff891d243878c48838a22997773 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:41:45.180751 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-e63611dc-776d-4c9d-b088-8408b7af411d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:45.183028 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-e63611dc-776d-4c9d-b088-8408b7af411d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:45.190403 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 915/1830] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jul 11 14:41:44 2022] DELETE /identity/v3/projects/586d2ff891d243878c48838a22997773 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:41:45.190403 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63611dc-776d-4c9d-b088-8408b7af411d admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:45.190403 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-e63611dc-776d-4c9d-b088-8408b7af411d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:45.190895 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-7040f6dd-52c1-49e6-ba09-0b49bd9a57e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:45.347870 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63611dc-776d-4c9d-b088-8408b7af411d admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:45.354175 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf8dbe4-42aa-49d3-abc9-9868816874e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '868e7c2dec264512b972c8736d659c34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:45.355181 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf8dbe4-42aa-49d3-abc9-9868816874e7 service cinder] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:45.355645 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf8dbe4-42aa-49d3-abc9-9868816874e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:45.356119 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf8dbe4-42aa-49d3-abc9-9868816874e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:45.359291 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-cbf8dbe4-42aa-49d3-abc9-9868816874e7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:45.383577 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7040f6dd-52c1-49e6-ba09-0b49bd9a57e2 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:45.420586 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:41:45.475932 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf8dbe4-42aa-49d3-abc9-9868816874e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:45.478173 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf8dbe4-42aa-49d3-abc9-9868816874e7 service cinder] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:45.492293 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90c3dcc-8f95-497c-952a-9fbb06a7bffb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20eede5ccd834862b00123310b5c3975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:45.494100 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90c3dcc-8f95-497c-952a-9fbb06a7bffb service neutron] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:45.495133 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90c3dcc-8f95-497c-952a-9fbb06a7bffb service neutron] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:45.495604 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90c3dcc-8f95-497c-952a-9fbb06a7bffb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:45.497522 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 916/1831] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:41:45 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:41:45.498234 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-b90c3dcc-8f95-497c-952a-9fbb06a7bffb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:45.499174 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9b6339-55f4-4c6c-81b0-b5249db1a1fa None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:45.499501 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9b6339-55f4-4c6c-81b0-b5249db1a1fa None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:45.499862 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9b6339-55f4-4c6c-81b0-b5249db1a1fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:45.514245 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:41:45.530197 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-7f9b6339-55f4-4c6c-81b0-b5249db1a1fa None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:41:45.533204 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-7f9b6339-55f4-4c6c-81b0-b5249db1a1fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:45.602356 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90c3dcc-8f95-497c-952a-9fbb06a7bffb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:45.606223 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90c3dcc-8f95-497c-952a-9fbb06a7bffb service neutron] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:45.635630 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 917/1832] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:41:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:41:45.636508 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9b6339-55f4-4c6c-81b0-b5249db1a1fa None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:45.638029 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-7f9b6339-55f4-4c6c-81b0-b5249db1a1fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:45.649468 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 916/1833] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:41:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 485 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:41:45.654250 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9999157b-fd1b-4360-ab27-17245eebb35d None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:45.654546 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9999157b-fd1b-4360-ab27-17245eebb35d None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:45.654904 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9999157b-fd1b-4360-ab27-17245eebb35d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:45.664850 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9b6339-55f4-4c6c-81b0-b5249db1a1fa None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:45.678416 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9381d98-d048-4a22-ba95-655940271c2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:45.679326 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9381d98-d048-4a22-ba95-655940271c2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:45.679609 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9381d98-d048-4a22-ba95-655940271c2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:45.679889 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9381d98-d048-4a22-ba95-655940271c2d admin admin] PATH_INFO: `/v3/users/952f05c9a2734d83bc56479358f2199d` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:45.682295 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9381d98-d048-4a22-ba95-655940271c2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=952f05c9a2734d83bc56479358f2199d)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:45.688063 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9381d98-d048-4a22-ba95-655940271c2d admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:45.690604 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-9999157b-fd1b-4360-ab27-17245eebb35d None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:41:45.692882 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-9999157b-fd1b-4360-ab27-17245eebb35d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:45.708176 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 917/1834] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:41:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:41:45.713324 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9999157b-fd1b-4360-ab27-17245eebb35d None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:45.726061 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9999157b-fd1b-4360-ab27-17245eebb35d None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:45.739667 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e30e133-97c0-4329-8c43-463e7a4a474b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:45.741747 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e30e133-97c0-4329-8c43-463e7a4a474b admin admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:45.742359 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e30e133-97c0-4329-8c43-463e7a4a474b admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:45.742359 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e30e133-97c0-4329-8c43-463e7a4a474b admin admin] PATH_INFO: `/v3/domains` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:45.743622 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e30e133-97c0-4329-8c43-463e7a4a474b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:41:45.744217 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e30e133-97c0-4329-8c43-463e7a4a474b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:45.747192 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e30e133-97c0-4329-8c43-463e7a4a474b admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:45.768937 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 918/1835] 10.222.0.70 () {58 vars in 1152 bytes} [Mon Jul 11 14:41:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:41:45.770603 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e30e133-97c0-4329-8c43-463e7a4a474b admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:45.784349 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e30e133-97c0-4329-8c43-463e7a4a474b admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:45.789995 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70367fbd-b34e-4a53-81cd-82e989a9147b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:45.791045 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70367fbd-b34e-4a53-81cd-82e989a9147b admin admin] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:45.791436 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70367fbd-b34e-4a53-81cd-82e989a9147b admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:45.792161 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70367fbd-b34e-4a53-81cd-82e989a9147b admin admin] PATH_INFO: `/v3/projects` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:45.792651 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70367fbd-b34e-4a53-81cd-82e989a9147b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:45.794699 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70367fbd-b34e-4a53-81cd-82e989a9147b admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:45.812590 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-f9381d98-d048-4a22-ba95-655940271c2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '952f05c9a2734d83bc56479358f2199d'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:45.829324 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-f9381d98-d048-4a22-ba95-655940271c2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '952f05c9a2734d83bc56479358f2199d'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:45.835341 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 919/1836] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jul 11 14:41:45 2022] POST /identity/v3/projects => generated 391 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:41:45.843857 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc2ea0d-5b04-4ba0-a78d-42923ec07c9f None None] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:45.844222 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc2ea0d-5b04-4ba0-a78d-42923ec07c9f None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:45.845753 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc2ea0d-5b04-4ba0-a78d-42923ec07c9f None None] PATH_INFO: `/` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:45.846784 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-f9381d98-d048-4a22-ba95-655940271c2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '952f05c9a2734d83bc56479358f2199d'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:45.847600 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-f9381d98-d048-4a22-ba95-655940271c2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '952f05c9a2734d83bc56479358f2199d'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:45.847842 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 920/1837] 10.222.0.70 () {54 vars in 921 bytes} [Mon Jul 11 14:41:45 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:41:45.848298 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-f9381d98-d048-4a22-ba95-655940271c2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '952f05c9a2734d83bc56479358f2199d'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:45.848652 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc2ea0d-5b04-4ba0-a78d-42923ec07c9f None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:45.851297 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-8dc2ea0d-5b04-4ba0-a78d-42923ec07c9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:45.894482 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 918/1838] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jul 11 14:41:45 2022] DELETE /identity/v3/users/952f05c9a2734d83bc56479358f2199d => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:41:45.943849 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdd18b8-0a40-47d4-b661-cd5256490764 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:45.944540 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdd18b8-0a40-47d4-b661-cd5256490764 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:45.945059 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdd18b8-0a40-47d4-b661-cd5256490764 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:45.973269 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-1cdd18b8-0a40-47d4-b661-cd5256490764 None None] MFA Rules not processed for user `f4f8c0d696af4bd5a205ca8e9110b8cc`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:41:45.977642 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc2ea0d-5b04-4ba0-a78d-42923ec07c9f None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:45.978559 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-1cdd18b8-0a40-47d4-b661-cd5256490764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:46.123799 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c51b9e-37d0-4cf9-9ad7-dc6354ca8249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:46.124920 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c51b9e-37d0-4cf9-9ad7-dc6354ca8249 admin admin] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:46.125331 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c51b9e-37d0-4cf9-9ad7-dc6354ca8249 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:46.125627 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c51b9e-37d0-4cf9-9ad7-dc6354ca8249 admin admin] PATH_INFO: `/v3/users` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:46.126460 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c51b9e-37d0-4cf9-9ad7-dc6354ca8249 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:46.128492 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c51b9e-37d0-4cf9-9ad7-dc6354ca8249 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:46.131189 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:41:46.188614 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:41:46.205343 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 921/1839] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jul 11 14:41:45 2022] POST /identity/v3/users => generated 296 bytes in 357 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:41:46.206320 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c51b9e-37d0-4cf9-9ad7-dc6354ca8249 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:46.208764 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-35c51b9e-37d0-4cf9-9ad7-dc6354ca8249 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:46.231109 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 919/1840] 10.222.0.70 () {58 vars in 1018 bytes} [Mon Jul 11 14:41:45 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:41:46.236594 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdd18b8-0a40-47d4-b661-cd5256490764 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:46.241980 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c51b9e-37d0-4cf9-9ad7-dc6354ca8249 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:46.248711 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e601e60-b5ea-4c22-be9f-7da144eeebfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:46.249809 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e601e60-b5ea-4c22-be9f-7da144eeebfc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:46.250162 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e601e60-b5ea-4c22-be9f-7da144eeebfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:46.250558 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e601e60-b5ea-4c22-be9f-7da144eeebfc admin admin] PATH_INFO: `/v3/users/4c79b4b0b87b475c8fb6adcd339d6e53` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:46.252438 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e601e60-b5ea-4c22-be9f-7da144eeebfc admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c79b4b0b87b475c8fb6adcd339d6e53)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:46.255884 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e601e60-b5ea-4c22-be9f-7da144eeebfc admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:46.262159 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdd18b8-0a40-47d4-b661-cd5256490764 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:46.270638 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2809f2-2fb4-4ca0-92f7-0bbb4c23e3b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:46.271800 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2809f2-2fb4-4ca0-92f7-0bbb4c23e3b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:46.272383 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2809f2-2fb4-4ca0-92f7-0bbb4c23e3b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:46.272951 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2809f2-2fb4-4ca0-92f7-0bbb4c23e3b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:46.274689 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2809f2-2fb4-4ca0-92f7-0bbb4c23e3b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:46.278314 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2809f2-2fb4-4ca0-92f7-0bbb4c23e3b7 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:46.304778 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 920/1841] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:41:46 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:41:46.307515 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2809f2-2fb4-4ca0-92f7-0bbb4c23e3b7 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:46.309499 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-6b2809f2-2fb4-4ca0-92f7-0bbb4c23e3b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:46.337760 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-0e601e60-b5ea-4c22-be9f-7da144eeebfc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c79b4b0b87b475c8fb6adcd339d6e53'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:46.349298 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-0e601e60-b5ea-4c22-be9f-7da144eeebfc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c79b4b0b87b475c8fb6adcd339d6e53'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:46.369576 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2809f2-2fb4-4ca0-92f7-0bbb4c23e3b7 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:46.371398 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-0e601e60-b5ea-4c22-be9f-7da144eeebfc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c79b4b0b87b475c8fb6adcd339d6e53'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:46.372590 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-0e601e60-b5ea-4c22-be9f-7da144eeebfc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c79b4b0b87b475c8fb6adcd339d6e53'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:46.374131 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-0e601e60-b5ea-4c22-be9f-7da144eeebfc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c79b4b0b87b475c8fb6adcd339d6e53'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:46.378756 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428aa7ac-b80f-44d2-a103-bf00dee533ae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4f8c0d696af4bd5a205ca8e9110b8cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:46.379475 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428aa7ac-b80f-44d2-a103-bf00dee533ae service nova] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:46.379823 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428aa7ac-b80f-44d2-a103-bf00dee533ae service nova] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:46.380547 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428aa7ac-b80f-44d2-a103-bf00dee533ae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:46.383554 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-428aa7ac-b80f-44d2-a103-bf00dee533ae service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:46.404396 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428aa7ac-b80f-44d2-a103-bf00dee533ae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:46.410211 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428aa7ac-b80f-44d2-a103-bf00dee533ae service nova] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:46.421955 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 922/1842] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jul 11 14:41:46 2022] DELETE /identity/v3/users/4c79b4b0b87b475c8fb6adcd339d6e53 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:41:46.421955 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e601e60-b5ea-4c22-be9f-7da144eeebfc admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:46.422519 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-0e601e60-b5ea-4c22-be9f-7da144eeebfc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:46.460133 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 921/1843] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:41:46 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:41:46.462088 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428aa7ac-b80f-44d2-a103-bf00dee533ae service nova] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:46.470693 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-428aa7ac-b80f-44d2-a103-bf00dee533ae service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:46.522060 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428aa7ac-b80f-44d2-a103-bf00dee533ae service nova] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:46.602035 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e601e60-b5ea-4c22-be9f-7da144eeebfc admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:46.617445 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8336256-2e60-4528-9c11-dac0656dfdfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:46.619500 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8336256-2e60-4528-9c11-dac0656dfdfa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:46.620190 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8336256-2e60-4528-9c11-dac0656dfdfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:46.620639 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8336256-2e60-4528-9c11-dac0656dfdfa admin admin] PATH_INFO: `/v3/projects/a94feb5a9416485295e2c8cc2291b266` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:46.622303 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8336256-2e60-4528-9c11-dac0656dfdfa admin admin] RBAC: Authorizing `identity:delete_project(project_id=a94feb5a9416485295e2c8cc2291b266)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:46.625111 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8336256-2e60-4528-9c11-dac0656dfdfa admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:46.700979 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6645bc2-d156-4922-b0f1-0f1f7252e808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:46.703524 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6645bc2-d156-4922-b0f1-0f1f7252e808 admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:46.704050 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6645bc2-d156-4922-b0f1-0f1f7252e808 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:46.704515 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6645bc2-d156-4922-b0f1-0f1f7252e808 admin admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:46.705721 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6645bc2-d156-4922-b0f1-0f1f7252e808 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:46.709743 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6645bc2-d156-4922-b0f1-0f1f7252e808 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:46.723130 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-d8336256-2e60-4528-9c11-dac0656dfdfa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a94feb5a9416485295e2c8cc2291b266', 'request_id': 'req-d8336256-2e60-4528-9c11-dac0656dfdfa'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:46.732109 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 922/1844] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:41:46 2022] GET /identity/v3/roles => generated 1420 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:41:46.734466 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0583e7e-377f-44dc-907f-1e69a24ac450 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:46.734859 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0583e7e-377f-44dc-907f-1e69a24ac450 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:46.735430 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0583e7e-377f-44dc-907f-1e69a24ac450 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:46.755571 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-d8336256-2e60-4528-9c11-dac0656dfdfa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a94feb5a9416485295e2c8cc2291b266', 'request_id': 'req-d8336256-2e60-4528-9c11-dac0656dfdfa'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:46.770970 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-a0583e7e-377f-44dc-907f-1e69a24ac450 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:41:46.773518 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-a0583e7e-377f-44dc-907f-1e69a24ac450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:46.786194 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-d8336256-2e60-4528-9c11-dac0656dfdfa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a94feb5a9416485295e2c8cc2291b266', 'request_id': 'req-d8336256-2e60-4528-9c11-dac0656dfdfa'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:46.826078 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:41:46.836706 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-d8336256-2e60-4528-9c11-dac0656dfdfa admin admin] The token cache is being invalidate because project a94feb5a9416485295e2c8cc2291b266 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80534) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:41:46.840219 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-d8336256-2e60-4528-9c11-dac0656dfdfa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:46.841978 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-d8336256-2e60-4528-9c11-dac0656dfdfa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:46.850533 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 923/1845] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jul 11 14:41:46 2022] DELETE /identity/v3/projects/a94feb5a9416485295e2c8cc2291b266 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:41:46.851831 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8336256-2e60-4528-9c11-dac0656dfdfa admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:46.854360 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-d8336256-2e60-4528-9c11-dac0656dfdfa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:46.949896 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 923/1846] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:41:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:41:46.950808 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0583e7e-377f-44dc-907f-1e69a24ac450 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:46.952506 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-a0583e7e-377f-44dc-907f-1e69a24ac450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:46.967390 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0583e7e-377f-44dc-907f-1e69a24ac450 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:46.972550 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76f47fe-cc86-48c2-8718-4958bb5d935d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:46.973728 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76f47fe-cc86-48c2-8718-4958bb5d935d admin admin] REQUEST_METHOD: `PUT` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:46.973728 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76f47fe-cc86-48c2-8718-4958bb5d935d admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:46.974026 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76f47fe-cc86-48c2-8718-4958bb5d935d admin admin] PATH_INFO: `/v3/projects/8aa47a1e9bc34463879e4b90657c70f2/users/8550342cff0b4cfb8a22974074c9cceb/roles/8eff41f243c843ed95505a488ca6eada` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:47.002322 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76f47fe-cc86-48c2-8718-4958bb5d935d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8aa47a1e9bc34463879e4b90657c70f2, user_id=8550342cff0b4cfb8a22974074c9cceb, role_id=8eff41f243c843ed95505a488ca6eada)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:47.009356 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76f47fe-cc86-48c2-8718-4958bb5d935d admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:47.014874 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8336256-2e60-4528-9c11-dac0656dfdfa admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:47.022197 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6569e85d-a87e-4c27-9b9d-24cb79f4b683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:47.023474 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6569e85d-a87e-4c27-9b9d-24cb79f4b683 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:47.023910 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6569e85d-a87e-4c27-9b9d-24cb79f4b683 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:47.024302 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6569e85d-a87e-4c27-9b9d-24cb79f4b683 admin admin] PATH_INFO: `/v3/projects/59c53191c6704cc39cc691f8ed5a8aae` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:47.026080 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6569e85d-a87e-4c27-9b9d-24cb79f4b683 admin admin] RBAC: Authorizing `identity:delete_project(project_id=59c53191c6704cc39cc691f8ed5a8aae)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:47.028325 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6569e85d-a87e-4c27-9b9d-24cb79f4b683 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:47.045430 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 924/1847] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jul 11 14:41:46 2022] PUT /identity/v3/projects/8aa47a1e9bc34463879e4b90657c70f2/users/8550342cff0b4cfb8a22974074c9cceb/roles/8eff41f243c843ed95505a488ca6eada => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:41:47.047254 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76f47fe-cc86-48c2-8718-4958bb5d935d admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:47.051477 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-e76f47fe-cc86-48c2-8718-4958bb5d935d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:47.118992 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-6569e85d-a87e-4c27-9b9d-24cb79f4b683 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59c53191c6704cc39cc691f8ed5a8aae', 'request_id': 'req-6569e85d-a87e-4c27-9b9d-24cb79f4b683'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:47.127827 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-6569e85d-a87e-4c27-9b9d-24cb79f4b683 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59c53191c6704cc39cc691f8ed5a8aae', 'request_id': 'req-6569e85d-a87e-4c27-9b9d-24cb79f4b683'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:47.130127 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:41:47.149540 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-6569e85d-a87e-4c27-9b9d-24cb79f4b683 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59c53191c6704cc39cc691f8ed5a8aae', 'request_id': 'req-6569e85d-a87e-4c27-9b9d-24cb79f4b683'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:47.184524 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76f47fe-cc86-48c2-8718-4958bb5d935d admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:47.186493 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-6569e85d-a87e-4c27-9b9d-24cb79f4b683 admin admin] The token cache is being invalidate because project 59c53191c6704cc39cc691f8ed5a8aae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80534) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:41:47.187320 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-6569e85d-a87e-4c27-9b9d-24cb79f4b683 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:47.188935 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-6569e85d-a87e-4c27-9b9d-24cb79f4b683 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:47.203507 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 924/1848] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jul 11 14:41:46 2022] DELETE /identity/v3/projects/59c53191c6704cc39cc691f8ed5a8aae => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:41:47.203507 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6569e85d-a87e-4c27-9b9d-24cb79f4b683 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:47.203507 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-6569e85d-a87e-4c27-9b9d-24cb79f4b683 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:47.326737 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11bb893-d3a2-4caa-81bf-5766b3272b34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:47.328795 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11bb893-d3a2-4caa-81bf-5766b3272b34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:47.329455 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11bb893-d3a2-4caa-81bf-5766b3272b34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:47.329866 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11bb893-d3a2-4caa-81bf-5766b3272b34 admin admin] PATH_INFO: `/v3/users/c88dd518b2ed47fb946e4e99498a6ff2` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:47.332504 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11bb893-d3a2-4caa-81bf-5766b3272b34 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c88dd518b2ed47fb946e4e99498a6ff2)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:47.335822 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11bb893-d3a2-4caa-81bf-5766b3272b34 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:47.366167 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6569e85d-a87e-4c27-9b9d-24cb79f4b683 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:47.374783 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7911dd49-6add-4256-9d2f-7066898ef7f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20eede5ccd834862b00123310b5c3975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:47.376282 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7911dd49-6add-4256-9d2f-7066898ef7f5 service neutron] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:47.376955 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7911dd49-6add-4256-9d2f-7066898ef7f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:47.377473 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7911dd49-6add-4256-9d2f-7066898ef7f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:47.384579 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-7911dd49-6add-4256-9d2f-7066898ef7f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:47.410911 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7911dd49-6add-4256-9d2f-7066898ef7f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:47.414438 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7911dd49-6add-4256-9d2f-7066898ef7f5 service neutron] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:47.432717 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-e11bb893-d3a2-4caa-81bf-5766b3272b34 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c88dd518b2ed47fb946e4e99498a6ff2'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:47.445459 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-e11bb893-d3a2-4caa-81bf-5766b3272b34 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c88dd518b2ed47fb946e4e99498a6ff2'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:47.456311 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 925/1849] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:41:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:41:47.463098 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c435f8-e9c0-4ef9-a75d-17677cda57b7 None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:47.463443 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-e11bb893-d3a2-4caa-81bf-5766b3272b34 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c88dd518b2ed47fb946e4e99498a6ff2'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:47.464602 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c435f8-e9c0-4ef9-a75d-17677cda57b7 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:47.464796 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-e11bb893-d3a2-4caa-81bf-5766b3272b34 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c88dd518b2ed47fb946e4e99498a6ff2'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:47.465478 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-e11bb893-d3a2-4caa-81bf-5766b3272b34 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c88dd518b2ed47fb946e4e99498a6ff2'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:47.466318 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c435f8-e9c0-4ef9-a75d-17677cda57b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:47.498618 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 925/1850] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jul 11 14:41:47 2022] DELETE /identity/v3/users/c88dd518b2ed47fb946e4e99498a6ff2 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:41:47.498618 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4acd438-b52f-4d8d-a097-75f115db7909 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:47.498618 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4acd438-b52f-4d8d-a097-75f115db7909 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:47.498618 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4acd438-b52f-4d8d-a097-75f115db7909 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:47.524154 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-c4acd438-b52f-4d8d-a097-75f115db7909 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:41:47.526069 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-c4acd438-b52f-4d8d-a097-75f115db7909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:47.581856 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-32c435f8-e9c0-4ef9-a75d-17677cda57b7 None None] MFA Rules not processed for user `8550342cff0b4cfb8a22974074c9cceb`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:41:47.583283 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-32c435f8-e9c0-4ef9-a75d-17677cda57b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:47.614998 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:41:47.622466 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:41:47.644223 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 926/1851] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:41:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:41:47.654228 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ca23ee-19ad-48fa-b056-3021528b4c76 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:47.654877 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ca23ee-19ad-48fa-b056-3021528b4c76 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:47.655526 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ca23ee-19ad-48fa-b056-3021528b4c76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:47.703183 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-d8ca23ee-19ad-48fa-b056-3021528b4c76 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:41:47.709172 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-d8ca23ee-19ad-48fa-b056-3021528b4c76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:47.732586 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 927/1852] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:41:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:41:47.739734 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ca23ee-19ad-48fa-b056-3021528b4c76 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:47.761483 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 926/1853] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:41:47 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:41:47.769147 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c435f8-e9c0-4ef9-a75d-17677cda57b7 None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:47.772405 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ca23ee-19ad-48fa-b056-3021528b4c76 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:47.775183 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-32c435f8-e9c0-4ef9-a75d-17677cda57b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:47.789003 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e88b422-db93-442e-b1a6-b451e84343b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:47.789861 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e88b422-db93-442e-b1a6-b451e84343b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:47.793603 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e88b422-db93-442e-b1a6-b451e84343b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:47.794084 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e88b422-db93-442e-b1a6-b451e84343b3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:47.794959 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e88b422-db93-442e-b1a6-b451e84343b3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:41:47.795378 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e88b422-db93-442e-b1a6-b451e84343b3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:47.798340 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e88b422-db93-442e-b1a6-b451e84343b3 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:47.810548 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c435f8-e9c0-4ef9-a75d-17677cda57b7 None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:47.824463 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4c03ce-69a3-4e69-859e-c12fe2252f48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:47.826330 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4c03ce-69a3-4e69-859e-c12fe2252f48 admin admin] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:47.827225 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4c03ce-69a3-4e69-859e-c12fe2252f48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:47.828087 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4c03ce-69a3-4e69-859e-c12fe2252f48 admin admin] PATH_INFO: `/v3/projects` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:47.830787 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4c03ce-69a3-4e69-859e-c12fe2252f48 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:47.832676 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 928/1854] 10.222.0.70 () {58 vars in 1152 bytes} [Mon Jul 11 14:41:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:41:47.834873 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4c03ce-69a3-4e69-859e-c12fe2252f48 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:47.837200 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e88b422-db93-442e-b1a6-b451e84343b3 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:47.865391 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e88b422-db93-442e-b1a6-b451e84343b3 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:47.880845 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8743dcf-bf2c-459f-88e8-6ae760a2f009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:47.882053 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8743dcf-bf2c-459f-88e8-6ae760a2f009 admin admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:47.884174 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8743dcf-bf2c-459f-88e8-6ae760a2f009 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:47.884846 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8743dcf-bf2c-459f-88e8-6ae760a2f009 admin admin] PATH_INFO: `/v3/projects` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:47.889656 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8743dcf-bf2c-459f-88e8-6ae760a2f009 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:47.892979 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8743dcf-bf2c-459f-88e8-6ae760a2f009 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:47.908267 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 927/1855] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jul 11 14:41:47 2022] POST /identity/v3/projects => generated 391 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:41:47.912712 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4c03ce-69a3-4e69-859e-c12fe2252f48 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:47.966157 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 929/1856] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jul 11 14:41:47 2022] POST /identity/v3/projects => generated 383 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:41:47.974806 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8743dcf-bf2c-459f-88e8-6ae760a2f009 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:48.138661 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4c03ce-69a3-4e69-859e-c12fe2252f48 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:48.171805 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8743dcf-bf2c-459f-88e8-6ae760a2f009 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:48.185578 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbbe22b-dd38-409c-98cb-15b274336d9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:48.186872 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbbe22b-dd38-409c-98cb-15b274336d9f admin admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:48.188393 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbbe22b-dd38-409c-98cb-15b274336d9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:48.188891 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbbe22b-dd38-409c-98cb-15b274336d9f admin admin] PATH_INFO: `/v3/users` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:48.190399 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbbe22b-dd38-409c-98cb-15b274336d9f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:48.197813 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbbe22b-dd38-409c-98cb-15b274336d9f admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:48.242764 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 930/1857] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jul 11 14:41:47 2022] POST /identity/v3/users => generated 292 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:41:48.247637 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbbe22b-dd38-409c-98cb-15b274336d9f admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:48.262488 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbbe22b-dd38-409c-98cb-15b274336d9f admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:48.272957 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198914c2-0fd0-4081-aad7-a905e993833e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:48.273770 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198914c2-0fd0-4081-aad7-a905e993833e admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:48.274062 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198914c2-0fd0-4081-aad7-a905e993833e admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:48.274345 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198914c2-0fd0-4081-aad7-a905e993833e admin admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:48.275660 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198914c2-0fd0-4081-aad7-a905e993833e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:48.282076 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198914c2-0fd0-4081-aad7-a905e993833e admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:48.302375 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 931/1858] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:41:48 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:41:48.307857 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198914c2-0fd0-4081-aad7-a905e993833e admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:48.322514 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198914c2-0fd0-4081-aad7-a905e993833e admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:48.330069 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fcc024-1fa2-4699-be31-3de65fe5d258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:48.331130 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fcc024-1fa2-4699-be31-3de65fe5d258 admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:48.331130 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fcc024-1fa2-4699-be31-3de65fe5d258 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:48.331130 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fcc024-1fa2-4699-be31-3de65fe5d258 admin admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:48.332197 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fcc024-1fa2-4699-be31-3de65fe5d258 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:48.333938 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fcc024-1fa2-4699-be31-3de65fe5d258 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:48.350349 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 932/1859] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:41:48 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 14:41:48.356600 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fcc024-1fa2-4699-be31-3de65fe5d258 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:48.366574 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0156700-8908-4a07-8269-91f136f6b738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:48.369802 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0156700-8908-4a07-8269-91f136f6b738 admin admin] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:48.370370 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0156700-8908-4a07-8269-91f136f6b738 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:48.370849 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0156700-8908-4a07-8269-91f136f6b738 admin admin] PATH_INFO: `/v3/users` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:48.371588 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fcc024-1fa2-4699-be31-3de65fe5d258 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:48.381685 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0156700-8908-4a07-8269-91f136f6b738 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:48.384423 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0156700-8908-4a07-8269-91f136f6b738 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:48.390390 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff76839-1df0-4192-b997-bff496d9d879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:48.391516 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff76839-1df0-4192-b997-bff496d9d879 admin admin] REQUEST_METHOD: `PUT` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:48.392062 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff76839-1df0-4192-b997-bff496d9d879 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:48.393962 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff76839-1df0-4192-b997-bff496d9d879 admin admin] PATH_INFO: `/v3/projects/ec67a91710df4b82a134073bbe01f060/users/c8ddfd59886d40c9a3333267de426311/roles/8eff41f243c843ed95505a488ca6eada` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:48.432610 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 928/1860] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jul 11 14:41:47 2022] POST /identity/v3/users => generated 302 bytes in 518 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:41:48.434838 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0156700-8908-4a07-8269-91f136f6b738 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:48.444840 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff76839-1df0-4192-b997-bff496d9d879 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec67a91710df4b82a134073bbe01f060, user_id=c8ddfd59886d40c9a3333267de426311, role_id=8eff41f243c843ed95505a488ca6eada)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:48.454020 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff76839-1df0-4192-b997-bff496d9d879 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:48.454491 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0156700-8908-4a07-8269-91f136f6b738 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:48.466762 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7c3d1c-6f54-4d5b-9a0f-8b603a99030e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:48.467726 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7c3d1c-6f54-4d5b-9a0f-8b603a99030e admin admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:48.468018 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7c3d1c-6f54-4d5b-9a0f-8b603a99030e admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:48.468395 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7c3d1c-6f54-4d5b-9a0f-8b603a99030e admin admin] PATH_INFO: `/v3/roles` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:48.469170 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7c3d1c-6f54-4d5b-9a0f-8b603a99030e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:48.471014 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7c3d1c-6f54-4d5b-9a0f-8b603a99030e admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:48.490098 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 933/1861] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jul 11 14:41:48 2022] PUT /identity/v3/projects/ec67a91710df4b82a134073bbe01f060/users/c8ddfd59886d40c9a3333267de426311/roles/8eff41f243c843ed95505a488ca6eada => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:41:48.494198 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 929/1862] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:41:48 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 14:41:48.496097 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff76839-1df0-4192-b997-bff496d9d879 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:48.502629 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0653a5a6-00e8-4f9a-bf09-b34f655e86dc None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:48.502936 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0653a5a6-00e8-4f9a-bf09-b34f655e86dc None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:48.503204 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0653a5a6-00e8-4f9a-bf09-b34f655e86dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:48.560848 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-0653a5a6-00e8-4f9a-bf09-b34f655e86dc None None] MFA Rules not processed for user `c8ddfd59886d40c9a3333267de426311`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:41:48.562121 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-0653a5a6-00e8-4f9a-bf09-b34f655e86dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:48.589160 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:41:48.660524 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:41:48.670663 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff76839-1df0-4192-b997-bff496d9d879 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:48.684267 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485ef870-1b47-4f7c-9b3c-9fe03e281a5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:48.691574 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485ef870-1b47-4f7c-9b3c-9fe03e281a5c admin admin] REQUEST_METHOD: `PUT` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:48.693921 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485ef870-1b47-4f7c-9b3c-9fe03e281a5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:48.695059 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485ef870-1b47-4f7c-9b3c-9fe03e281a5c admin admin] PATH_INFO: `/v3/projects/474d8a1240584520bcc49805ad720234/users/5b92e0618ed14f11a55592cb927f14f5/roles/b46df176b0fe479da63c318db225bed4` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:48.734573 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485ef870-1b47-4f7c-9b3c-9fe03e281a5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=474d8a1240584520bcc49805ad720234, user_id=5b92e0618ed14f11a55592cb927f14f5, role_id=b46df176b0fe479da63c318db225bed4)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:48.738362 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485ef870-1b47-4f7c-9b3c-9fe03e281a5c admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:48.747530 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 930/1863] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:41:48 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:41:48.748805 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0653a5a6-00e8-4f9a-bf09-b34f655e86dc None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:48.776494 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 934/1864] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jul 11 14:41:48 2022] PUT /identity/v3/projects/474d8a1240584520bcc49805ad720234/users/5b92e0618ed14f11a55592cb927f14f5/roles/b46df176b0fe479da63c318db225bed4 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:41:48.786341 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0653a5a6-00e8-4f9a-bf09-b34f655e86dc None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:48.801615 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485ef870-1b47-4f7c-9b3c-9fe03e281a5c admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:48.934127 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc8b6d2-27fc-4295-989d-52597f19c81d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:48.935701 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc8b6d2-27fc-4295-989d-52597f19c81d admin admin] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:48.936289 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc8b6d2-27fc-4295-989d-52597f19c81d admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:48.936991 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc8b6d2-27fc-4295-989d-52597f19c81d admin admin] PATH_INFO: `/v3/projects` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:48.937680 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc8b6d2-27fc-4295-989d-52597f19c81d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:48.939179 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485ef870-1b47-4f7c-9b3c-9fe03e281a5c admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:48.940577 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc8b6d2-27fc-4295-989d-52597f19c81d admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:48.944804 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c635bbdb-ee57-4d79-806e-588ffd0a06f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:48.945926 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c635bbdb-ee57-4d79-806e-588ffd0a06f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:48.946443 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c635bbdb-ee57-4d79-806e-588ffd0a06f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:48.946969 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c635bbdb-ee57-4d79-806e-588ffd0a06f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:48.948012 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c635bbdb-ee57-4d79-806e-588ffd0a06f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:48.950030 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c635bbdb-ee57-4d79-806e-588ffd0a06f8 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:48.970554 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 935/1865] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:41:48 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:41:48.975738 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c635bbdb-ee57-4d79-806e-588ffd0a06f8 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:48.991747 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 931/1866] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jul 11 14:41:48 2022] POST /identity/v3/projects => generated 383 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:41:48.997370 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc8b6d2-27fc-4295-989d-52597f19c81d admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:49.000802 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c635bbdb-ee57-4d79-806e-588ffd0a06f8 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:49.088714 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc8b6d2-27fc-4295-989d-52597f19c81d admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:49.097504 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5777272-41bb-4cd0-957d-fed7f86875c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:49.101637 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5777272-41bb-4cd0-957d-fed7f86875c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:49.101901 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5777272-41bb-4cd0-957d-fed7f86875c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:49.102176 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5777272-41bb-4cd0-957d-fed7f86875c6 admin admin] PATH_INFO: `/v3/projects/474d8a1240584520bcc49805ad720234/users/5b92e0618ed14f11a55592cb927f14f5/roles/b46df176b0fe479da63c318db225bed4` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:49.111680 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5777272-41bb-4cd0-957d-fed7f86875c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=474d8a1240584520bcc49805ad720234, user_id=5b92e0618ed14f11a55592cb927f14f5, role_id=b46df176b0fe479da63c318db225bed4)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:49.115164 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5777272-41bb-4cd0-957d-fed7f86875c6 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:49.121976 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856bd1b7-a342-4353-b876-8606d0355a8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:49.122685 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856bd1b7-a342-4353-b876-8606d0355a8c admin admin] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:49.122960 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856bd1b7-a342-4353-b876-8606d0355a8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:49.123244 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856bd1b7-a342-4353-b876-8606d0355a8c admin admin] PATH_INFO: `/v3/users` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:49.124689 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856bd1b7-a342-4353-b876-8606d0355a8c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:49.126556 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856bd1b7-a342-4353-b876-8606d0355a8c admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:49.131744 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 936/1867] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jul 11 14:41:48 2022] PUT /identity/v3/projects/474d8a1240584520bcc49805ad720234/users/5b92e0618ed14f11a55592cb927f14f5/roles/b46df176b0fe479da63c318db225bed4 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:41:49.143240 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe19e49-55b9-4478-8df8-5d1a004c6c7c None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:49.144017 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe19e49-55b9-4478-8df8-5d1a004c6c7c None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:49.144515 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe19e49-55b9-4478-8df8-5d1a004c6c7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:49.194712 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-dfe19e49-55b9-4478-8df8-5d1a004c6c7c None None] MFA Rules not processed for user `5b92e0618ed14f11a55592cb927f14f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:41:49.196769 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-dfe19e49-55b9-4478-8df8-5d1a004c6c7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:49.199884 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 932/1868] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jul 11 14:41:48 2022] POST /identity/v3/users => generated 298 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:41:49.204648 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856bd1b7-a342-4353-b876-8606d0355a8c admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:49.256085 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856bd1b7-a342-4353-b876-8606d0355a8c admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:49.300586 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:41:49.313245 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:41:49.330240 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 937/1869] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:41:49 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:41:49.345294 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe19e49-55b9-4478-8df8-5d1a004c6c7c None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:49.347435 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-dfe19e49-55b9-4478-8df8-5d1a004c6c7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:49.365910 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ba6df7-6a15-4d36-876a-0543f3905e50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:49.366967 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ba6df7-6a15-4d36-876a-0543f3905e50 admin admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:49.367547 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ba6df7-6a15-4d36-876a-0543f3905e50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:49.367547 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ba6df7-6a15-4d36-876a-0543f3905e50 admin admin] PATH_INFO: `/v3/roles` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:49.369110 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ba6df7-6a15-4d36-876a-0543f3905e50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:49.382983 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ba6df7-6a15-4d36-876a-0543f3905e50 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:49.410172 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 933/1870] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:41:49 2022] GET /identity/v3/roles => generated 1420 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:41:49.417233 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ba6df7-6a15-4d36-876a-0543f3905e50 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:49.435924 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ba6df7-6a15-4d36-876a-0543f3905e50 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:49.450203 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c917c5d-0dd6-4113-aff1-21dabf2a9559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:49.451138 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c917c5d-0dd6-4113-aff1-21dabf2a9559 admin admin] REQUEST_METHOD: `PUT` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:49.451427 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c917c5d-0dd6-4113-aff1-21dabf2a9559 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:49.451709 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c917c5d-0dd6-4113-aff1-21dabf2a9559 admin admin] PATH_INFO: `/v3/projects/6d0a3c0964614962bafd5c0851119f9a/users/3fe04744e8c94f9480e9151d059484ca/roles/b46df176b0fe479da63c318db225bed4` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:49.461628 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe19e49-55b9-4478-8df8-5d1a004c6c7c None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:49.467182 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227a8da3-e1b6-486e-95cb-8a89e3ae478a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '868e7c2dec264512b972c8736d659c34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:49.468545 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227a8da3-e1b6-486e-95cb-8a89e3ae478a service cinder] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:49.469062 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227a8da3-e1b6-486e-95cb-8a89e3ae478a service cinder] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:49.469531 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227a8da3-e1b6-486e-95cb-8a89e3ae478a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:49.488965 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227a8da3-e1b6-486e-95cb-8a89e3ae478a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:49.490492 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227a8da3-e1b6-486e-95cb-8a89e3ae478a service cinder] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:49.491275 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c917c5d-0dd6-4113-aff1-21dabf2a9559 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d0a3c0964614962bafd5c0851119f9a, user_id=3fe04744e8c94f9480e9151d059484ca, role_id=b46df176b0fe479da63c318db225bed4)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:49.495885 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c917c5d-0dd6-4113-aff1-21dabf2a9559 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:49.503792 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 938/1871] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:41:49 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:41:49.511562 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227a8da3-e1b6-486e-95cb-8a89e3ae478a service cinder] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:49.513165 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-227a8da3-e1b6-486e-95cb-8a89e3ae478a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:49.532830 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227a8da3-e1b6-486e-95cb-8a89e3ae478a service cinder] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:49.558353 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 934/1872] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jul 11 14:41:49 2022] PUT /identity/v3/projects/6d0a3c0964614962bafd5c0851119f9a/users/3fe04744e8c94f9480e9151d059484ca/roles/b46df176b0fe479da63c318db225bed4 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:41:49.560570 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c917c5d-0dd6-4113-aff1-21dabf2a9559 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:49.651364 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c59015-6d62-49ae-801e-ff7667604a2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:49.653583 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c59015-6d62-49ae-801e-ff7667604a2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:49.654356 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c59015-6d62-49ae-801e-ff7667604a2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:49.654903 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c59015-6d62-49ae-801e-ff7667604a2f admin admin] PATH_INFO: `/v3/projects/6e2f4af802a54c4ea6e5c1f59a618f1c` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:49.656673 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c59015-6d62-49ae-801e-ff7667604a2f admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e2f4af802a54c4ea6e5c1f59a618f1c)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:49.659473 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c59015-6d62-49ae-801e-ff7667604a2f admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:49.712535 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c917c5d-0dd6-4113-aff1-21dabf2a9559 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:49.720840 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac856d3a-452e-40b7-a2be-85e784136477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:49.721592 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac856d3a-452e-40b7-a2be-85e784136477 admin admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:49.722039 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac856d3a-452e-40b7-a2be-85e784136477 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:49.722749 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac856d3a-452e-40b7-a2be-85e784136477 admin admin] PATH_INFO: `/v3/roles` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:49.723686 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac856d3a-452e-40b7-a2be-85e784136477 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:49.726172 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac856d3a-452e-40b7-a2be-85e784136477 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:49.738558 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 935/1873] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:41:49 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:41:49.739430 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac856d3a-452e-40b7-a2be-85e784136477 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:49.742195 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-ac856d3a-452e-40b7-a2be-85e784136477 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:49.775452 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-26c59015-6d62-49ae-801e-ff7667604a2f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e2f4af802a54c4ea6e5c1f59a618f1c', 'request_id': 'req-26c59015-6d62-49ae-801e-ff7667604a2f'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:49.809650 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-26c59015-6d62-49ae-801e-ff7667604a2f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e2f4af802a54c4ea6e5c1f59a618f1c', 'request_id': 'req-26c59015-6d62-49ae-801e-ff7667604a2f'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:49.823570 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-26c59015-6d62-49ae-801e-ff7667604a2f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e2f4af802a54c4ea6e5c1f59a618f1c', 'request_id': 'req-26c59015-6d62-49ae-801e-ff7667604a2f'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:49.826159 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac856d3a-452e-40b7-a2be-85e784136477 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:49.855343 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-26c59015-6d62-49ae-801e-ff7667604a2f admin admin] The token cache is being invalidate because project 6e2f4af802a54c4ea6e5c1f59a618f1c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:41:49.857996 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-26c59015-6d62-49ae-801e-ff7667604a2f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:49.863661 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-26c59015-6d62-49ae-801e-ff7667604a2f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:49.886005 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 939/1874] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jul 11 14:41:49 2022] DELETE /identity/v3/projects/6e2f4af802a54c4ea6e5c1f59a618f1c => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:41:49.887446 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c59015-6d62-49ae-801e-ff7667604a2f admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:49.895062 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-26c59015-6d62-49ae-801e-ff7667604a2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:49.927476 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee720f1a-64c0-48f5-a281-61b54471e1fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '868e7c2dec264512b972c8736d659c34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:49.928488 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee720f1a-64c0-48f5-a281-61b54471e1fd service cinder] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:49.928943 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee720f1a-64c0-48f5-a281-61b54471e1fd service cinder] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:49.929360 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee720f1a-64c0-48f5-a281-61b54471e1fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:49.933363 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-ee720f1a-64c0-48f5-a281-61b54471e1fd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:49.949716 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:41:50.021675 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:41:50.022648 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee720f1a-64c0-48f5-a281-61b54471e1fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:50.024894 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee720f1a-64c0-48f5-a281-61b54471e1fd service cinder] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:50.041901 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 936/1875] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:41:49 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:41:50.044636 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ebabf0-3594-4aa5-9a55-8d89a7045b6e None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:50.045203 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ebabf0-3594-4aa5-9a55-8d89a7045b6e None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:50.045563 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ebabf0-3594-4aa5-9a55-8d89a7045b6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:50.072375 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-a6ebabf0-3594-4aa5-9a55-8d89a7045b6e None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:41:50.074908 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-a6ebabf0-3594-4aa5-9a55-8d89a7045b6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:50.144795 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c59015-6d62-49ae-801e-ff7667604a2f admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:50.153013 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cd5ab7-603c-4fa4-922e-52651386f249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:50.154170 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cd5ab7-603c-4fa4-922e-52651386f249 admin admin] REQUEST_METHOD: `PUT` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:50.154531 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cd5ab7-603c-4fa4-922e-52651386f249 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:50.154882 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cd5ab7-603c-4fa4-922e-52651386f249 admin admin] PATH_INFO: `/v3/projects/6d0a3c0964614962bafd5c0851119f9a/users/3fe04744e8c94f9480e9151d059484ca/roles/b46df176b0fe479da63c318db225bed4` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:50.163941 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cd5ab7-603c-4fa4-922e-52651386f249 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d0a3c0964614962bafd5c0851119f9a, user_id=3fe04744e8c94f9480e9151d059484ca, role_id=b46df176b0fe479da63c318db225bed4)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:50.168888 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cd5ab7-603c-4fa4-922e-52651386f249 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:50.186034 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 940/1876] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jul 11 14:41:49 2022] PUT /identity/v3/projects/6d0a3c0964614962bafd5c0851119f9a/users/3fe04744e8c94f9480e9151d059484ca/roles/b46df176b0fe479da63c318db225bed4 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:41:50.209674 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ef1380-9be1-4c1e-b799-f9e584f91248 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:50.210308 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ef1380-9be1-4c1e-b799-f9e584f91248 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:50.212879 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ef1380-9be1-4c1e-b799-f9e584f91248 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:50.222579 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 937/1877] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:41:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:41:50.235766 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5729ec-baad-4b52-ae06-ff64e53bf353 None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:50.236137 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5729ec-baad-4b52-ae06-ff64e53bf353 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:50.236782 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5729ec-baad-4b52-ae06-ff64e53bf353 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:50.261566 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-1c5729ec-baad-4b52-ae06-ff64e53bf353 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:41:50.262931 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-1c5729ec-baad-4b52-ae06-ff64e53bf353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:50.287482 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-d0ef1380-9be1-4c1e-b799-f9e584f91248 None None] MFA Rules not processed for user `3fe04744e8c94f9480e9151d059484ca`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:41:50.299371 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-d0ef1380-9be1-4c1e-b799-f9e584f91248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:50.351079 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 938/1878] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:41:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:41:50.352240 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5729ec-baad-4b52-ae06-ff64e53bf353 None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:50.364476 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5729ec-baad-4b52-ae06-ff64e53bf353 None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:50.370664 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd2f7f4-644e-4244-944d-584ca3e5204f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:50.372223 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd2f7f4-644e-4244-944d-584ca3e5204f admin admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:50.372610 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd2f7f4-644e-4244-944d-584ca3e5204f admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:50.373036 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd2f7f4-644e-4244-944d-584ca3e5204f admin admin] PATH_INFO: `/v3/domains` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:50.373910 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd2f7f4-644e-4244-944d-584ca3e5204f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:41:50.374309 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd2f7f4-644e-4244-944d-584ca3e5204f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:50.376410 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd2f7f4-644e-4244-944d-584ca3e5204f admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:50.391375 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 939/1879] 10.222.0.70 () {58 vars in 1152 bytes} [Mon Jul 11 14:41:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:41:50.400774 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd2f7f4-644e-4244-944d-584ca3e5204f admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:50.439150 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd2f7f4-644e-4244-944d-584ca3e5204f admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:50.447091 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c432adb3-fa58-4767-9085-a65aa147c56b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:50.448779 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c432adb3-fa58-4767-9085-a65aa147c56b admin admin] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:50.449434 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c432adb3-fa58-4767-9085-a65aa147c56b admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:50.450363 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c432adb3-fa58-4767-9085-a65aa147c56b admin admin] PATH_INFO: `/v3/projects` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:50.451929 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c432adb3-fa58-4767-9085-a65aa147c56b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:50.455821 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c432adb3-fa58-4767-9085-a65aa147c56b admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:50.501569 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 941/1880] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:41:50 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:41:50.514043 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ef1380-9be1-4c1e-b799-f9e584f91248 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:50.517298 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-d0ef1380-9be1-4c1e-b799-f9e584f91248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:50.529893 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 940/1881] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jul 11 14:41:50 2022] POST /identity/v3/projects => generated 387 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:41:50.531032 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c432adb3-fa58-4767-9085-a65aa147c56b admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:50.570547 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:41:50.637774 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ef1380-9be1-4c1e-b799-f9e584f91248 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:50.704517 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c432adb3-fa58-4767-9085-a65aa147c56b admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:50.709730 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e0a983-1725-49e2-bf50-333e7ee5f979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:50.710423 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e0a983-1725-49e2-bf50-333e7ee5f979 admin admin] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:50.710710 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e0a983-1725-49e2-bf50-333e7ee5f979 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:50.711007 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e0a983-1725-49e2-bf50-333e7ee5f979 admin admin] PATH_INFO: `/v3/users` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:50.712058 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e0a983-1725-49e2-bf50-333e7ee5f979 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:50.714739 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e0a983-1725-49e2-bf50-333e7ee5f979 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:50.742545 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 941/1882] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jul 11 14:41:50 2022] POST /identity/v3/users => generated 294 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:41:50.748128 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e0a983-1725-49e2-bf50-333e7ee5f979 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:50.771647 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55319c34-d94f-49ba-85a4-20c634a564a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '868e7c2dec264512b972c8736d659c34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:50.774212 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55319c34-d94f-49ba-85a4-20c634a564a5 service cinder] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:50.774770 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55319c34-d94f-49ba-85a4-20c634a564a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:50.779862 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55319c34-d94f-49ba-85a4-20c634a564a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:50.800190 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e0a983-1725-49e2-bf50-333e7ee5f979 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:50.826844 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:41:50.851407 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f62ddd3-fe83-48b7-8477-4a05cd5dee30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:50.861449 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f62ddd3-fe83-48b7-8477-4a05cd5dee30 admin admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:50.866211 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f62ddd3-fe83-48b7-8477-4a05cd5dee30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:50.866565 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f62ddd3-fe83-48b7-8477-4a05cd5dee30 admin admin] PATH_INFO: `/v3/roles` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:50.872960 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f62ddd3-fe83-48b7-8477-4a05cd5dee30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:50.887628 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f62ddd3-fe83-48b7-8477-4a05cd5dee30 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:50.943902 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 942/1883] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:41:50 2022] GET /identity/v3/roles => generated 1420 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 14:41:50.944114 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55319c34-d94f-49ba-85a4-20c634a564a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:50.947646 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f62ddd3-fe83-48b7-8477-4a05cd5dee30 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:50.949700 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55319c34-d94f-49ba-85a4-20c634a564a5 service cinder] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:50.956417 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-9f62ddd3-fe83-48b7-8477-4a05cd5dee30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:50.984629 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 942/1884] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:41:50 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:41:50.986478 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55319c34-d94f-49ba-85a4-20c634a564a5 service cinder] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:51.009240 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55319c34-d94f-49ba-85a4-20c634a564a5 service cinder] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:51.013497 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f62ddd3-fe83-48b7-8477-4a05cd5dee30 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:51.015712 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaec4c7e-e1d4-4c1f-b5bd-67e8df04f73e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:51.016647 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaec4c7e-e1d4-4c1f-b5bd-67e8df04f73e admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:51.016994 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaec4c7e-e1d4-4c1f-b5bd-67e8df04f73e admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:51.017172 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaec4c7e-e1d4-4c1f-b5bd-67e8df04f73e admin admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:51.017988 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaec4c7e-e1d4-4c1f-b5bd-67e8df04f73e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:51.019654 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaec4c7e-e1d4-4c1f-b5bd-67e8df04f73e admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:51.037177 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f117741f-96c3-4b74-adc7-4572c7c9937b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:51.042469 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f117741f-96c3-4b74-adc7-4572c7c9937b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:51.043920 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 943/1885] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:41:50 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:41:51.044144 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f117741f-96c3-4b74-adc7-4572c7c9937b admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:51.045766 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f117741f-96c3-4b74-adc7-4572c7c9937b admin admin] PATH_INFO: `/v3/projects/690b095f0a79431d99d52bedc3a82bf5` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:51.048283 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaec4c7e-e1d4-4c1f-b5bd-67e8df04f73e admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:51.050660 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f117741f-96c3-4b74-adc7-4572c7c9937b admin admin] RBAC: Authorizing `identity:delete_project(project_id=690b095f0a79431d99d52bedc3a82bf5)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:51.054919 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f117741f-96c3-4b74-adc7-4572c7c9937b admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:51.081641 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaec4c7e-e1d4-4c1f-b5bd-67e8df04f73e admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:51.095456 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c4efc5-1b51-475d-88c2-7045e56d8598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:51.096349 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c4efc5-1b51-475d-88c2-7045e56d8598 admin admin] REQUEST_METHOD: `PUT` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:51.097546 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c4efc5-1b51-475d-88c2-7045e56d8598 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:51.097838 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c4efc5-1b51-475d-88c2-7045e56d8598 admin admin] PATH_INFO: `/v3/projects/06032a6a2be249eab27322e187990332/users/da60ca2559c04cd4b6fd36797fda64f9/roles/8eff41f243c843ed95505a488ca6eada` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:51.177752 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c4efc5-1b51-475d-88c2-7045e56d8598 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06032a6a2be249eab27322e187990332, user_id=da60ca2559c04cd4b6fd36797fda64f9, role_id=8eff41f243c843ed95505a488ca6eada)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:51.187131 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c4efc5-1b51-475d-88c2-7045e56d8598 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:51.187506 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-f117741f-96c3-4b74-adc7-4572c7c9937b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '690b095f0a79431d99d52bedc3a82bf5', 'request_id': 'req-f117741f-96c3-4b74-adc7-4572c7c9937b'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:51.204588 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-f117741f-96c3-4b74-adc7-4572c7c9937b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '690b095f0a79431d99d52bedc3a82bf5', 'request_id': 'req-f117741f-96c3-4b74-adc7-4572c7c9937b'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:51.215471 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 944/1886] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jul 11 14:41:51 2022] PUT /identity/v3/projects/06032a6a2be249eab27322e187990332/users/da60ca2559c04cd4b6fd36797fda64f9/roles/8eff41f243c843ed95505a488ca6eada => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:41:51.218265 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c4efc5-1b51-475d-88c2-7045e56d8598 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:51.220745 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-f117741f-96c3-4b74-adc7-4572c7c9937b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '690b095f0a79431d99d52bedc3a82bf5', 'request_id': 'req-f117741f-96c3-4b74-adc7-4572c7c9937b'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:51.244573 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-f117741f-96c3-4b74-adc7-4572c7c9937b admin admin] The token cache is being invalidate because project 690b095f0a79431d99d52bedc3a82bf5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80534) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:41:51.249191 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-f117741f-96c3-4b74-adc7-4572c7c9937b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:51.251543 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-f117741f-96c3-4b74-adc7-4572c7c9937b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:51.254376 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 943/1887] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jul 11 14:41:50 2022] DELETE /identity/v3/projects/690b095f0a79431d99d52bedc3a82bf5 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:41:51.261022 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737a0a9b-ffde-4269-a323-e9c4ab2820ed None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:51.261358 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737a0a9b-ffde-4269-a323-e9c4ab2820ed None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:51.261638 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737a0a9b-ffde-4269-a323-e9c4ab2820ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:51.327440 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-737a0a9b-ffde-4269-a323-e9c4ab2820ed None None] MFA Rules not processed for user `da60ca2559c04cd4b6fd36797fda64f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:41:51.332956 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-737a0a9b-ffde-4269-a323-e9c4ab2820ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:51.363057 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c4efc5-1b51-475d-88c2-7045e56d8598 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:51.377742 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692809a1-d015-4c60-a3b0-b0103ac48a63 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '868e7c2dec264512b972c8736d659c34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:51.378621 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692809a1-d015-4c60-a3b0-b0103ac48a63 service cinder] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:51.379095 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692809a1-d015-4c60-a3b0-b0103ac48a63 service cinder] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:51.379652 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692809a1-d015-4c60-a3b0-b0103ac48a63 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:51.386124 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-692809a1-d015-4c60-a3b0-b0103ac48a63 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:51.473589 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 944/1888] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:41:51 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:41:51.474526 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737a0a9b-ffde-4269-a323-e9c4ab2820ed None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:51.482365 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-737a0a9b-ffde-4269-a323-e9c4ab2820ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:51.515261 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:41:51.515644 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692809a1-d015-4c60-a3b0-b0103ac48a63 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:51.518193 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692809a1-d015-4c60-a3b0-b0103ac48a63 service cinder] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:51.532330 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 945/1889] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:41:51 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:41:51.533250 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692809a1-d015-4c60-a3b0-b0103ac48a63 service cinder] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:51.535163 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-692809a1-d015-4c60-a3b0-b0103ac48a63 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:51.628727 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:41:51.676487 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737a0a9b-ffde-4269-a323-e9c4ab2820ed None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:51.698826 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2521c9-b212-4069-a851-debbd3d1a9f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:51.702143 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2521c9-b212-4069-a851-debbd3d1a9f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:51.704734 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2521c9-b212-4069-a851-debbd3d1a9f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:51.704734 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2521c9-b212-4069-a851-debbd3d1a9f2 admin admin] PATH_INFO: `/v3/users/4a1a65b0784d474ab01b710b7e482afd` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:51.708402 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2521c9-b212-4069-a851-debbd3d1a9f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a1a65b0784d474ab01b710b7e482afd)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:51.724082 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2521c9-b212-4069-a851-debbd3d1a9f2 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:51.729598 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692809a1-d015-4c60-a3b0-b0103ac48a63 service cinder] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:51.746266 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1cd16d-429e-4e0d-bbd5-a2f8a8b07724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:51.746997 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1cd16d-429e-4e0d-bbd5-a2f8a8b07724 admin admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:51.747281 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1cd16d-429e-4e0d-bbd5-a2f8a8b07724 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:51.747559 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1cd16d-429e-4e0d-bbd5-a2f8a8b07724 admin admin] PATH_INFO: `/v3/projects` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:51.748336 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1cd16d-429e-4e0d-bbd5-a2f8a8b07724 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:51.756169 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1cd16d-429e-4e0d-bbd5-a2f8a8b07724 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:51.817206 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-ac2521c9-b212-4069-a851-debbd3d1a9f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a1a65b0784d474ab01b710b7e482afd'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:51.829072 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 946/1890] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jul 11 14:41:51 2022] POST /identity/v3/projects => generated 385 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:41:51.833180 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1cd16d-429e-4e0d-bbd5-a2f8a8b07724 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:51.833387 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-ac2521c9-b212-4069-a851-debbd3d1a9f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a1a65b0784d474ab01b710b7e482afd'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:51.851697 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-ac2521c9-b212-4069-a851-debbd3d1a9f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a1a65b0784d474ab01b710b7e482afd'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:51.854233 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-ac2521c9-b212-4069-a851-debbd3d1a9f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a1a65b0784d474ab01b710b7e482afd'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:51.855086 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-ac2521c9-b212-4069-a851-debbd3d1a9f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a1a65b0784d474ab01b710b7e482afd'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:51.904652 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 945/1891] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jul 11 14:41:51 2022] DELETE /identity/v3/users/4a1a65b0784d474ab01b710b7e482afd => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:41:51.994264 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1cd16d-429e-4e0d-bbd5-a2f8a8b07724 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:52.221475 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e81a6a1-9062-48fa-8447-59ab77d196fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:52.222890 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e81a6a1-9062-48fa-8447-59ab77d196fa admin admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:52.223414 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e81a6a1-9062-48fa-8447-59ab77d196fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:52.223944 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e81a6a1-9062-48fa-8447-59ab77d196fa admin admin] PATH_INFO: `/v3/users` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:52.225439 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e81a6a1-9062-48fa-8447-59ab77d196fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:52.252715 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e81a6a1-9062-48fa-8447-59ab77d196fa admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:52.373479 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 947/1892] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jul 11 14:41:51 2022] POST /identity/v3/users => generated 299 bytes in 539 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:41:52.375034 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2521c9-b212-4069-a851-debbd3d1a9f2 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:52.377755 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-ac2521c9-b212-4069-a851-debbd3d1a9f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:52.412996 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2521c9-b212-4069-a851-debbd3d1a9f2 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:52.423800 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665c71f9-f231-48bd-a277-8522b5007288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:52.424772 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665c71f9-f231-48bd-a277-8522b5007288 admin admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:52.426627 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665c71f9-f231-48bd-a277-8522b5007288 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:52.428324 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665c71f9-f231-48bd-a277-8522b5007288 admin admin] PATH_INFO: `/v3/roles` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:52.429332 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665c71f9-f231-48bd-a277-8522b5007288 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:52.434267 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665c71f9-f231-48bd-a277-8522b5007288 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:52.468925 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 946/1893] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:41:52 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 14:41:52.475349 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e81a6a1-9062-48fa-8447-59ab77d196fa admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:52.584690 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e81a6a1-9062-48fa-8447-59ab77d196fa admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:52.625349 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ff06ba-ebfd-44ec-a0a8-cb33433a13b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:52.626716 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ff06ba-ebfd-44ec-a0a8-cb33433a13b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:52.627227 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ff06ba-ebfd-44ec-a0a8-cb33433a13b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:52.627733 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ff06ba-ebfd-44ec-a0a8-cb33433a13b8 admin admin] PATH_INFO: `/v3/projects/6784adbe69504b13acb86742039b804b/users/be332aa0d47e4cc68c376dd72719efa2/roles/b46df176b0fe479da63c318db225bed4` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:52.699278 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ff06ba-ebfd-44ec-a0a8-cb33433a13b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6784adbe69504b13acb86742039b804b, user_id=be332aa0d47e4cc68c376dd72719efa2, role_id=b46df176b0fe479da63c318db225bed4)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:52.702136 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ff06ba-ebfd-44ec-a0a8-cb33433a13b8 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:52.736588 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 948/1894] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jul 11 14:41:52 2022] PUT /identity/v3/projects/6784adbe69504b13acb86742039b804b/users/be332aa0d47e4cc68c376dd72719efa2/roles/b46df176b0fe479da63c318db225bed4 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:41:52.737222 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665c71f9-f231-48bd-a277-8522b5007288 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:52.754524 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665c71f9-f231-48bd-a277-8522b5007288 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:52.867363 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26aaa6f-a5b2-4f28-b6f9-dab6e35ecafa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:52.870389 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26aaa6f-a5b2-4f28-b6f9-dab6e35ecafa admin admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:52.871475 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26aaa6f-a5b2-4f28-b6f9-dab6e35ecafa admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:52.871874 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26aaa6f-a5b2-4f28-b6f9-dab6e35ecafa admin admin] PATH_INFO: `/v3/roles` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:52.875357 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26aaa6f-a5b2-4f28-b6f9-dab6e35ecafa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:52.878800 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26aaa6f-a5b2-4f28-b6f9-dab6e35ecafa admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:52.906342 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 947/1895] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:41:52 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:41:52.910121 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ff06ba-ebfd-44ec-a0a8-cb33433a13b8 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:52.933838 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ff06ba-ebfd-44ec-a0a8-cb33433a13b8 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:52.939179 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e199302b-f970-4e54-94b0-d8f3e1b19296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:52.941844 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e199302b-f970-4e54-94b0-d8f3e1b19296 admin admin] REQUEST_METHOD: `PUT` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:52.942495 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e199302b-f970-4e54-94b0-d8f3e1b19296 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:52.942918 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e199302b-f970-4e54-94b0-d8f3e1b19296 admin admin] PATH_INFO: `/v3/projects/6784adbe69504b13acb86742039b804b/users/be332aa0d47e4cc68c376dd72719efa2/roles/b46df176b0fe479da63c318db225bed4` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:52.946327 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e199302b-f970-4e54-94b0-d8f3e1b19296 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6784adbe69504b13acb86742039b804b, user_id=be332aa0d47e4cc68c376dd72719efa2, role_id=b46df176b0fe479da63c318db225bed4)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:52.950297 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e199302b-f970-4e54-94b0-d8f3e1b19296 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:52.974849 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 949/1896] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jul 11 14:41:52 2022] PUT /identity/v3/projects/6784adbe69504b13acb86742039b804b/users/be332aa0d47e4cc68c376dd72719efa2/roles/b46df176b0fe479da63c318db225bed4 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:41:53.000619 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a074c959-b119-40bd-b8b6-4c75a77703d1 None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:53.001763 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a074c959-b119-40bd-b8b6-4c75a77703d1 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:53.002189 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a074c959-b119-40bd-b8b6-4c75a77703d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:53.122751 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:41:53.186606 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e199302b-f970-4e54-94b0-d8f3e1b19296 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:53.192421 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-e199302b-f970-4e54-94b0-d8f3e1b19296 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:53.217746 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-a074c959-b119-40bd-b8b6-4c75a77703d1 None None] MFA Rules not processed for user `be332aa0d47e4cc68c376dd72719efa2`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:41:53.239775 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-a074c959-b119-40bd-b8b6-4c75a77703d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:53.344713 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:41:53.579809 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e199302b-f970-4e54-94b0-d8f3e1b19296 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:53.598134 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d8ac52-a631-40be-b6a1-fe4e0026e1c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:53.599907 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d8ac52-a631-40be-b6a1-fe4e0026e1c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:53.600445 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d8ac52-a631-40be-b6a1-fe4e0026e1c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:53.600950 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d8ac52-a631-40be-b6a1-fe4e0026e1c8 admin admin] PATH_INFO: `/v3/projects/941589f19a364b14936591b9bf22ac18` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:53.605540 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d8ac52-a631-40be-b6a1-fe4e0026e1c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=941589f19a364b14936591b9bf22ac18)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:53.612838 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d8ac52-a631-40be-b6a1-fe4e0026e1c8 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:53.644438 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 948/1897] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:41:52 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 641 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:41:53.682119 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a074c959-b119-40bd-b8b6-4c75a77703d1 None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:53.683934 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-a074c959-b119-40bd-b8b6-4c75a77703d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:53.711913 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-10d8ac52-a631-40be-b6a1-fe4e0026e1c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '941589f19a364b14936591b9bf22ac18', 'request_id': 'req-10d8ac52-a631-40be-b6a1-fe4e0026e1c8'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:53.720151 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-10d8ac52-a631-40be-b6a1-fe4e0026e1c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '941589f19a364b14936591b9bf22ac18', 'request_id': 'req-10d8ac52-a631-40be-b6a1-fe4e0026e1c8'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:53.731585 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-10d8ac52-a631-40be-b6a1-fe4e0026e1c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '941589f19a364b14936591b9bf22ac18', 'request_id': 'req-10d8ac52-a631-40be-b6a1-fe4e0026e1c8'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:53.759648 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-10d8ac52-a631-40be-b6a1-fe4e0026e1c8 admin admin] The token cache is being invalidate because project 941589f19a364b14936591b9bf22ac18 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:41:53.760413 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-10d8ac52-a631-40be-b6a1-fe4e0026e1c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:53.763311 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-10d8ac52-a631-40be-b6a1-fe4e0026e1c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:53.773199 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 950/1898] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jul 11 14:41:53 2022] DELETE /identity/v3/projects/941589f19a364b14936591b9bf22ac18 => generated 0 bytes in 583 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:41:53.775061 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e29596f-dd2e-496e-bce4-0a36f15bbecc None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:53.775626 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e29596f-dd2e-496e-bce4-0a36f15bbecc None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:53.776115 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e29596f-dd2e-496e-bce4-0a36f15bbecc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:53.801219 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-4e29596f-dd2e-496e-bce4-0a36f15bbecc None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:41:53.802832 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-4e29596f-dd2e-496e-bce4-0a36f15bbecc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:53.854920 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a074c959-b119-40bd-b8b6-4c75a77703d1 None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:53.938028 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 951/1899] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:41:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:41:53.948690 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6770ee-1768-44c4-9692-dac0e5278d36 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:53.950223 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6770ee-1768-44c4-9692-dac0e5278d36 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:53.951541 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6770ee-1768-44c4-9692-dac0e5278d36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:53.980221 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-af6770ee-1768-44c4-9692-dac0e5278d36 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:41:53.981838 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-af6770ee-1768-44c4-9692-dac0e5278d36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:53.993030 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 952/1900] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:41:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:41:53.997150 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6770ee-1768-44c4-9692-dac0e5278d36 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:54.022739 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6770ee-1768-44c4-9692-dac0e5278d36 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:54.031495 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e342bd-550c-47c9-99f3-46d55fd5c27e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:54.033680 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e342bd-550c-47c9-99f3-46d55fd5c27e admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:54.034489 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e342bd-550c-47c9-99f3-46d55fd5c27e admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:54.035260 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e342bd-550c-47c9-99f3-46d55fd5c27e admin admin] PATH_INFO: `/v3/domains` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:54.038478 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e342bd-550c-47c9-99f3-46d55fd5c27e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:41:54.039401 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e342bd-550c-47c9-99f3-46d55fd5c27e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:54.043566 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e342bd-550c-47c9-99f3-46d55fd5c27e admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:54.043821 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63361d75-93e5-4a6c-8e3a-b0c40ca2b6da service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '868e7c2dec264512b972c8736d659c34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:54.045248 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63361d75-93e5-4a6c-8e3a-b0c40ca2b6da service cinder] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:54.045248 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63361d75-93e5-4a6c-8e3a-b0c40ca2b6da service cinder] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:54.045248 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63361d75-93e5-4a6c-8e3a-b0c40ca2b6da service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:54.048615 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-63361d75-93e5-4a6c-8e3a-b0c40ca2b6da service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:54.093232 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 953/1901] 10.222.0.70 () {58 vars in 1152 bytes} [Mon Jul 11 14:41:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:41:54.098612 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e342bd-550c-47c9-99f3-46d55fd5c27e admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:54.121070 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e342bd-550c-47c9-99f3-46d55fd5c27e admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:54.135034 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d269851-4cfc-4ffa-9957-1b9d1c467f3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:54.135666 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d269851-4cfc-4ffa-9957-1b9d1c467f3b admin admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:54.136903 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d269851-4cfc-4ffa-9957-1b9d1c467f3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:54.136903 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d269851-4cfc-4ffa-9957-1b9d1c467f3b admin admin] PATH_INFO: `/v3/projects` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:54.140859 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d269851-4cfc-4ffa-9957-1b9d1c467f3b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:54.145591 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d269851-4cfc-4ffa-9957-1b9d1c467f3b admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:54.188901 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63361d75-93e5-4a6c-8e3a-b0c40ca2b6da service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:54.190384 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63361d75-93e5-4a6c-8e3a-b0c40ca2b6da service cinder] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:54.203750 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 949/1902] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:41:53 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 525 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:41:54.223321 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 954/1903] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jul 11 14:41:54 2022] POST /identity/v3/projects => generated 371 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:41:54.224001 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63361d75-93e5-4a6c-8e3a-b0c40ca2b6da service cinder] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:54.234664 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:41:54.249843 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63361d75-93e5-4a6c-8e3a-b0c40ca2b6da service cinder] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:54.292027 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d269851-4cfc-4ffa-9957-1b9d1c467f3b admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:54.296512 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-1d269851-4cfc-4ffa-9957-1b9d1c467f3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:54.310631 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:41:54.378889 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5280e0c5-c596-471f-a826-a519250ddbf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:54.379818 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5280e0c5-c596-471f-a826-a519250ddbf1 admin admin] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:54.380353 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5280e0c5-c596-471f-a826-a519250ddbf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:54.381026 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5280e0c5-c596-471f-a826-a519250ddbf1 admin admin] PATH_INFO: `/v3/users` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:54.382350 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5280e0c5-c596-471f-a826-a519250ddbf1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:54.384912 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5280e0c5-c596-471f-a826-a519250ddbf1 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:54.419797 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 950/1904] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jul 11 14:41:54 2022] POST /identity/v3/users => generated 286 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:41:54.420838 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5280e0c5-c596-471f-a826-a519250ddbf1 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:54.433087 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d269851-4cfc-4ffa-9957-1b9d1c467f3b admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:54.434698 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5280e0c5-c596-471f-a826-a519250ddbf1 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:54.447461 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224ffdb6-09b8-4c54-97e4-d9654c8a2558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:54.447807 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60013e1-1903-486a-ac53-261ed8f00302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:54.447906 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224ffdb6-09b8-4c54-97e4-d9654c8a2558 admin admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:54.447906 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224ffdb6-09b8-4c54-97e4-d9654c8a2558 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:54.448072 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224ffdb6-09b8-4c54-97e4-d9654c8a2558 admin admin] PATH_INFO: `/v3/roles` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:54.448361 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60013e1-1903-486a-ac53-261ed8f00302 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:54.448571 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60013e1-1903-486a-ac53-261ed8f00302 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:54.448823 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60013e1-1903-486a-ac53-261ed8f00302 admin admin] PATH_INFO: `/v3/users/da60ca2559c04cd4b6fd36797fda64f9` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:54.449007 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224ffdb6-09b8-4c54-97e4-d9654c8a2558 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:54.450601 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224ffdb6-09b8-4c54-97e4-d9654c8a2558 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:54.450714 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60013e1-1903-486a-ac53-261ed8f00302 admin admin] RBAC: Authorizing `identity:delete_user(user_id=da60ca2559c04cd4b6fd36797fda64f9)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:54.452697 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60013e1-1903-486a-ac53-261ed8f00302 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:54.470551 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 951/1905] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:41:54 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:41:54.476052 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224ffdb6-09b8-4c54-97e4-d9654c8a2558 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:54.487330 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224ffdb6-09b8-4c54-97e4-d9654c8a2558 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:54.492853 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b184c54e-454e-4596-87b8-d6a918c2fa32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:54.493949 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b184c54e-454e-4596-87b8-d6a918c2fa32 admin admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:54.494863 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b184c54e-454e-4596-87b8-d6a918c2fa32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:54.495075 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b184c54e-454e-4596-87b8-d6a918c2fa32 admin admin] PATH_INFO: `/v3/roles` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:54.495930 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b184c54e-454e-4596-87b8-d6a918c2fa32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:54.497664 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b184c54e-454e-4596-87b8-d6a918c2fa32 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:54.516563 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 952/1906] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:41:54 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:41:54.518245 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b184c54e-454e-4596-87b8-d6a918c2fa32 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:54.527259 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-b60013e1-1903-486a-ac53-261ed8f00302 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da60ca2559c04cd4b6fd36797fda64f9'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:54.532120 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b184c54e-454e-4596-87b8-d6a918c2fa32 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:54.537733 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-b60013e1-1903-486a-ac53-261ed8f00302 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da60ca2559c04cd4b6fd36797fda64f9'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:54.539472 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39dcf5f-d504-4fb1-a642-32168f0259d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:54.541003 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39dcf5f-d504-4fb1-a642-32168f0259d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:54.541470 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39dcf5f-d504-4fb1-a642-32168f0259d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:54.541800 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39dcf5f-d504-4fb1-a642-32168f0259d7 admin admin] PATH_INFO: `/v3/projects/564b827b10cd45c4a1fb658de9173d0a/users/3f3407ce7a5f410eac48cbe270b4115a/roles/8eff41f243c843ed95505a488ca6eada` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:54.559268 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-b60013e1-1903-486a-ac53-261ed8f00302 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da60ca2559c04cd4b6fd36797fda64f9'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:54.562875 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-b60013e1-1903-486a-ac53-261ed8f00302 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da60ca2559c04cd4b6fd36797fda64f9'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:54.563147 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-b60013e1-1903-486a-ac53-261ed8f00302 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da60ca2559c04cd4b6fd36797fda64f9'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:54.568456 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39dcf5f-d504-4fb1-a642-32168f0259d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=564b827b10cd45c4a1fb658de9173d0a, user_id=3f3407ce7a5f410eac48cbe270b4115a, role_id=8eff41f243c843ed95505a488ca6eada)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:54.572160 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39dcf5f-d504-4fb1-a642-32168f0259d7 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:54.592216 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 953/1907] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jul 11 14:41:54 2022] PUT /identity/v3/projects/564b827b10cd45c4a1fb658de9173d0a/users/3f3407ce7a5f410eac48cbe270b4115a/roles/8eff41f243c843ed95505a488ca6eada => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:41:54.601451 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 955/1908] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jul 11 14:41:54 2022] DELETE /identity/v3/users/da60ca2559c04cd4b6fd36797fda64f9 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:41:54.606533 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0211dee0-072e-42c7-882f-9637a9a2f508 None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:54.606818 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0211dee0-072e-42c7-882f-9637a9a2f508 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:54.607087 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0211dee0-072e-42c7-882f-9637a9a2f508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:54.610443 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7ac0de-640a-4b75-ad7b-4b027e302b37 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:54.610733 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7ac0de-640a-4b75-ad7b-4b027e302b37 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:54.611010 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7ac0de-640a-4b75-ad7b-4b027e302b37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:54.643914 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-0211dee0-072e-42c7-882f-9637a9a2f508 None None] MFA Rules not processed for user `3f3407ce7a5f410eac48cbe270b4115a`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:41:54.644189 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-ab7ac0de-640a-4b75-ad7b-4b027e302b37 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:41:54.645415 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-0211dee0-072e-42c7-882f-9637a9a2f508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:54.646135 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-ab7ac0de-640a-4b75-ad7b-4b027e302b37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:54.724079 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 956/1909] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:41:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:41:54.736129 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7ac0de-640a-4b75-ad7b-4b027e302b37 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:54.737485 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-ab7ac0de-640a-4b75-ad7b-4b027e302b37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:54.746597 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 954/1910] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:41:54 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:41:54.759484 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0211dee0-072e-42c7-882f-9637a9a2f508 None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:54.761293 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-0211dee0-072e-42c7-882f-9637a9a2f508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:54.781292 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:41:54.822045 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:41:54.827240 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7ac0de-640a-4b75-ad7b-4b027e302b37 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:54.831000 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9fa85e-eaa8-42ca-b559-af3e12433a86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20eede5ccd834862b00123310b5c3975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:54.831883 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9fa85e-eaa8-42ca-b559-af3e12433a86 service neutron] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:54.832275 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9fa85e-eaa8-42ca-b559-af3e12433a86 service neutron] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:54.832545 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9fa85e-eaa8-42ca-b559-af3e12433a86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:54.843037 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0211dee0-072e-42c7-882f-9637a9a2f508 None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:54.843255 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9fa85e-eaa8-42ca-b559-af3e12433a86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:54.844643 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9fa85e-eaa8-42ca-b559-af3e12433a86 service neutron] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:54.847278 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3099ea-d6c7-4f7a-997d-43a66bed2d7b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '868e7c2dec264512b972c8736d659c34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:54.847969 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3099ea-d6c7-4f7a-997d-43a66bed2d7b service cinder] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:54.848441 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3099ea-d6c7-4f7a-997d-43a66bed2d7b service cinder] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:54.848743 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3099ea-d6c7-4f7a-997d-43a66bed2d7b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:54.856836 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 957/1911] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:41:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:41:54.858962 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3099ea-d6c7-4f7a-997d-43a66bed2d7b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:54.860989 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3099ea-d6c7-4f7a-997d-43a66bed2d7b service cinder] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:54.874796 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 955/1912] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:41:54 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:41:54.895787 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9fa85e-eaa8-42ca-b559-af3e12433a86 service neutron] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:54.897252 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-1c9fa85e-eaa8-42ca-b559-af3e12433a86 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:54.910701 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9fa85e-eaa8-42ca-b559-af3e12433a86 service neutron] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:54.918774 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3d5e9b-4a04-462a-9de4-8d926c28549b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:54.919835 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3d5e9b-4a04-462a-9de4-8d926c28549b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:54.920160 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3d5e9b-4a04-462a-9de4-8d926c28549b admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:54.920512 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3d5e9b-4a04-462a-9de4-8d926c28549b admin admin] PATH_INFO: `/v3/users/3f3407ce7a5f410eac48cbe270b4115a` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:54.921985 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3d5e9b-4a04-462a-9de4-8d926c28549b admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f3407ce7a5f410eac48cbe270b4115a)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:54.924585 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3d5e9b-4a04-462a-9de4-8d926c28549b admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:54.989404 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-ba3d5e9b-4a04-462a-9de4-8d926c28549b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f3407ce7a5f410eac48cbe270b4115a'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:54.998596 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-ba3d5e9b-4a04-462a-9de4-8d926c28549b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f3407ce7a5f410eac48cbe270b4115a'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:55.007226 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-ba3d5e9b-4a04-462a-9de4-8d926c28549b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f3407ce7a5f410eac48cbe270b4115a'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:55.007921 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-ba3d5e9b-4a04-462a-9de4-8d926c28549b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f3407ce7a5f410eac48cbe270b4115a'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:55.009226 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-ba3d5e9b-4a04-462a-9de4-8d926c28549b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f3407ce7a5f410eac48cbe270b4115a'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:55.034974 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 958/1913] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jul 11 14:41:54 2022] DELETE /identity/v3/users/3f3407ce7a5f410eac48cbe270b4115a => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:41:55.039552 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c42548-bb8f-4e40-a4ba-bc350112bde1 None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:55.039888 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c42548-bb8f-4e40-a4ba-bc350112bde1 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:55.040172 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c42548-bb8f-4e40-a4ba-bc350112bde1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:55.058946 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-92c42548-bb8f-4e40-a4ba-bc350112bde1 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:41:55.060398 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-92c42548-bb8f-4e40-a4ba-bc350112bde1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:55.152826 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 956/1914] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:41:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:41:55.166552 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3d5e9b-4a04-462a-9de4-8d926c28549b admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:55.168122 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-ba3d5e9b-4a04-462a-9de4-8d926c28549b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:55.217952 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c42548-bb8f-4e40-a4ba-bc350112bde1 None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:55.219516 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-92c42548-bb8f-4e40-a4ba-bc350112bde1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:55.233950 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c42548-bb8f-4e40-a4ba-bc350112bde1 None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:55.239628 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be12fda-b212-4398-9b24-6363197f42ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:55.240661 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be12fda-b212-4398-9b24-6363197f42ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:55.241026 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be12fda-b212-4398-9b24-6363197f42ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:55.241245 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be12fda-b212-4398-9b24-6363197f42ad admin admin] PATH_INFO: `/v3/projects/06032a6a2be249eab27322e187990332` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:55.244098 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be12fda-b212-4398-9b24-6363197f42ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=06032a6a2be249eab27322e187990332)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:55.246971 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be12fda-b212-4398-9b24-6363197f42ad admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:55.273507 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3d5e9b-4a04-462a-9de4-8d926c28549b admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:55.279938 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98af1a9b-033e-45c4-a60d-1af2b1a70fbd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20eede5ccd834862b00123310b5c3975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:55.280651 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98af1a9b-033e-45c4-a60d-1af2b1a70fbd service neutron] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:55.280944 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98af1a9b-033e-45c4-a60d-1af2b1a70fbd service neutron] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:55.281225 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98af1a9b-033e-45c4-a60d-1af2b1a70fbd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:55.297991 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98af1a9b-033e-45c4-a60d-1af2b1a70fbd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:55.300045 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98af1a9b-033e-45c4-a60d-1af2b1a70fbd service neutron] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:55.319830 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 959/1915] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:41:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:41:55.329201 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-0be12fda-b212-4398-9b24-6363197f42ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06032a6a2be249eab27322e187990332', 'request_id': 'req-0be12fda-b212-4398-9b24-6363197f42ad'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:55.337791 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-0be12fda-b212-4398-9b24-6363197f42ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06032a6a2be249eab27322e187990332', 'request_id': 'req-0be12fda-b212-4398-9b24-6363197f42ad'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:55.349366 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-0be12fda-b212-4398-9b24-6363197f42ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06032a6a2be249eab27322e187990332', 'request_id': 'req-0be12fda-b212-4398-9b24-6363197f42ad'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:55.357355 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98af1a9b-033e-45c4-a60d-1af2b1a70fbd service neutron] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:55.359042 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-98af1a9b-033e-45c4-a60d-1af2b1a70fbd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:55.365962 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-0be12fda-b212-4398-9b24-6363197f42ad admin admin] The token cache is being invalidate because project 06032a6a2be249eab27322e187990332 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80534) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:41:55.366367 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-0be12fda-b212-4398-9b24-6363197f42ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:55.367109 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-0be12fda-b212-4398-9b24-6363197f42ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:55.372256 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 957/1916] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jul 11 14:41:55 2022] DELETE /identity/v3/projects/06032a6a2be249eab27322e187990332 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:41:55.375770 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be12fda-b212-4398-9b24-6363197f42ad admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:55.379078 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-0be12fda-b212-4398-9b24-6363197f42ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:55.386159 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98af1a9b-033e-45c4-a60d-1af2b1a70fbd service neutron] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:55.441693 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:41:55.460715 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be12fda-b212-4398-9b24-6363197f42ad admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:55.467452 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762f283e-33d6-475d-815e-a1b1a204d7a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:55.468491 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762f283e-33d6-475d-815e-a1b1a204d7a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:55.468670 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762f283e-33d6-475d-815e-a1b1a204d7a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:55.469048 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762f283e-33d6-475d-815e-a1b1a204d7a6 admin admin] PATH_INFO: `/v3/users/be332aa0d47e4cc68c376dd72719efa2` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:55.470398 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762f283e-33d6-475d-815e-a1b1a204d7a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=be332aa0d47e4cc68c376dd72719efa2)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:55.470951 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85df44f2-4de4-407d-9965-a5a4e448b248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:55.472118 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85df44f2-4de4-407d-9965-a5a4e448b248 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:55.472497 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85df44f2-4de4-407d-9965-a5a4e448b248 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:55.472617 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762f283e-33d6-475d-815e-a1b1a204d7a6 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:55.472843 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85df44f2-4de4-407d-9965-a5a4e448b248 admin admin] PATH_INFO: `/v3/users/8550342cff0b4cfb8a22974074c9cceb` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:55.474675 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85df44f2-4de4-407d-9965-a5a4e448b248 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8550342cff0b4cfb8a22974074c9cceb)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:55.475659 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:41:55.478767 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85df44f2-4de4-407d-9965-a5a4e448b248 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:55.547771 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-762f283e-33d6-475d-815e-a1b1a204d7a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be332aa0d47e4cc68c376dd72719efa2'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:55.558657 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-762f283e-33d6-475d-815e-a1b1a204d7a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be332aa0d47e4cc68c376dd72719efa2'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:55.563932 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-85df44f2-4de4-407d-9965-a5a4e448b248 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8550342cff0b4cfb8a22974074c9cceb'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:55.574627 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-762f283e-33d6-475d-815e-a1b1a204d7a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be332aa0d47e4cc68c376dd72719efa2'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:55.575646 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-762f283e-33d6-475d-815e-a1b1a204d7a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be332aa0d47e4cc68c376dd72719efa2'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:55.576454 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-762f283e-33d6-475d-815e-a1b1a204d7a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be332aa0d47e4cc68c376dd72719efa2'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:55.578763 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-85df44f2-4de4-407d-9965-a5a4e448b248 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8550342cff0b4cfb8a22974074c9cceb'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:55.592887 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-85df44f2-4de4-407d-9965-a5a4e448b248 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8550342cff0b4cfb8a22974074c9cceb'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:55.593598 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-85df44f2-4de4-407d-9965-a5a4e448b248 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8550342cff0b4cfb8a22974074c9cceb'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:55.595219 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-85df44f2-4de4-407d-9965-a5a4e448b248 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8550342cff0b4cfb8a22974074c9cceb'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:55.603399 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 958/1917] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jul 11 14:41:55 2022] DELETE /identity/v3/users/be332aa0d47e4cc68c376dd72719efa2 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:41:55.603399 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762f283e-33d6-475d-815e-a1b1a204d7a6 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:55.619968 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 960/1918] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jul 11 14:41:55 2022] DELETE /identity/v3/users/8550342cff0b4cfb8a22974074c9cceb => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:41:55.625534 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce5b3ef-bb70-423d-a4b6-97c21f3b1bbb None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:55.626239 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce5b3ef-bb70-423d-a4b6-97c21f3b1bbb None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:55.626693 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-762f283e-33d6-475d-815e-a1b1a204d7a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:55.627091 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce5b3ef-bb70-423d-a4b6-97c21f3b1bbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:55.652707 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-4ce5b3ef-bb70-423d-a4b6-97c21f3b1bbb None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:41:55.655080 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-4ce5b3ef-bb70-423d-a4b6-97c21f3b1bbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:55.746616 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762f283e-33d6-475d-815e-a1b1a204d7a6 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:55.760070 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 961/1919] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:41:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:41:55.761137 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb3aff0-80e7-4d66-a91c-6f23c75bebab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:55.762946 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb3aff0-80e7-4d66-a91c-6f23c75bebab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:55.764145 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb3aff0-80e7-4d66-a91c-6f23c75bebab admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:55.764930 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb3aff0-80e7-4d66-a91c-6f23c75bebab admin admin] PATH_INFO: `/v3/users/c8ddfd59886d40c9a3333267de426311` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:55.766475 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb3aff0-80e7-4d66-a91c-6f23c75bebab admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8ddfd59886d40c9a3333267de426311)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:55.768689 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb3aff0-80e7-4d66-a91c-6f23c75bebab admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:55.788648 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce5b3ef-bb70-423d-a4b6-97c21f3b1bbb None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:55.790838 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-4ce5b3ef-bb70-423d-a4b6-97c21f3b1bbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:55.886990 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-8fb3aff0-80e7-4d66-a91c-6f23c75bebab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8ddfd59886d40c9a3333267de426311'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:55.896790 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-8fb3aff0-80e7-4d66-a91c-6f23c75bebab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8ddfd59886d40c9a3333267de426311'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:55.909217 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-8fb3aff0-80e7-4d66-a91c-6f23c75bebab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8ddfd59886d40c9a3333267de426311'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:55.910800 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-8fb3aff0-80e7-4d66-a91c-6f23c75bebab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8ddfd59886d40c9a3333267de426311'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:55.911558 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-8fb3aff0-80e7-4d66-a91c-6f23c75bebab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8ddfd59886d40c9a3333267de426311'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:55.920613 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce5b3ef-bb70-423d-a4b6-97c21f3b1bbb None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:55.927225 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee34a09-e514-4c8e-9da9-5b085d1a5931 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20eede5ccd834862b00123310b5c3975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:55.928474 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee34a09-e514-4c8e-9da9-5b085d1a5931 service neutron] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:55.928810 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee34a09-e514-4c8e-9da9-5b085d1a5931 service neutron] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:55.929165 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee34a09-e514-4c8e-9da9-5b085d1a5931 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:55.931801 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-cee34a09-e514-4c8e-9da9-5b085d1a5931 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:55.937433 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:41:55.945609 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 959/1920] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jul 11 14:41:55 2022] DELETE /identity/v3/users/c8ddfd59886d40c9a3333267de426311 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:41:55.945609 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb3aff0-80e7-4d66-a91c-6f23c75bebab admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:55.947974 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-8fb3aff0-80e7-4d66-a91c-6f23c75bebab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:55.948193 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee34a09-e514-4c8e-9da9-5b085d1a5931 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:55.949700 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee34a09-e514-4c8e-9da9-5b085d1a5931 service neutron] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:55.962298 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 962/1921] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:41:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:41:55.963362 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf92365-1153-4c17-8c95-da4062be5f3c None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:55.963650 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf92365-1153-4c17-8c95-da4062be5f3c None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:55.963925 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf92365-1153-4c17-8c95-da4062be5f3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:55.975293 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:41:55.994874 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-0cf92365-1153-4c17-8c95-da4062be5f3c None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:41:55.997156 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-0cf92365-1153-4c17-8c95-da4062be5f3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:56.053672 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb3aff0-80e7-4d66-a91c-6f23c75bebab admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:56.062382 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44941ed-7bcf-4af8-94fc-b9a8ac726d42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:56.063770 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44941ed-7bcf-4af8-94fc-b9a8ac726d42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:56.064052 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44941ed-7bcf-4af8-94fc-b9a8ac726d42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:56.064362 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44941ed-7bcf-4af8-94fc-b9a8ac726d42 admin admin] PATH_INFO: `/v3/projects/564b827b10cd45c4a1fb658de9173d0a` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:56.066667 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44941ed-7bcf-4af8-94fc-b9a8ac726d42 admin admin] RBAC: Authorizing `identity:delete_project(project_id=564b827b10cd45c4a1fb658de9173d0a)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:56.069625 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44941ed-7bcf-4af8-94fc-b9a8ac726d42 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:56.133021 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 963/1922] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:41:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:41:56.147661 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf92365-1153-4c17-8c95-da4062be5f3c None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:56.149464 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-0cf92365-1153-4c17-8c95-da4062be5f3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:56.162014 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-a44941ed-7bcf-4af8-94fc-b9a8ac726d42 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '564b827b10cd45c4a1fb658de9173d0a', 'request_id': 'req-a44941ed-7bcf-4af8-94fc-b9a8ac726d42'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:56.172505 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-a44941ed-7bcf-4af8-94fc-b9a8ac726d42 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '564b827b10cd45c4a1fb658de9173d0a', 'request_id': 'req-a44941ed-7bcf-4af8-94fc-b9a8ac726d42'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:56.187294 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-a44941ed-7bcf-4af8-94fc-b9a8ac726d42 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '564b827b10cd45c4a1fb658de9173d0a', 'request_id': 'req-a44941ed-7bcf-4af8-94fc-b9a8ac726d42'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:56.211032 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-a44941ed-7bcf-4af8-94fc-b9a8ac726d42 admin admin] The token cache is being invalidate because project 564b827b10cd45c4a1fb658de9173d0a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80534) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:41:56.211340 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-a44941ed-7bcf-4af8-94fc-b9a8ac726d42 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:56.212310 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-a44941ed-7bcf-4af8-94fc-b9a8ac726d42 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:56.214402 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 960/1923] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jul 11 14:41:55 2022] DELETE /identity/v3/projects/564b827b10cd45c4a1fb658de9173d0a => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:41:56.215022 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44941ed-7bcf-4af8-94fc-b9a8ac726d42 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:56.216631 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-a44941ed-7bcf-4af8-94fc-b9a8ac726d42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:56.236520 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf92365-1153-4c17-8c95-da4062be5f3c None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:56.339488 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44941ed-7bcf-4af8-94fc-b9a8ac726d42 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:56.353279 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47db2603-49ed-484e-b770-40a9587984ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:56.354360 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47db2603-49ed-484e-b770-40a9587984ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:56.354649 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47db2603-49ed-484e-b770-40a9587984ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:56.354951 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47db2603-49ed-484e-b770-40a9587984ba admin admin] PATH_INFO: `/v3/projects/6784adbe69504b13acb86742039b804b` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:56.358169 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47db2603-49ed-484e-b770-40a9587984ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=6784adbe69504b13acb86742039b804b)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:56.360114 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47db2603-49ed-484e-b770-40a9587984ba admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:56.383581 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa05685-212c-4a14-8777-0e8f92feef1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20eede5ccd834862b00123310b5c3975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:56.384709 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa05685-212c-4a14-8777-0e8f92feef1b service neutron] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:56.385128 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa05685-212c-4a14-8777-0e8f92feef1b service neutron] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:56.385666 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa05685-212c-4a14-8777-0e8f92feef1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:56.389592 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-bfa05685-212c-4a14-8777-0e8f92feef1b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:56.409212 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa05685-212c-4a14-8777-0e8f92feef1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:56.412493 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa05685-212c-4a14-8777-0e8f92feef1b service neutron] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:56.435002 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 964/1924] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:41:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:41:56.438566 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ce869e-fbf9-4e42-a7df-a6dcc057426d None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:56.438831 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ce869e-fbf9-4e42-a7df-a6dcc057426d None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:56.439312 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ce869e-fbf9-4e42-a7df-a6dcc057426d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:56.442844 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:41:56.472232 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-85ce869e-fbf9-4e42-a7df-a6dcc057426d None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:41:56.472470 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-47db2603-49ed-484e-b770-40a9587984ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6784adbe69504b13acb86742039b804b', 'request_id': 'req-47db2603-49ed-484e-b770-40a9587984ba'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:56.474072 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-85ce869e-fbf9-4e42-a7df-a6dcc057426d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:56.481886 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-47db2603-49ed-484e-b770-40a9587984ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6784adbe69504b13acb86742039b804b', 'request_id': 'req-47db2603-49ed-484e-b770-40a9587984ba'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:56.492043 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-47db2603-49ed-484e-b770-40a9587984ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6784adbe69504b13acb86742039b804b', 'request_id': 'req-47db2603-49ed-484e-b770-40a9587984ba'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:56.514021 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-47db2603-49ed-484e-b770-40a9587984ba admin admin] The token cache is being invalidate because project 6784adbe69504b13acb86742039b804b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80534) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:41:56.514337 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-47db2603-49ed-484e-b770-40a9587984ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:56.515129 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-47db2603-49ed-484e-b770-40a9587984ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:56.518737 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 961/1925] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jul 11 14:41:56 2022] DELETE /identity/v3/projects/6784adbe69504b13acb86742039b804b => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:41:56.524683 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a426b60-cc6a-4012-bc72-08178288c47b None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:56.525238 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a426b60-cc6a-4012-bc72-08178288c47b None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:56.525601 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a426b60-cc6a-4012-bc72-08178288c47b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:56.551681 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-2a426b60-cc6a-4012-bc72-08178288c47b None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:41:56.553132 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-2a426b60-cc6a-4012-bc72-08178288c47b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:56.563863 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 965/1926] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:41:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:41:56.572400 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2124e79-35c7-4b68-8a27-995f581d31be None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:56.572796 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2124e79-35c7-4b68-8a27-995f581d31be None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:56.573174 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2124e79-35c7-4b68-8a27-995f581d31be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:56.585642 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:41:56.607496 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-b2124e79-35c7-4b68-8a27-995f581d31be None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:41:56.609835 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-b2124e79-35c7-4b68-8a27-995f581d31be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:56.622325 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 966/1927] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:41:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:41:56.627499 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2124e79-35c7-4b68-8a27-995f581d31be None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:56.643317 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2124e79-35c7-4b68-8a27-995f581d31be None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:56.652475 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e727cd28-5217-43fc-b9be-b64434d07e9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:56.653242 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e727cd28-5217-43fc-b9be-b64434d07e9e admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:56.654085 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e727cd28-5217-43fc-b9be-b64434d07e9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:56.654085 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e727cd28-5217-43fc-b9be-b64434d07e9e admin admin] PATH_INFO: `/v3/domains` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:56.654574 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e727cd28-5217-43fc-b9be-b64434d07e9e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:41:56.654935 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e727cd28-5217-43fc-b9be-b64434d07e9e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:56.657484 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e727cd28-5217-43fc-b9be-b64434d07e9e admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:56.673322 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 962/1928] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:41:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:41:56.681817 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 967/1929] 10.222.0.70 () {58 vars in 1152 bytes} [Mon Jul 11 14:41:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:41:56.683070 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e727cd28-5217-43fc-b9be-b64434d07e9e admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:56.685566 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbfbf22-d419-4e3c-b245-4ac4ba5c2359 None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:56.686052 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbfbf22-d419-4e3c-b245-4ac4ba5c2359 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:56.686392 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbfbf22-d419-4e3c-b245-4ac4ba5c2359 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:56.700903 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e727cd28-5217-43fc-b9be-b64434d07e9e admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:56.707399 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f7f27f-9fe6-4c66-86fb-e9952138cc6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:56.707974 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f7f27f-9fe6-4c66-86fb-e9952138cc6e admin admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:56.708335 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f7f27f-9fe6-4c66-86fb-e9952138cc6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:56.708616 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f7f27f-9fe6-4c66-86fb-e9952138cc6e admin admin] PATH_INFO: `/v3/projects` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:56.709339 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f7f27f-9fe6-4c66-86fb-e9952138cc6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:56.711989 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f7f27f-9fe6-4c66-86fb-e9952138cc6e admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:56.712583 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-9dbfbf22-d419-4e3c-b245-4ac4ba5c2359 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:41:56.714626 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-9dbfbf22-d419-4e3c-b245-4ac4ba5c2359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:56.724451 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 963/1930] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:41:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:41:56.729212 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbfbf22-d419-4e3c-b245-4ac4ba5c2359 None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:56.740900 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbfbf22-d419-4e3c-b245-4ac4ba5c2359 None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:56.748934 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febc761e-9371-4bec-9c15-5222e883b90a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:56.749373 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 968/1931] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jul 11 14:41:56 2022] POST /identity/v3/projects => generated 357 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:41:56.753159 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febc761e-9371-4bec-9c15-5222e883b90a admin admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:56.754079 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febc761e-9371-4bec-9c15-5222e883b90a admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:56.754213 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f7f27f-9fe6-4c66-86fb-e9952138cc6e admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:56.754307 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febc761e-9371-4bec-9c15-5222e883b90a admin admin] PATH_INFO: `/v3/domains` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:56.756668 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febc761e-9371-4bec-9c15-5222e883b90a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:41:56.759084 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febc761e-9371-4bec-9c15-5222e883b90a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:56.760981 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febc761e-9371-4bec-9c15-5222e883b90a admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:56.776762 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 964/1932] 10.222.0.70 () {58 vars in 1152 bytes} [Mon Jul 11 14:41:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:41:56.782468 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febc761e-9371-4bec-9c15-5222e883b90a admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:56.801090 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febc761e-9371-4bec-9c15-5222e883b90a admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:56.876336 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f7f27f-9fe6-4c66-86fb-e9952138cc6e admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:56.888957 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ca9ca0-3007-4144-b4f7-704e59c32142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:56.890018 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ca9ca0-3007-4144-b4f7-704e59c32142 admin admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:56.890564 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ca9ca0-3007-4144-b4f7-704e59c32142 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:56.891141 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ca9ca0-3007-4144-b4f7-704e59c32142 admin admin] PATH_INFO: `/v3/users` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:56.892054 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ca9ca0-3007-4144-b4f7-704e59c32142 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:56.893742 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ba8178-e369-4221-8380-6f56abef2703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:56.894473 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ba8178-e369-4221-8380-6f56abef2703 admin admin] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:56.894914 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ba8178-e369-4221-8380-6f56abef2703 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:56.895581 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ba8178-e369-4221-8380-6f56abef2703 admin admin] PATH_INFO: `/v3/projects` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:56.896124 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ca9ca0-3007-4144-b4f7-704e59c32142 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:56.896489 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ba8178-e369-4221-8380-6f56abef2703 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:56.898405 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ba8178-e369-4221-8380-6f56abef2703 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:56.928553 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 969/1933] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jul 11 14:41:56 2022] POST /identity/v3/users => generated 279 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:41:56.929803 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ca9ca0-3007-4144-b4f7-704e59c32142 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:56.943043 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ca9ca0-3007-4144-b4f7-704e59c32142 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:56.948588 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 965/1934] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jul 11 14:41:56 2022] POST /identity/v3/projects => generated 377 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:41:56.950628 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ba8178-e369-4221-8380-6f56abef2703 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:57.003347 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:41:57.037272 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469384d7-7581-45fc-b593-7e5826e6e4fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:57.037986 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469384d7-7581-45fc-b593-7e5826e6e4fc admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:57.038275 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469384d7-7581-45fc-b593-7e5826e6e4fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:57.038558 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469384d7-7581-45fc-b593-7e5826e6e4fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:57.039355 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469384d7-7581-45fc-b593-7e5826e6e4fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:57.042653 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469384d7-7581-45fc-b593-7e5826e6e4fc admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:57.055910 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ba8178-e369-4221-8380-6f56abef2703 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:57.060279 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 970/1935] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:41:56 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:41:57.064354 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469384d7-7581-45fc-b593-7e5826e6e4fc admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:57.066824 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7cc0a6-4406-4240-9685-a2d13273e608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:57.068570 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7cc0a6-4406-4240-9685-a2d13273e608 admin admin] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:57.069087 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7cc0a6-4406-4240-9685-a2d13273e608 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:57.069678 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7cc0a6-4406-4240-9685-a2d13273e608 admin admin] PATH_INFO: `/v3/users` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:57.070645 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7cc0a6-4406-4240-9685-a2d13273e608 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:57.075351 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7cc0a6-4406-4240-9685-a2d13273e608 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:57.080818 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469384d7-7581-45fc-b593-7e5826e6e4fc admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:57.093201 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eb3c69-9e30-41c7-9692-42e4bed08064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:57.094018 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eb3c69-9e30-41c7-9692-42e4bed08064 admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:57.094527 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eb3c69-9e30-41c7-9692-42e4bed08064 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:57.095526 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eb3c69-9e30-41c7-9692-42e4bed08064 admin admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:57.095744 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6eb3c69-9e30-41c7-9692-42e4bed08064 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:57.097725 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6eb3c69-9e30-41c7-9692-42e4bed08064 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:57.120642 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 966/1936] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jul 11 14:41:56 2022] POST /identity/v3/users => generated 289 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:41:57.123073 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7cc0a6-4406-4240-9685-a2d13273e608 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:57.134170 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 971/1937] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:41:57 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:41:57.154219 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eb3c69-9e30-41c7-9692-42e4bed08064 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:57.156185 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7cc0a6-4406-4240-9685-a2d13273e608 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:57.168781 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dee8785-38a0-43b0-beba-32ed68b3ce3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:57.169468 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dee8785-38a0-43b0-beba-32ed68b3ce3c admin admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:57.169585 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eb3c69-9e30-41c7-9692-42e4bed08064 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:57.169885 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dee8785-38a0-43b0-beba-32ed68b3ce3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:57.170166 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dee8785-38a0-43b0-beba-32ed68b3ce3c admin admin] PATH_INFO: `/v3/roles` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:57.170934 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dee8785-38a0-43b0-beba-32ed68b3ce3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:57.174832 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dee8785-38a0-43b0-beba-32ed68b3ce3c admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:57.176266 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e83b38-dbb5-4731-a49d-7b1e6954e7da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:57.178016 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e83b38-dbb5-4731-a49d-7b1e6954e7da admin admin] REQUEST_METHOD: `PUT` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:57.178658 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e83b38-dbb5-4731-a49d-7b1e6954e7da admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:57.179015 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e83b38-dbb5-4731-a49d-7b1e6954e7da admin admin] PATH_INFO: `/v3/projects/5aa6307f6f7741129661386d956c9af5/users/8cd3d42080b043b681aa41201ded30c6/roles/8eff41f243c843ed95505a488ca6eada` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:57.190555 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 967/1938] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:41:57 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:41:57.195265 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dee8785-38a0-43b0-beba-32ed68b3ce3c admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:57.201062 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e83b38-dbb5-4731-a49d-7b1e6954e7da admin admin] RBAC: Authorizing `identity:create_grant(project_id=5aa6307f6f7741129661386d956c9af5, user_id=8cd3d42080b043b681aa41201ded30c6, role_id=8eff41f243c843ed95505a488ca6eada)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:57.204091 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e83b38-dbb5-4731-a49d-7b1e6954e7da admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:57.209356 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dee8785-38a0-43b0-beba-32ed68b3ce3c admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:57.217032 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32031b8e-b45f-4a79-a802-3e4397852152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:57.217954 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32031b8e-b45f-4a79-a802-3e4397852152 admin admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:57.218413 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32031b8e-b45f-4a79-a802-3e4397852152 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:57.219184 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32031b8e-b45f-4a79-a802-3e4397852152 admin admin] PATH_INFO: `/v3/roles` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:57.220343 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32031b8e-b45f-4a79-a802-3e4397852152 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:57.222130 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32031b8e-b45f-4a79-a802-3e4397852152 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:57.232613 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 972/1939] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jul 11 14:41:57 2022] PUT /identity/v3/projects/5aa6307f6f7741129661386d956c9af5/users/8cd3d42080b043b681aa41201ded30c6/roles/8eff41f243c843ed95505a488ca6eada => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:41:57.233710 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e83b38-dbb5-4731-a49d-7b1e6954e7da admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:57.239948 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-41e83b38-dbb5-4731-a49d-7b1e6954e7da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:57.244231 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 968/1940] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:41:57 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:41:57.250570 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e3021f-7c8c-4687-aebd-6b243d30eaec None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:57.251037 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e3021f-7c8c-4687-aebd-6b243d30eaec None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:57.251419 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e3021f-7c8c-4687-aebd-6b243d30eaec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:57.256460 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:41:57.297913 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-76e3021f-7c8c-4687-aebd-6b243d30eaec None None] MFA Rules not processed for user `8cd3d42080b043b681aa41201ded30c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:41:57.300128 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-76e3021f-7c8c-4687-aebd-6b243d30eaec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:57.344304 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e83b38-dbb5-4731-a49d-7b1e6954e7da admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:57.364544 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad85eec1-0870-407a-8359-d3826462cbbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:57.366567 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad85eec1-0870-407a-8359-d3826462cbbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:57.367038 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad85eec1-0870-407a-8359-d3826462cbbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:57.367332 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad85eec1-0870-407a-8359-d3826462cbbd admin admin] PATH_INFO: `/v3/projects/8aa47a1e9bc34463879e4b90657c70f2` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:57.370836 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad85eec1-0870-407a-8359-d3826462cbbd admin admin] RBAC: Authorizing `identity:delete_project(project_id=8aa47a1e9bc34463879e4b90657c70f2)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:57.373068 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad85eec1-0870-407a-8359-d3826462cbbd admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:57.408852 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 969/1941] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:41:57 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:41:57.410113 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e3021f-7c8c-4687-aebd-6b243d30eaec None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:57.448871 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e3021f-7c8c-4687-aebd-6b243d30eaec None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:57.463231 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754bbe39-7ba3-44f8-9856-2f82aea085aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:57.464509 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754bbe39-7ba3-44f8-9856-2f82aea085aa admin admin] REQUEST_METHOD: `PUT` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:57.464917 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754bbe39-7ba3-44f8-9856-2f82aea085aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:57.465231 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754bbe39-7ba3-44f8-9856-2f82aea085aa admin admin] PATH_INFO: `/v3/projects/98bc4f231b1445109e12a926cd6795d4/users/b68a55610f4143c5915a1a1f2c991d6b/roles/8eff41f243c843ed95505a488ca6eada` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:57.474843 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-ad85eec1-0870-407a-8359-d3826462cbbd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8aa47a1e9bc34463879e4b90657c70f2', 'request_id': 'req-ad85eec1-0870-407a-8359-d3826462cbbd'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:57.484415 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-ad85eec1-0870-407a-8359-d3826462cbbd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8aa47a1e9bc34463879e4b90657c70f2', 'request_id': 'req-ad85eec1-0870-407a-8359-d3826462cbbd'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:57.495267 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-ad85eec1-0870-407a-8359-d3826462cbbd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8aa47a1e9bc34463879e4b90657c70f2', 'request_id': 'req-ad85eec1-0870-407a-8359-d3826462cbbd'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:57.498263 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754bbe39-7ba3-44f8-9856-2f82aea085aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=98bc4f231b1445109e12a926cd6795d4, user_id=b68a55610f4143c5915a1a1f2c991d6b, role_id=8eff41f243c843ed95505a488ca6eada)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:57.503693 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754bbe39-7ba3-44f8-9856-2f82aea085aa admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:57.520413 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-ad85eec1-0870-407a-8359-d3826462cbbd admin admin] The token cache is being invalidate because project 8aa47a1e9bc34463879e4b90657c70f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:41:57.521214 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-ad85eec1-0870-407a-8359-d3826462cbbd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:57.522117 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-ad85eec1-0870-407a-8359-d3826462cbbd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:57.525138 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 973/1942] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jul 11 14:41:57 2022] DELETE /identity/v3/projects/8aa47a1e9bc34463879e4b90657c70f2 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:41:57.526058 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad85eec1-0870-407a-8359-d3826462cbbd admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:57.527674 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-ad85eec1-0870-407a-8359-d3826462cbbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:57.530814 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 970/1943] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jul 11 14:41:57 2022] PUT /identity/v3/projects/98bc4f231b1445109e12a926cd6795d4/users/b68a55610f4143c5915a1a1f2c991d6b/roles/8eff41f243c843ed95505a488ca6eada => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:41:57.533278 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754bbe39-7ba3-44f8-9856-2f82aea085aa admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:57.541233 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-754bbe39-7ba3-44f8-9856-2f82aea085aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:57.631121 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad85eec1-0870-407a-8359-d3826462cbbd admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:57.636620 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754bbe39-7ba3-44f8-9856-2f82aea085aa admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:57.641746 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d72c91b-cad3-4054-9d4f-8c6e131ddad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:57.642631 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d72c91b-cad3-4054-9d4f-8c6e131ddad8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:57.642919 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d72c91b-cad3-4054-9d4f-8c6e131ddad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:57.643199 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d72c91b-cad3-4054-9d4f-8c6e131ddad8 admin admin] PATH_INFO: `/v3/users/5b92e0618ed14f11a55592cb927f14f5` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:57.644423 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d72c91b-cad3-4054-9d4f-8c6e131ddad8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b92e0618ed14f11a55592cb927f14f5)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:57.646425 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d72c91b-cad3-4054-9d4f-8c6e131ddad8 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:57.648262 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:41:57.684044 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d64c734-7ded-4376-834c-720e5009abd1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '868e7c2dec264512b972c8736d659c34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:57.684858 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d64c734-7ded-4376-834c-720e5009abd1 service cinder] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:57.685208 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d64c734-7ded-4376-834c-720e5009abd1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:57.685755 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d64c734-7ded-4376-834c-720e5009abd1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:57.691568 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-0d64c734-7ded-4376-834c-720e5009abd1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:57.703609 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:41:57.706903 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-4d72c91b-cad3-4054-9d4f-8c6e131ddad8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b92e0618ed14f11a55592cb927f14f5'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:57.722460 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-4d72c91b-cad3-4054-9d4f-8c6e131ddad8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b92e0618ed14f11a55592cb927f14f5'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:57.734003 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-4d72c91b-cad3-4054-9d4f-8c6e131ddad8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b92e0618ed14f11a55592cb927f14f5'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:57.734688 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-4d72c91b-cad3-4054-9d4f-8c6e131ddad8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b92e0618ed14f11a55592cb927f14f5'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:57.736271 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-4d72c91b-cad3-4054-9d4f-8c6e131ddad8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b92e0618ed14f11a55592cb927f14f5'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:57.760891 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 971/1944] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jul 11 14:41:57 2022] DELETE /identity/v3/users/5b92e0618ed14f11a55592cb927f14f5 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:41:57.762963 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c8b244-0233-4d14-adb9-6be1b91de347 None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:57.763256 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c8b244-0233-4d14-adb9-6be1b91de347 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:57.763564 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c8b244-0233-4d14-adb9-6be1b91de347 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:57.770214 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d64c734-7ded-4376-834c-720e5009abd1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:57.771890 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d64c734-7ded-4376-834c-720e5009abd1 service cinder] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:57.787586 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 974/1945] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:41:57 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:41:57.789117 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d64c734-7ded-4376-834c-720e5009abd1 service cinder] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:57.793791 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-0d64c734-7ded-4376-834c-720e5009abd1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:57.795347 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-73c8b244-0233-4d14-adb9-6be1b91de347 None None] MFA Rules not processed for user `b68a55610f4143c5915a1a1f2c991d6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:41:57.796487 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-73c8b244-0233-4d14-adb9-6be1b91de347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:57.820470 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d64c734-7ded-4376-834c-720e5009abd1 service cinder] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:57.894894 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b6e219-f5e4-45ff-b30e-91f2f7a1490a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:57.896114 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b6e219-f5e4-45ff-b30e-91f2f7a1490a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:57.896492 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b6e219-f5e4-45ff-b30e-91f2f7a1490a admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:57.896881 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b6e219-f5e4-45ff-b30e-91f2f7a1490a admin admin] PATH_INFO: `/v3/projects/ec67a91710df4b82a134073bbe01f060` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:57.898362 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b6e219-f5e4-45ff-b30e-91f2f7a1490a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec67a91710df4b82a134073bbe01f060)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:57.898812 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 972/1946] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:41:57 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:41:57.901217 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b6e219-f5e4-45ff-b30e-91f2f7a1490a admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:57.903986 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c8b244-0233-4d14-adb9-6be1b91de347 None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:57.905608 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-73c8b244-0233-4d14-adb9-6be1b91de347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:57.923812 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c8b244-0233-4d14-adb9-6be1b91de347 None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:57.931157 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99b4a03-4a7f-4c5a-8b20-a4f418c54431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:57.932320 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99b4a03-4a7f-4c5a-8b20-a4f418c54431 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:57.932664 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99b4a03-4a7f-4c5a-8b20-a4f418c54431 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:57.932982 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99b4a03-4a7f-4c5a-8b20-a4f418c54431 admin admin] PATH_INFO: `/v3/users/8cd3d42080b043b681aa41201ded30c6` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:57.934150 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99b4a03-4a7f-4c5a-8b20-a4f418c54431 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8cd3d42080b043b681aa41201ded30c6)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:57.936279 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99b4a03-4a7f-4c5a-8b20-a4f418c54431 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:57.974488 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-58b6e219-f5e4-45ff-b30e-91f2f7a1490a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec67a91710df4b82a134073bbe01f060', 'request_id': 'req-58b6e219-f5e4-45ff-b30e-91f2f7a1490a'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:57.984168 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-58b6e219-f5e4-45ff-b30e-91f2f7a1490a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec67a91710df4b82a134073bbe01f060', 'request_id': 'req-58b6e219-f5e4-45ff-b30e-91f2f7a1490a'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:57.992043 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-58b6e219-f5e4-45ff-b30e-91f2f7a1490a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec67a91710df4b82a134073bbe01f060', 'request_id': 'req-58b6e219-f5e4-45ff-b30e-91f2f7a1490a'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:58.013519 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-58b6e219-f5e4-45ff-b30e-91f2f7a1490a admin admin] The token cache is being invalidate because project ec67a91710df4b82a134073bbe01f060 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:41:58.013849 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-58b6e219-f5e4-45ff-b30e-91f2f7a1490a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:58.014751 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-58b6e219-f5e4-45ff-b30e-91f2f7a1490a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:58.016598 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 975/1947] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jul 11 14:41:57 2022] DELETE /identity/v3/projects/ec67a91710df4b82a134073bbe01f060 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:41:58.017238 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b6e219-f5e4-45ff-b30e-91f2f7a1490a admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:58.018694 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-58b6e219-f5e4-45ff-b30e-91f2f7a1490a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:58.020051 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-c99b4a03-4a7f-4c5a-8b20-a4f418c54431 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8cd3d42080b043b681aa41201ded30c6'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:58.030529 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-c99b4a03-4a7f-4c5a-8b20-a4f418c54431 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8cd3d42080b043b681aa41201ded30c6'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:58.041778 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-c99b4a03-4a7f-4c5a-8b20-a4f418c54431 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8cd3d42080b043b681aa41201ded30c6'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:58.042594 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-c99b4a03-4a7f-4c5a-8b20-a4f418c54431 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8cd3d42080b043b681aa41201ded30c6'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:58.043413 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-c99b4a03-4a7f-4c5a-8b20-a4f418c54431 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8cd3d42080b043b681aa41201ded30c6'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:58.045379 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:41:58.070821 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 973/1948] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jul 11 14:41:57 2022] DELETE /identity/v3/users/8cd3d42080b043b681aa41201ded30c6 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:41:58.071554 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99b4a03-4a7f-4c5a-8b20-a4f418c54431 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:58.073559 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-c99b4a03-4a7f-4c5a-8b20-a4f418c54431 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:58.082235 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:41:58.110909 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b6e219-f5e4-45ff-b30e-91f2f7a1490a admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:58.162763 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99b4a03-4a7f-4c5a-8b20-a4f418c54431 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:58.168611 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcc7e5f-d3bc-4e33-ad69-030ef750e4fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:58.169573 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcc7e5f-d3bc-4e33-ad69-030ef750e4fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:58.169849 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcc7e5f-d3bc-4e33-ad69-030ef750e4fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:58.170209 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcc7e5f-d3bc-4e33-ad69-030ef750e4fd admin admin] PATH_INFO: `/v3/users/3fe04744e8c94f9480e9151d059484ca` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:58.172906 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcc7e5f-d3bc-4e33-ad69-030ef750e4fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=3fe04744e8c94f9480e9151d059484ca)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:58.175354 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcc7e5f-d3bc-4e33-ad69-030ef750e4fd admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:58.194301 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1957fd8b-43d1-4265-a1c2-af8e0769e76b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:58.195254 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1957fd8b-43d1-4265-a1c2-af8e0769e76b admin admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:58.195254 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1957fd8b-43d1-4265-a1c2-af8e0769e76b admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:58.197460 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1957fd8b-43d1-4265-a1c2-af8e0769e76b admin admin] PATH_INFO: `/v3/projects` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:58.197826 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1957fd8b-43d1-4265-a1c2-af8e0769e76b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:58.200006 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1957fd8b-43d1-4265-a1c2-af8e0769e76b admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:58.230611 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 976/1949] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jul 11 14:41:58 2022] POST /identity/v3/projects => generated 377 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:41:58.232051 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85a3e6b-e823-4781-8971-c97701d90017 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:58.232464 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85a3e6b-e823-4781-8971-c97701d90017 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:58.232748 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85a3e6b-e823-4781-8971-c97701d90017 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:58.243530 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-dfcc7e5f-d3bc-4e33-ad69-030ef750e4fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3fe04744e8c94f9480e9151d059484ca'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:58.251149 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-dfcc7e5f-d3bc-4e33-ad69-030ef750e4fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3fe04744e8c94f9480e9151d059484ca'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:58.253250 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-d85a3e6b-e823-4781-8971-c97701d90017 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:41:58.254488 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-d85a3e6b-e823-4781-8971-c97701d90017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:58.261151 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-dfcc7e5f-d3bc-4e33-ad69-030ef750e4fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3fe04744e8c94f9480e9151d059484ca'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:58.261938 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-dfcc7e5f-d3bc-4e33-ad69-030ef750e4fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3fe04744e8c94f9480e9151d059484ca'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:58.262691 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-dfcc7e5f-d3bc-4e33-ad69-030ef750e4fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3fe04744e8c94f9480e9151d059484ca'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:58.282483 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 974/1950] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jul 11 14:41:58 2022] DELETE /identity/v3/users/3fe04744e8c94f9480e9151d059484ca => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:41:58.283531 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcc7e5f-d3bc-4e33-ad69-030ef750e4fd admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:58.285065 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-dfcc7e5f-d3bc-4e33-ad69-030ef750e4fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:58.350480 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 977/1951] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:41:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:41:58.351536 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85a3e6b-e823-4781-8971-c97701d90017 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:58.352954 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-d85a3e6b-e823-4781-8971-c97701d90017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:58.370251 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85a3e6b-e823-4781-8971-c97701d90017 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:58.370915 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcc7e5f-d3bc-4e33-ad69-030ef750e4fd admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:58.376362 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2312e2b0-7b7c-486c-8894-d449fd76d8d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:58.377098 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2312e2b0-7b7c-486c-8894-d449fd76d8d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:58.377264 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5456878c-2db0-4ea1-b04e-a22953caf015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:58.377537 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2312e2b0-7b7c-486c-8894-d449fd76d8d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:58.377821 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2312e2b0-7b7c-486c-8894-d449fd76d8d4 admin admin] PATH_INFO: `/v3/users` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:58.378512 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5456878c-2db0-4ea1-b04e-a22953caf015 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:58.378639 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2312e2b0-7b7c-486c-8894-d449fd76d8d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:58.378778 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5456878c-2db0-4ea1-b04e-a22953caf015 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:58.379319 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5456878c-2db0-4ea1-b04e-a22953caf015 admin admin] PATH_INFO: `/v3/projects/474d8a1240584520bcc49805ad720234` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:58.380872 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2312e2b0-7b7c-486c-8894-d449fd76d8d4 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:58.381324 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5456878c-2db0-4ea1-b04e-a22953caf015 admin admin] RBAC: Authorizing `identity:delete_project(project_id=474d8a1240584520bcc49805ad720234)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:58.383981 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5456878c-2db0-4ea1-b04e-a22953caf015 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:58.386236 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:41:58.406085 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 978/1952] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jul 11 14:41:58 2022] POST /identity/v3/users => generated 289 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:41:58.407574 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2312e2b0-7b7c-486c-8894-d449fd76d8d4 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:58.410262 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-2312e2b0-7b7c-486c-8894-d449fd76d8d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:58.449055 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-5456878c-2db0-4ea1-b04e-a22953caf015 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '474d8a1240584520bcc49805ad720234', 'request_id': 'req-5456878c-2db0-4ea1-b04e-a22953caf015'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:58.457386 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-5456878c-2db0-4ea1-b04e-a22953caf015 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '474d8a1240584520bcc49805ad720234', 'request_id': 'req-5456878c-2db0-4ea1-b04e-a22953caf015'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:58.466368 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-5456878c-2db0-4ea1-b04e-a22953caf015 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '474d8a1240584520bcc49805ad720234', 'request_id': 'req-5456878c-2db0-4ea1-b04e-a22953caf015'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:58.484854 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2312e2b0-7b7c-486c-8894-d449fd76d8d4 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:58.489523 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-5456878c-2db0-4ea1-b04e-a22953caf015 admin admin] The token cache is being invalidate because project 474d8a1240584520bcc49805ad720234 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80534) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:41:58.489825 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-5456878c-2db0-4ea1-b04e-a22953caf015 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:58.491127 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-5456878c-2db0-4ea1-b04e-a22953caf015 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:58.496639 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 975/1953] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jul 11 14:41:58 2022] DELETE /identity/v3/projects/474d8a1240584520bcc49805ad720234 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:41:58.496639 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5456878c-2db0-4ea1-b04e-a22953caf015 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:58.496639 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-5456878c-2db0-4ea1-b04e-a22953caf015 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:58.499913 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:41:58.549990 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbed6b0f-8d7f-430c-9875-f38e8d18e154 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20eede5ccd834862b00123310b5c3975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:58.550837 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbed6b0f-8d7f-430c-9875-f38e8d18e154 service neutron] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:58.551133 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbed6b0f-8d7f-430c-9875-f38e8d18e154 service neutron] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:58.551413 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbed6b0f-8d7f-430c-9875-f38e8d18e154 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:58.553558 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-cbed6b0f-8d7f-430c-9875-f38e8d18e154 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:58.589471 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5456878c-2db0-4ea1-b04e-a22953caf015 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:58.594782 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e70461-51f9-40fe-b4e1-9b118451a502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:58.595462 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e70461-51f9-40fe-b4e1-9b118451a502 admin admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:58.595814 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e70461-51f9-40fe-b4e1-9b118451a502 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:58.596162 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e70461-51f9-40fe-b4e1-9b118451a502 admin admin] PATH_INFO: `/v3/roles` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:58.597014 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e70461-51f9-40fe-b4e1-9b118451a502 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:58.598725 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e70461-51f9-40fe-b4e1-9b118451a502 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:58.617593 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 976/1954] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:41:58 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:41:58.624913 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb54982e-282b-4618-9521-cc2162749ab2 None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:58.625199 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb54982e-282b-4618-9521-cc2162749ab2 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:58.626417 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb54982e-282b-4618-9521-cc2162749ab2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:58.658760 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-cb54982e-282b-4618-9521-cc2162749ab2 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:41:58.659979 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-cb54982e-282b-4618-9521-cc2162749ab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:58.668424 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 977/1955] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:41:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:41:58.669303 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb54982e-282b-4618-9521-cc2162749ab2 None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:58.677561 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbed6b0f-8d7f-430c-9875-f38e8d18e154 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:58.679592 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb54982e-282b-4618-9521-cc2162749ab2 None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:58.679873 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbed6b0f-8d7f-430c-9875-f38e8d18e154 service neutron] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:58.685023 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8c5e9c-9df6-4a4e-ade2-c06a6491f686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:58.685747 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8c5e9c-9df6-4a4e-ade2-c06a6491f686 admin admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:58.686060 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8c5e9c-9df6-4a4e-ade2-c06a6491f686 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:58.686370 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8c5e9c-9df6-4a4e-ade2-c06a6491f686 admin admin] PATH_INFO: `/v3/roles` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:58.687232 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8c5e9c-9df6-4a4e-ade2-c06a6491f686 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:58.688924 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8c5e9c-9df6-4a4e-ade2-c06a6491f686 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:58.694587 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 979/1956] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:41:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:41:58.697616 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b2269c-debf-44b6-9daf-025baaf93c58 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:58.697943 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b2269c-debf-44b6-9daf-025baaf93c58 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:58.698214 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b2269c-debf-44b6-9daf-025baaf93c58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:58.704418 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 978/1957] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:41:58 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:41:58.706018 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8c5e9c-9df6-4a4e-ade2-c06a6491f686 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:58.718245 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8c5e9c-9df6-4a4e-ade2-c06a6491f686 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:58.720564 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-91b2269c-debf-44b6-9daf-025baaf93c58 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:41:58.721797 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-91b2269c-debf-44b6-9daf-025baaf93c58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:58.725264 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8469359f-eb0f-4410-b229-a1b684ec5f21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:58.725264 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8469359f-eb0f-4410-b229-a1b684ec5f21 admin admin] REQUEST_METHOD: `PUT` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:58.725264 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8469359f-eb0f-4410-b229-a1b684ec5f21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:58.725561 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8469359f-eb0f-4410-b229-a1b684ec5f21 admin admin] PATH_INFO: `/v3/projects/a14d9382c08b4874830639eb16e71883/users/8347fd229e6549b1b68947486d399091/roles/8eff41f243c843ed95505a488ca6eada` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:58.733833 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 980/1958] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:41:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:41:58.738912 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b2269c-debf-44b6-9daf-025baaf93c58 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:58.745678 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8469359f-eb0f-4410-b229-a1b684ec5f21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a14d9382c08b4874830639eb16e71883, user_id=8347fd229e6549b1b68947486d399091, role_id=8eff41f243c843ed95505a488ca6eada)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:58.748405 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8469359f-eb0f-4410-b229-a1b684ec5f21 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:58.750896 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b2269c-debf-44b6-9daf-025baaf93c58 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:58.756296 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc591d1a-908d-49e7-85af-ac49daefeb28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:58.757316 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc591d1a-908d-49e7-85af-ac49daefeb28 admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:58.757635 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc591d1a-908d-49e7-85af-ac49daefeb28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:58.757912 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc591d1a-908d-49e7-85af-ac49daefeb28 admin admin] PATH_INFO: `/v3/domains` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:58.766051 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc591d1a-908d-49e7-85af-ac49daefeb28 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:41:58.766051 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc591d1a-908d-49e7-85af-ac49daefeb28 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:58.766051 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc591d1a-908d-49e7-85af-ac49daefeb28 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:58.784239 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 979/1959] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jul 11 14:41:58 2022] PUT /identity/v3/projects/a14d9382c08b4874830639eb16e71883/users/8347fd229e6549b1b68947486d399091/roles/8eff41f243c843ed95505a488ca6eada => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:41:58.784571 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 981/1960] 10.222.0.70 () {58 vars in 1152 bytes} [Mon Jul 11 14:41:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:41:58.784679 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8469359f-eb0f-4410-b229-a1b684ec5f21 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:58.789088 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0c119d-ca25-4f24-958d-822cb9cec8ab None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:58.789505 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0c119d-ca25-4f24-958d-822cb9cec8ab None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:58.789859 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0c119d-ca25-4f24-958d-822cb9cec8ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:58.826880 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-0f0c119d-ca25-4f24-958d-822cb9cec8ab None None] MFA Rules not processed for user `8347fd229e6549b1b68947486d399091`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:41:58.828374 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-0f0c119d-ca25-4f24-958d-822cb9cec8ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:58.840326 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:41:58.864985 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8469359f-eb0f-4410-b229-a1b684ec5f21 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:58.873252 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7450c3a-4bf9-4383-a256-d2fece5ead66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:58.874026 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7450c3a-4bf9-4383-a256-d2fece5ead66 admin admin] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:58.874379 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7450c3a-4bf9-4383-a256-d2fece5ead66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:58.874954 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7450c3a-4bf9-4383-a256-d2fece5ead66 admin admin] PATH_INFO: `/v3/projects` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:58.875826 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7450c3a-4bf9-4383-a256-d2fece5ead66 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:58.879170 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7450c3a-4bf9-4383-a256-d2fece5ead66 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:58.908342 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 982/1961] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:41:58 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:41:58.913217 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0c119d-ca25-4f24-958d-822cb9cec8ab None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:58.913382 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 980/1962] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jul 11 14:41:58 2022] POST /identity/v3/projects => generated 383 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:41:58.918798 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7450c3a-4bf9-4383-a256-d2fece5ead66 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:58.928060 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0c119d-ca25-4f24-958d-822cb9cec8ab None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:58.969234 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:41:59.003682 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7450c3a-4bf9-4383-a256-d2fece5ead66 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:59.010051 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e009499b-88c2-46ad-996c-b5459cbc6a6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:59.019332 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e009499b-88c2-46ad-996c-b5459cbc6a6f admin admin] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:59.019332 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e009499b-88c2-46ad-996c-b5459cbc6a6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:59.019332 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e009499b-88c2-46ad-996c-b5459cbc6a6f admin admin] PATH_INFO: `/v3/users` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:59.019332 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e009499b-88c2-46ad-996c-b5459cbc6a6f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:59.019332 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e009499b-88c2-46ad-996c-b5459cbc6a6f admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:59.042115 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 981/1963] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jul 11 14:41:58 2022] POST /identity/v3/users => generated 292 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:41:59.056234 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e009499b-88c2-46ad-996c-b5459cbc6a6f admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:59.056969 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f2b85e-0bf8-4c34-a0ac-353acb5ef805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:59.057698 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f2b85e-0bf8-4c34-a0ac-353acb5ef805 admin admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:59.060536 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f2b85e-0bf8-4c34-a0ac-353acb5ef805 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:59.060830 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f2b85e-0bf8-4c34-a0ac-353acb5ef805 admin admin] PATH_INFO: `/v3/projects` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:59.061519 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f2b85e-0bf8-4c34-a0ac-353acb5ef805 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:59.064345 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f2b85e-0bf8-4c34-a0ac-353acb5ef805 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:59.077745 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e009499b-88c2-46ad-996c-b5459cbc6a6f admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:59.082923 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41c1a13-e267-4841-9e60-cd8ed3eb01ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:59.083609 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41c1a13-e267-4841-9e60-cd8ed3eb01ab admin admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:59.084056 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41c1a13-e267-4841-9e60-cd8ed3eb01ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:59.084239 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41c1a13-e267-4841-9e60-cd8ed3eb01ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:59.084946 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41c1a13-e267-4841-9e60-cd8ed3eb01ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:59.086632 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41c1a13-e267-4841-9e60-cd8ed3eb01ab admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:59.097648 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 982/1964] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:41:59 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:41:59.102717 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41c1a13-e267-4841-9e60-cd8ed3eb01ab admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:59.113293 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 983/1965] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jul 11 14:41:58 2022] POST /identity/v3/projects => generated 377 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:41:59.117118 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f2b85e-0bf8-4c34-a0ac-353acb5ef805 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:59.118432 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41c1a13-e267-4841-9e60-cd8ed3eb01ab admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:59.194199 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6a6a5f-bf8f-49f8-8a86-d7d3a358b8eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:59.194998 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6a6a5f-bf8f-49f8-8a86-d7d3a358b8eb admin admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:59.195324 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6a6a5f-bf8f-49f8-8a86-d7d3a358b8eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:59.195458 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6a6a5f-bf8f-49f8-8a86-d7d3a358b8eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:59.196481 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6a6a5f-bf8f-49f8-8a86-d7d3a358b8eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:59.198936 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6a6a5f-bf8f-49f8-8a86-d7d3a358b8eb admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:59.199045 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f2b85e-0bf8-4c34-a0ac-353acb5ef805 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:59.205088 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514b0cdf-9674-4ee3-8155-0384da58dda1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:59.207337 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514b0cdf-9674-4ee3-8155-0384da58dda1 admin admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:59.207917 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514b0cdf-9674-4ee3-8155-0384da58dda1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:59.208457 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514b0cdf-9674-4ee3-8155-0384da58dda1 admin admin] PATH_INFO: `/v3/users` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:59.210110 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514b0cdf-9674-4ee3-8155-0384da58dda1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:59.213758 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514b0cdf-9674-4ee3-8155-0384da58dda1 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:59.214438 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 983/1966] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:41:59 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:41:59.215500 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6a6a5f-bf8f-49f8-8a86-d7d3a358b8eb admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:59.221423 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-ca6a6a5f-bf8f-49f8-8a86-d7d3a358b8eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:59.241843 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6a6a5f-bf8f-49f8-8a86-d7d3a358b8eb admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:59.247178 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 984/1967] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jul 11 14:41:59 2022] POST /identity/v3/users => generated 295 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:41:59.247178 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514b0cdf-9674-4ee3-8155-0384da58dda1 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:59.254557 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b72372c-b037-49e0-a797-285bfcac74c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:59.255697 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b72372c-b037-49e0-a797-285bfcac74c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:59.257487 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514b0cdf-9674-4ee3-8155-0384da58dda1 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:59.260790 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b72372c-b037-49e0-a797-285bfcac74c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:59.261280 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b72372c-b037-49e0-a797-285bfcac74c4 admin admin] PATH_INFO: `/v3/projects/6d0a3c0964614962bafd5c0851119f9a` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:59.263242 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b72372c-b037-49e0-a797-285bfcac74c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d0a3c0964614962bafd5c0851119f9a)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:59.264044 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98dcfb1-e162-46ee-a9c4-f8995030f4ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:59.265265 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98dcfb1-e162-46ee-a9c4-f8995030f4ae admin admin] REQUEST_METHOD: `PUT` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:59.265782 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98dcfb1-e162-46ee-a9c4-f8995030f4ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:59.266277 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98dcfb1-e162-46ee-a9c4-f8995030f4ae admin admin] PATH_INFO: `/v3/projects/5c707cd4833d4282bd478d981d6c50c2/users/fbf08b798e684f95ade7d13d6f6b9294/roles/8eff41f243c843ed95505a488ca6eada` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:59.267567 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b72372c-b037-49e0-a797-285bfcac74c4 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:59.292462 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98dcfb1-e162-46ee-a9c4-f8995030f4ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c707cd4833d4282bd478d981d6c50c2, user_id=fbf08b798e684f95ade7d13d6f6b9294, role_id=8eff41f243c843ed95505a488ca6eada)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:59.296149 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98dcfb1-e162-46ee-a9c4-f8995030f4ae admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:59.320378 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 985/1968] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jul 11 14:41:59 2022] PUT /identity/v3/projects/5c707cd4833d4282bd478d981d6c50c2/users/fbf08b798e684f95ade7d13d6f6b9294/roles/8eff41f243c843ed95505a488ca6eada => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:41:59.321429 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98dcfb1-e162-46ee-a9c4-f8995030f4ae admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:59.334272 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:41:59.346022 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-7b72372c-b037-49e0-a797-285bfcac74c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d0a3c0964614962bafd5c0851119f9a', 'request_id': 'req-7b72372c-b037-49e0-a797-285bfcac74c4'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:59.357521 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-7b72372c-b037-49e0-a797-285bfcac74c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d0a3c0964614962bafd5c0851119f9a', 'request_id': 'req-7b72372c-b037-49e0-a797-285bfcac74c4'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:59.372618 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-7b72372c-b037-49e0-a797-285bfcac74c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d0a3c0964614962bafd5c0851119f9a', 'request_id': 'req-7b72372c-b037-49e0-a797-285bfcac74c4'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:59.387879 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-7b72372c-b037-49e0-a797-285bfcac74c4 admin admin] The token cache is being invalidate because project 6d0a3c0964614962bafd5c0851119f9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80534) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:41:59.389210 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-7b72372c-b037-49e0-a797-285bfcac74c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:59.390098 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-7b72372c-b037-49e0-a797-285bfcac74c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:59.392540 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 984/1969] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jul 11 14:41:59 2022] DELETE /identity/v3/projects/6d0a3c0964614962bafd5c0851119f9a => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:41:59.394713 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a318850-942f-49f0-8729-7179abb1f04f None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:59.395305 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a318850-942f-49f0-8729-7179abb1f04f None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:59.395974 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a318850-942f-49f0-8729-7179abb1f04f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:59.439001 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-8a318850-942f-49f0-8729-7179abb1f04f None None] MFA Rules not processed for user `fbf08b798e684f95ade7d13d6f6b9294`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:41:59.441361 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-8a318850-942f-49f0-8729-7179abb1f04f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:59.464524 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98dcfb1-e162-46ee-a9c4-f8995030f4ae admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:59.511846 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:41:59.565698 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f21f9f2-fa93-44a6-b41a-5acc0efa29cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:59.566544 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f21f9f2-fa93-44a6-b41a-5acc0efa29cd admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:59.567345 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f21f9f2-fa93-44a6-b41a-5acc0efa29cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:59.567957 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f21f9f2-fa93-44a6-b41a-5acc0efa29cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:59.568746 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f21f9f2-fa93-44a6-b41a-5acc0efa29cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:59.571813 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f21f9f2-fa93-44a6-b41a-5acc0efa29cd admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:59.587914 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 986/1970] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:41:59 2022] GET /identity/v3/roles => generated 1420 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:41:59.587914 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66299c57-fe5d-42c2-a9cb-4096bdf53c78 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:59.588189 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66299c57-fe5d-42c2-a9cb-4096bdf53c78 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:59.588466 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66299c57-fe5d-42c2-a9cb-4096bdf53c78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:59.612537 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 985/1971] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:41:59 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:41:59.614046 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a318850-942f-49f0-8729-7179abb1f04f None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:59.615459 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-8a318850-942f-49f0-8729-7179abb1f04f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:59.621299 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-66299c57-fe5d-42c2-a9cb-4096bdf53c78 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:41:59.623550 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-66299c57-fe5d-42c2-a9cb-4096bdf53c78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:59.640954 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a318850-942f-49f0-8729-7179abb1f04f None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:59.650708 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 987/1972] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:41:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:41:59.656873 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a55b95-e7d9-4ad8-add3-a5c4994afaa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:59.656976 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66299c57-fe5d-42c2-a9cb-4096bdf53c78 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:59.657055 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a55b95-e7d9-4ad8-add3-a5c4994afaa1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:59.657131 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-66299c57-fe5d-42c2-a9cb-4096bdf53c78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:59.657201 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a55b95-e7d9-4ad8-add3-a5c4994afaa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:59.657201 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a55b95-e7d9-4ad8-add3-a5c4994afaa1 admin admin] PATH_INFO: `/v3/projects/ae91866893854a0eaf63890dd1d2b811/users/4da2fe93ea26476c8e6494092ae0e4e8/roles/b46df176b0fe479da63c318db225bed4` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:59.700394 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a55b95-e7d9-4ad8-add3-a5c4994afaa1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae91866893854a0eaf63890dd1d2b811, user_id=4da2fe93ea26476c8e6494092ae0e4e8, role_id=b46df176b0fe479da63c318db225bed4)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:59.702262 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66299c57-fe5d-42c2-a9cb-4096bdf53c78 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:59.710148 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a55b95-e7d9-4ad8-add3-a5c4994afaa1 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:59.732784 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8937c94d-36e9-4ea1-89b0-bd6b94277f4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:59.734873 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8937c94d-36e9-4ea1-89b0-bd6b94277f4a admin admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:59.735170 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8937c94d-36e9-4ea1-89b0-bd6b94277f4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:59.735450 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8937c94d-36e9-4ea1-89b0-bd6b94277f4a admin admin] PATH_INFO: `/v3/projects` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:59.736247 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8937c94d-36e9-4ea1-89b0-bd6b94277f4a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:59.739588 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8937c94d-36e9-4ea1-89b0-bd6b94277f4a admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:59.740816 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 986/1973] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jul 11 14:41:59 2022] PUT /identity/v3/projects/ae91866893854a0eaf63890dd1d2b811/users/4da2fe93ea26476c8e6494092ae0e4e8/roles/b46df176b0fe479da63c318db225bed4 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:41:59.745559 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a55b95-e7d9-4ad8-add3-a5c4994afaa1 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:59.748421 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-97a55b95-e7d9-4ad8-add3-a5c4994afaa1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:59.802649 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 988/1974] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jul 11 14:41:59 2022] POST /identity/v3/projects => generated 385 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:41:59.804050 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f3d771-27cf-44d9-9afc-3a7e1757667d None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:59.804381 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f3d771-27cf-44d9-9afc-3a7e1757667d None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:59.804661 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f3d771-27cf-44d9-9afc-3a7e1757667d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:59.827497 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-24f3d771-27cf-44d9-9afc-3a7e1757667d None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:41:59.828771 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-24f3d771-27cf-44d9-9afc-3a7e1757667d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:59.833848 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a55b95-e7d9-4ad8-add3-a5c4994afaa1 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:59.882238 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:41:59.905410 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5e12cc-b95e-4be1-bba0-5cfd2b3ab2ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:59.908467 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5e12cc-b95e-4be1-bba0-5cfd2b3ab2ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:59.908637 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 989/1975] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:41:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:41:59.908730 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5e12cc-b95e-4be1-bba0-5cfd2b3ab2ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:59.908730 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5e12cc-b95e-4be1-bba0-5cfd2b3ab2ac admin admin] PATH_INFO: `/v3/projects/5aa6307f6f7741129661386d956c9af5` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:59.908872 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f3d771-27cf-44d9-9afc-3a7e1757667d None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:59.909723 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5e12cc-b95e-4be1-bba0-5cfd2b3ab2ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=5aa6307f6f7741129661386d956c9af5)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:59.911724 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5e12cc-b95e-4be1-bba0-5cfd2b3ab2ac admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:59.922395 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f3d771-27cf-44d9-9afc-3a7e1757667d None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:59.928350 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9f2a8d-00f6-43dd-ac5f-d5d89e4706cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:59.929041 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9f2a8d-00f6-43dd-ac5f-d5d89e4706cb admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:59.929325 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9f2a8d-00f6-43dd-ac5f-d5d89e4706cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:59.929601 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9f2a8d-00f6-43dd-ac5f-d5d89e4706cb admin admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:59.931202 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9f2a8d-00f6-43dd-ac5f-d5d89e4706cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:59.933201 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9f2a8d-00f6-43dd-ac5f-d5d89e4706cb admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:59.944653 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 990/1976] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:41:59 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:41:59.946114 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9f2a8d-00f6-43dd-ac5f-d5d89e4706cb admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:59.958999 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9f2a8d-00f6-43dd-ac5f-d5d89e4706cb admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:59.973649 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-0f5e12cc-b95e-4be1-bba0-5cfd2b3ab2ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5aa6307f6f7741129661386d956c9af5', 'request_id': 'req-0f5e12cc-b95e-4be1-bba0-5cfd2b3ab2ac'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:59.981584 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-0f5e12cc-b95e-4be1-bba0-5cfd2b3ab2ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5aa6307f6f7741129661386d956c9af5', 'request_id': 'req-0f5e12cc-b95e-4be1-bba0-5cfd2b3ab2ac'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:41:59.993631 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-0f5e12cc-b95e-4be1-bba0-5cfd2b3ab2ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5aa6307f6f7741129661386d956c9af5', 'request_id': 'req-0f5e12cc-b95e-4be1-bba0-5cfd2b3ab2ac'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:00.004848 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-0f5e12cc-b95e-4be1-bba0-5cfd2b3ab2ac admin admin] The token cache is being invalidate because project 5aa6307f6f7741129661386d956c9af5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80534) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:42:00.005221 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-0f5e12cc-b95e-4be1-bba0-5cfd2b3ab2ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:00.005944 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-0f5e12cc-b95e-4be1-bba0-5cfd2b3ab2ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:00.007562 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 987/1977] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jul 11 14:41:59 2022] DELETE /identity/v3/projects/5aa6307f6f7741129661386d956c9af5 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:42:00.008546 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5e12cc-b95e-4be1-bba0-5cfd2b3ab2ac admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:00.010102 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-0f5e12cc-b95e-4be1-bba0-5cfd2b3ab2ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:42:00.046122 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386bb032-737c-4226-9b8a-dc91928ac76e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:00.046852 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386bb032-737c-4226-9b8a-dc91928ac76e admin admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:00.048623 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386bb032-737c-4226-9b8a-dc91928ac76e admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:00.051796 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386bb032-737c-4226-9b8a-dc91928ac76e admin admin] PATH_INFO: `/v3/users` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:00.052640 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386bb032-737c-4226-9b8a-dc91928ac76e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:00.054630 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386bb032-737c-4226-9b8a-dc91928ac76e admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:00.101395 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 991/1978] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jul 11 14:41:59 2022] POST /identity/v3/users => generated 299 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:42:00.101395 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386bb032-737c-4226-9b8a-dc91928ac76e admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:00.104942 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-386bb032-737c-4226-9b8a-dc91928ac76e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:42:00.143191 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386bb032-737c-4226-9b8a-dc91928ac76e admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:00.150633 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc563ec5-1cfa-4a34-90d1-b37c8ffea3cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:00.151951 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc563ec5-1cfa-4a34-90d1-b37c8ffea3cf admin admin] REQUEST_METHOD: `PUT` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:00.152648 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5e12cc-b95e-4be1-bba0-5cfd2b3ab2ac admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:00.152933 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc563ec5-1cfa-4a34-90d1-b37c8ffea3cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:00.153486 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc563ec5-1cfa-4a34-90d1-b37c8ffea3cf admin admin] PATH_INFO: `/v3/projects/ae91866893854a0eaf63890dd1d2b811/users/4da2fe93ea26476c8e6494092ae0e4e8/roles/b46df176b0fe479da63c318db225bed4` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:00.156520 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc563ec5-1cfa-4a34-90d1-b37c8ffea3cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae91866893854a0eaf63890dd1d2b811, user_id=4da2fe93ea26476c8e6494092ae0e4e8, role_id=b46df176b0fe479da63c318db225bed4)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:00.159770 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc563ec5-1cfa-4a34-90d1-b37c8ffea3cf admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:00.161062 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070d29d4-14bb-4473-ac03-9323f4fb472d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:00.161764 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070d29d4-14bb-4473-ac03-9323f4fb472d admin admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:00.162105 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070d29d4-14bb-4473-ac03-9323f4fb472d admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:00.162387 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070d29d4-14bb-4473-ac03-9323f4fb472d admin admin] PATH_INFO: `/v3/domains` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:00.163144 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070d29d4-14bb-4473-ac03-9323f4fb472d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:42:00.163503 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070d29d4-14bb-4473-ac03-9323f4fb472d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:00.166306 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070d29d4-14bb-4473-ac03-9323f4fb472d admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:00.176881 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 992/1979] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jul 11 14:42:00 2022] PUT /identity/v3/projects/ae91866893854a0eaf63890dd1d2b811/users/4da2fe93ea26476c8e6494092ae0e4e8/roles/b46df176b0fe479da63c318db225bed4 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:42:00.178582 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc563ec5-1cfa-4a34-90d1-b37c8ffea3cf admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:00.187804 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-fc563ec5-1cfa-4a34-90d1-b37c8ffea3cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:42:00.190319 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 988/1980] 10.222.0.70 () {58 vars in 1152 bytes} [Mon Jul 11 14:42:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:42:00.192254 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab232306-0661-4c1e-a160-8cfa66ae2f26 None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:00.194275 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab232306-0661-4c1e-a160-8cfa66ae2f26 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:00.194753 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab232306-0661-4c1e-a160-8cfa66ae2f26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:00.200450 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:42:00.254451 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-ab232306-0661-4c1e-a160-8cfa66ae2f26 None None] MFA Rules not processed for user `4da2fe93ea26476c8e6494092ae0e4e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:42:00.256607 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-ab232306-0661-4c1e-a160-8cfa66ae2f26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:42:00.282420 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc563ec5-1cfa-4a34-90d1-b37c8ffea3cf admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:00.287360 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6788d0b-d359-45a0-9356-4a3e9ce50542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:00.288048 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6788d0b-d359-45a0-9356-4a3e9ce50542 admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:00.288369 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6788d0b-d359-45a0-9356-4a3e9ce50542 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:00.288647 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6788d0b-d359-45a0-9356-4a3e9ce50542 admin admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:00.289379 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6788d0b-d359-45a0-9356-4a3e9ce50542 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:00.291576 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6788d0b-d359-45a0-9356-4a3e9ce50542 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:00.303665 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 993/1981] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:42:00 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:42:00.303665 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6788d0b-d359-45a0-9356-4a3e9ce50542 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:00.316586 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6788d0b-d359-45a0-9356-4a3e9ce50542 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:00.324133 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2124a9d-fe55-4905-bcaf-420118629817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:00.324855 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:42:00.324993 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2124a9d-fe55-4905-bcaf-420118629817 admin admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:00.325342 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2124a9d-fe55-4905-bcaf-420118629817 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:00.325702 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2124a9d-fe55-4905-bcaf-420118629817 admin admin] PATH_INFO: `/v3/projects` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:00.326487 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2124a9d-fe55-4905-bcaf-420118629817 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:00.328764 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2124a9d-fe55-4905-bcaf-420118629817 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:00.368449 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 989/1982] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:42:00 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:42:00.370733 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab232306-0661-4c1e-a160-8cfa66ae2f26 None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:00.380982 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 994/1983] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jul 11 14:42:00 2022] POST /identity/v3/projects => generated 387 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:42:00.383090 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2124a9d-fe55-4905-bcaf-420118629817 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:00.383918 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab232306-0661-4c1e-a160-8cfa66ae2f26 None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:00.491596 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2124a9d-fe55-4905-bcaf-420118629817 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:00.500951 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289facae-68f0-4fe6-ad13-a39d8d06b85d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:00.501231 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b26f94-0f89-40bd-8a79-3eb876a53e19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:00.501707 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289facae-68f0-4fe6-ad13-a39d8d06b85d admin admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:00.502155 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289facae-68f0-4fe6-ad13-a39d8d06b85d admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:00.502528 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289facae-68f0-4fe6-ad13-a39d8d06b85d admin admin] PATH_INFO: `/v3/users` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:00.502705 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b26f94-0f89-40bd-8a79-3eb876a53e19 admin admin] REQUEST_METHOD: `PUT` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:00.503203 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b26f94-0f89-40bd-8a79-3eb876a53e19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:00.503843 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289facae-68f0-4fe6-ad13-a39d8d06b85d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:00.504009 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b26f94-0f89-40bd-8a79-3eb876a53e19 admin admin] PATH_INFO: `/v3/projects/b91b188b8d3d46f3a93311b33ee99062/users/37113bb017f94f4eb91f5d76905b9856/roles/b46df176b0fe479da63c318db225bed4` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:00.507643 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289facae-68f0-4fe6-ad13-a39d8d06b85d admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:00.526825 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b26f94-0f89-40bd-8a79-3eb876a53e19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b91b188b8d3d46f3a93311b33ee99062, user_id=37113bb017f94f4eb91f5d76905b9856, role_id=b46df176b0fe479da63c318db225bed4)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:00.530605 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b26f94-0f89-40bd-8a79-3eb876a53e19 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:00.544903 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 995/1984] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jul 11 14:42:00 2022] POST /identity/v3/users => generated 294 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:42:00.546105 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289facae-68f0-4fe6-ad13-a39d8d06b85d admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:00.547934 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-289facae-68f0-4fe6-ad13-a39d8d06b85d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:42:00.559876 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 990/1985] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jul 11 14:42:00 2022] PUT /identity/v3/projects/b91b188b8d3d46f3a93311b33ee99062/users/37113bb017f94f4eb91f5d76905b9856/roles/b46df176b0fe479da63c318db225bed4 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:42:00.564753 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b26f94-0f89-40bd-8a79-3eb876a53e19 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:00.646377 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289facae-68f0-4fe6-ad13-a39d8d06b85d admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:00.652538 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b26f94-0f89-40bd-8a79-3eb876a53e19 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:00.657386 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af01db7-10ad-4d4d-84b0-c7050ff0b0a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:00.658061 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af01db7-10ad-4d4d-84b0-c7050ff0b0a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:00.658348 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af01db7-10ad-4d4d-84b0-c7050ff0b0a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:00.658630 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af01db7-10ad-4d4d-84b0-c7050ff0b0a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:00.659366 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af01db7-10ad-4d4d-84b0-c7050ff0b0a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:00.661032 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af01db7-10ad-4d4d-84b0-c7050ff0b0a2 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:00.671266 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 991/1986] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:42:00 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:42:00.672096 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af01db7-10ad-4d4d-84b0-c7050ff0b0a2 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:00.673224 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:42:00.684460 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af01db7-10ad-4d4d-84b0-c7050ff0b0a2 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:00.689224 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57a4677-7445-40b1-be13-1832270a76f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:00.690304 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57a4677-7445-40b1-be13-1832270a76f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:00.690592 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57a4677-7445-40b1-be13-1832270a76f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:00.690872 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57a4677-7445-40b1-be13-1832270a76f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:00.691594 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57a4677-7445-40b1-be13-1832270a76f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:00.693225 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57a4677-7445-40b1-be13-1832270a76f4 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:00.703074 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b009d69-d484-4594-819b-00ba4b6082c8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '868e7c2dec264512b972c8736d659c34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:00.703734 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b009d69-d484-4594-819b-00ba4b6082c8 service cinder] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:00.704022 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b009d69-d484-4594-819b-00ba4b6082c8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:00.704156 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 992/1987] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:42:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:42:00.704401 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b009d69-d484-4594-819b-00ba4b6082c8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:00.704901 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57a4677-7445-40b1-be13-1832270a76f4 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:00.714905 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57a4677-7445-40b1-be13-1832270a76f4 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:00.719783 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31777318-4241-4ef7-9429-f2aef6883bca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:00.720826 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31777318-4241-4ef7-9429-f2aef6883bca admin admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:00.721119 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31777318-4241-4ef7-9429-f2aef6883bca admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:00.721397 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31777318-4241-4ef7-9429-f2aef6883bca admin admin] PATH_INFO: `/v3/roles` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:00.722151 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31777318-4241-4ef7-9429-f2aef6883bca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:00.723744 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31777318-4241-4ef7-9429-f2aef6883bca admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:00.735880 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 993/1988] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:42:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:42:00.736709 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31777318-4241-4ef7-9429-f2aef6883bca admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:00.748001 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31777318-4241-4ef7-9429-f2aef6883bca admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:00.752739 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d10da22-8250-46da-987e-13a4014e6c9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:00.753605 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d10da22-8250-46da-987e-13a4014e6c9a admin admin] REQUEST_METHOD: `PUT` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:00.754041 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d10da22-8250-46da-987e-13a4014e6c9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:00.754329 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d10da22-8250-46da-987e-13a4014e6c9a admin admin] PATH_INFO: `/v3/projects/b91b188b8d3d46f3a93311b33ee99062/users/37113bb017f94f4eb91f5d76905b9856/roles/b46df176b0fe479da63c318db225bed4` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:00.756418 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d10da22-8250-46da-987e-13a4014e6c9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b91b188b8d3d46f3a93311b33ee99062, user_id=37113bb017f94f4eb91f5d76905b9856, role_id=b46df176b0fe479da63c318db225bed4)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:00.759619 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d10da22-8250-46da-987e-13a4014e6c9a admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:00.771282 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 994/1989] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jul 11 14:42:00 2022] PUT /identity/v3/projects/b91b188b8d3d46f3a93311b33ee99062/users/37113bb017f94f4eb91f5d76905b9856/roles/b46df176b0fe479da63c318db225bed4 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:42:00.772103 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d10da22-8250-46da-987e-13a4014e6c9a admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:00.784428 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b009d69-d484-4594-819b-00ba4b6082c8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:00.785991 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b009d69-d484-4594-819b-00ba4b6082c8 service cinder] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:00.797661 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 996/1990] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:42:00 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:42:00.800832 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a218a8b-097b-42e1-a4a6-4652b1aeaade None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:00.801118 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a218a8b-097b-42e1-a4a6-4652b1aeaade None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:00.801571 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a218a8b-097b-42e1-a4a6-4652b1aeaade None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:00.820105 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:42:00.840960 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-1a218a8b-097b-42e1-a4a6-4652b1aeaade None None] MFA Rules not processed for user `37113bb017f94f4eb91f5d76905b9856`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:42:00.842609 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-1a218a8b-097b-42e1-a4a6-4652b1aeaade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:42:00.872616 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d10da22-8250-46da-987e-13a4014e6c9a admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:00.879568 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9197bb81-6788-4ff8-966a-aee47d75635e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:00.880584 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9197bb81-6788-4ff8-966a-aee47d75635e admin admin] REQUEST_METHOD: `PUT` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:00.881150 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9197bb81-6788-4ff8-966a-aee47d75635e admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:00.881439 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9197bb81-6788-4ff8-966a-aee47d75635e admin admin] PATH_INFO: `/v3/projects/d9ea725f646f4843a506533f24c1e7b0/users/4e0db46562fe4824a0e0a00257c6fa56/roles/8eff41f243c843ed95505a488ca6eada` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:00.901696 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9197bb81-6788-4ff8-966a-aee47d75635e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9ea725f646f4843a506533f24c1e7b0, user_id=4e0db46562fe4824a0e0a00257c6fa56, role_id=8eff41f243c843ed95505a488ca6eada)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:00.904511 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9197bb81-6788-4ff8-966a-aee47d75635e admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:00.925620 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 995/1991] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jul 11 14:42:00 2022] PUT /identity/v3/projects/d9ea725f646f4843a506533f24c1e7b0/users/4e0db46562fe4824a0e0a00257c6fa56/roles/8eff41f243c843ed95505a488ca6eada => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:42:00.927184 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9197bb81-6788-4ff8-966a-aee47d75635e admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:00.929544 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-9197bb81-6788-4ff8-966a-aee47d75635e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:42:00.948405 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 997/1992] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:42:00 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:42:00.951444 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3febf2af-2392-4987-b801-74a2021ef5de None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:00.951940 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3febf2af-2392-4987-b801-74a2021ef5de None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:00.952449 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3febf2af-2392-4987-b801-74a2021ef5de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:00.987587 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-3febf2af-2392-4987-b801-74a2021ef5de None None] MFA Rules not processed for user `4e0db46562fe4824a0e0a00257c6fa56`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:42:00.989373 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-3febf2af-2392-4987-b801-74a2021ef5de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:42:01.010175 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9197bb81-6788-4ff8-966a-aee47d75635e admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:01.013793 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b6c197-a847-4d53-8e4f-478e70a1675a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '868e7c2dec264512b972c8736d659c34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:01.014448 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b6c197-a847-4d53-8e4f-478e70a1675a service cinder] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:01.014735 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b6c197-a847-4d53-8e4f-478e70a1675a service cinder] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:01.015007 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b6c197-a847-4d53-8e4f-478e70a1675a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:01.016887 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-35b6c197-a847-4d53-8e4f-478e70a1675a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:42:01.042308 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:42:01.062341 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 998/1993] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:42:00 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:42:01.062884 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3febf2af-2392-4987-b801-74a2021ef5de None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:01.078970 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3febf2af-2392-4987-b801-74a2021ef5de None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:01.083066 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b6c197-a847-4d53-8e4f-478e70a1675a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:01.083416 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37046c1a-c8bc-4051-8485-d7a838979239 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '868e7c2dec264512b972c8736d659c34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:01.084076 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37046c1a-c8bc-4051-8485-d7a838979239 service cinder] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:01.084468 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37046c1a-c8bc-4051-8485-d7a838979239 service cinder] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:01.084823 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37046c1a-c8bc-4051-8485-d7a838979239 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:01.084919 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b6c197-a847-4d53-8e4f-478e70a1675a service cinder] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:01.087093 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-37046c1a-c8bc-4051-8485-d7a838979239 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:42:01.094897 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 996/1994] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:42:00 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:42:01.095717 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b6c197-a847-4d53-8e4f-478e70a1675a service cinder] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:01.159496 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37046c1a-c8bc-4051-8485-d7a838979239 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:01.161129 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37046c1a-c8bc-4051-8485-d7a838979239 service cinder] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:01.172621 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b6c197-a847-4d53-8e4f-478e70a1675a service cinder] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:01.172752 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 999/1995] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:42:01 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:42:01.177616 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6894e9bc-58c0-4ea9-8331-923b66997685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:01.178454 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6894e9bc-58c0-4ea9-8331-923b66997685 admin admin] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:01.178847 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6894e9bc-58c0-4ea9-8331-923b66997685 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:01.179207 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6894e9bc-58c0-4ea9-8331-923b66997685 admin admin] PATH_INFO: `/v3/projects` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:01.180000 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6894e9bc-58c0-4ea9-8331-923b66997685 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:01.182968 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6894e9bc-58c0-4ea9-8331-923b66997685 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:01.199882 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:42:01.216245 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 997/1996] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jul 11 14:42:01 2022] POST /identity/v3/projects => generated 389 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:42:01.219049 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37046c1a-c8bc-4051-8485-d7a838979239 service cinder] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:01.231296 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37046c1a-c8bc-4051-8485-d7a838979239 service cinder] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:01.307285 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a208640-b5b5-453b-91ee-c403a4024a14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:01.308296 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a208640-b5b5-453b-91ee-c403a4024a14 admin admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:01.308829 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a208640-b5b5-453b-91ee-c403a4024a14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:01.309157 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a208640-b5b5-453b-91ee-c403a4024a14 admin admin] PATH_INFO: `/v3/users` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:01.309863 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a208640-b5b5-453b-91ee-c403a4024a14 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:01.312496 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a208640-b5b5-453b-91ee-c403a4024a14 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:01.341832 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1000/1997] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jul 11 14:42:01 2022] POST /identity/v3/users => generated 301 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:42:01.345821 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6894e9bc-58c0-4ea9-8331-923b66997685 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:01.359156 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6894e9bc-58c0-4ea9-8331-923b66997685 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:01.363963 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda08dc9-093d-4169-852d-0323baac905e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:01.364672 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda08dc9-093d-4169-852d-0323baac905e admin admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:01.364986 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda08dc9-093d-4169-852d-0323baac905e admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:01.365277 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda08dc9-093d-4169-852d-0323baac905e admin admin] PATH_INFO: `/v3/roles` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:01.366166 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda08dc9-093d-4169-852d-0323baac905e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:01.368121 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda08dc9-093d-4169-852d-0323baac905e admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:01.382395 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 998/1998] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:42:01 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:42:01.388307 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a208640-b5b5-453b-91ee-c403a4024a14 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:01.419298 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a208640-b5b5-453b-91ee-c403a4024a14 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:01.424934 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7835a589-14f0-4373-a763-ddfffa0d336e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:01.426984 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7835a589-14f0-4373-a763-ddfffa0d336e admin admin] REQUEST_METHOD: `PUT` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:01.427869 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7835a589-14f0-4373-a763-ddfffa0d336e admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:01.428462 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7835a589-14f0-4373-a763-ddfffa0d336e admin admin] PATH_INFO: `/v3/projects/1e15397b3c5a42018e5830fd0bd09ee4/users/b9b93e3809b7471fbe3d4b94fe7f5499/roles/b46df176b0fe479da63c318db225bed4` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:01.457425 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7835a589-14f0-4373-a763-ddfffa0d336e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e15397b3c5a42018e5830fd0bd09ee4, user_id=b9b93e3809b7471fbe3d4b94fe7f5499, role_id=b46df176b0fe479da63c318db225bed4)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:01.460398 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7835a589-14f0-4373-a763-ddfffa0d336e admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:01.483459 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1001/1999] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jul 11 14:42:01 2022] PUT /identity/v3/projects/1e15397b3c5a42018e5830fd0bd09ee4/users/b9b93e3809b7471fbe3d4b94fe7f5499/roles/b46df176b0fe479da63c318db225bed4 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:42:01.484364 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda08dc9-093d-4169-852d-0323baac905e admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:01.498711 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda08dc9-093d-4169-852d-0323baac905e admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:01.601583 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fb6a3a-86d5-49c7-a93b-962a1a06350d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:01.603247 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fb6a3a-86d5-49c7-a93b-962a1a06350d admin admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:01.603952 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fb6a3a-86d5-49c7-a93b-962a1a06350d admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:01.604791 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fb6a3a-86d5-49c7-a93b-962a1a06350d admin admin] PATH_INFO: `/v3/roles` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:01.605772 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fb6a3a-86d5-49c7-a93b-962a1a06350d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:01.607758 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fb6a3a-86d5-49c7-a93b-962a1a06350d admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:01.627365 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 999/2000] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:42:01 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:42:01.628649 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7835a589-14f0-4373-a763-ddfffa0d336e admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:01.644087 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7835a589-14f0-4373-a763-ddfffa0d336e admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:01.678514 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b23f1d-faa9-4380-919e-956178b34c63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:01.680633 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b23f1d-faa9-4380-919e-956178b34c63 admin admin] REQUEST_METHOD: `PUT` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:01.681144 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b23f1d-faa9-4380-919e-956178b34c63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:01.681629 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b23f1d-faa9-4380-919e-956178b34c63 admin admin] PATH_INFO: `/v3/projects/1e15397b3c5a42018e5830fd0bd09ee4/users/b9b93e3809b7471fbe3d4b94fe7f5499/roles/b46df176b0fe479da63c318db225bed4` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:01.687323 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b23f1d-faa9-4380-919e-956178b34c63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e15397b3c5a42018e5830fd0bd09ee4, user_id=b9b93e3809b7471fbe3d4b94fe7f5499, role_id=b46df176b0fe479da63c318db225bed4)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:01.692053 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b23f1d-faa9-4380-919e-956178b34c63 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:01.723055 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1002/2001] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jul 11 14:42:01 2022] PUT /identity/v3/projects/1e15397b3c5a42018e5830fd0bd09ee4/users/b9b93e3809b7471fbe3d4b94fe7f5499/roles/b46df176b0fe479da63c318db225bed4 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:42:01.742188 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a3dd1e-b847-40ef-b234-a3808f9c6d0c None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:01.742603 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a3dd1e-b847-40ef-b234-a3808f9c6d0c None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:01.742835 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a3dd1e-b847-40ef-b234-a3808f9c6d0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:01.797316 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-03a3dd1e-b847-40ef-b234-a3808f9c6d0c None None] MFA Rules not processed for user `b9b93e3809b7471fbe3d4b94fe7f5499`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:42:01.799153 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-03a3dd1e-b847-40ef-b234-a3808f9c6d0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:42:01.884787 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1000/2002] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:42:01 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:42:01.897153 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b23f1d-faa9-4380-919e-956178b34c63 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:01.954372 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:42:01.968422 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b23f1d-faa9-4380-919e-956178b34c63 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:01.973187 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba4cbd3-1ab0-4ca6-9747-92d5c11d0f27 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '868e7c2dec264512b972c8736d659c34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:01.974205 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba4cbd3-1ab0-4ca6-9747-92d5c11d0f27 service cinder] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:01.974205 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba4cbd3-1ab0-4ca6-9747-92d5c11d0f27 service cinder] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:01.974410 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba4cbd3-1ab0-4ca6-9747-92d5c11d0f27 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:01.994431 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba4cbd3-1ab0-4ca6-9747-92d5c11d0f27 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:01.996299 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba4cbd3-1ab0-4ca6-9747-92d5c11d0f27 service cinder] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:02.042962 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1003/2003] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:42:01 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:42:02.218407 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a3dd1e-b847-40ef-b234-a3808f9c6d0c None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:02.322121 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a3dd1e-b847-40ef-b234-a3808f9c6d0c None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:02.327707 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fa4602-cc35-415e-9bd4-7ab5d6d4ca9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:02.328690 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fa4602-cc35-415e-9bd4-7ab5d6d4ca9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:02.328971 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fa4602-cc35-415e-9bd4-7ab5d6d4ca9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:02.329855 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fa4602-cc35-415e-9bd4-7ab5d6d4ca9e admin admin] PATH_INFO: `/v3/users/4e0db46562fe4824a0e0a00257c6fa56` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:02.330538 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fa4602-cc35-415e-9bd4-7ab5d6d4ca9e admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e0db46562fe4824a0e0a00257c6fa56)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:02.332884 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fa4602-cc35-415e-9bd4-7ab5d6d4ca9e admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:02.339997 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:42:02.393649 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-36fa4602-cc35-415e-9bd4-7ab5d6d4ca9e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e0db46562fe4824a0e0a00257c6fa56'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:02.404779 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-36fa4602-cc35-415e-9bd4-7ab5d6d4ca9e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e0db46562fe4824a0e0a00257c6fa56'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:02.414131 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-36fa4602-cc35-415e-9bd4-7ab5d6d4ca9e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e0db46562fe4824a0e0a00257c6fa56'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:02.416281 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-36fa4602-cc35-415e-9bd4-7ab5d6d4ca9e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e0db46562fe4824a0e0a00257c6fa56'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:02.418637 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-36fa4602-cc35-415e-9bd4-7ab5d6d4ca9e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e0db46562fe4824a0e0a00257c6fa56'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:02.444173 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1001/2004] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jul 11 14:42:02 2022] DELETE /identity/v3/users/4e0db46562fe4824a0e0a00257c6fa56 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:42:02.449806 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631f0603-8d19-48de-b46e-b3a6d8b35956 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:02.450105 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631f0603-8d19-48de-b46e-b3a6d8b35956 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:02.450385 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631f0603-8d19-48de-b46e-b3a6d8b35956 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:02.473506 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-631f0603-8d19-48de-b46e-b3a6d8b35956 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:42:02.475079 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-631f0603-8d19-48de-b46e-b3a6d8b35956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:42:02.549260 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1004/2005] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:42:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:42:02.560039 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fa4602-cc35-415e-9bd4-7ab5d6d4ca9e admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:02.561789 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-36fa4602-cc35-415e-9bd4-7ab5d6d4ca9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:42:02.655818 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fa4602-cc35-415e-9bd4-7ab5d6d4ca9e admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:02.660927 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a486a32c-c579-4aa7-852e-8a946f38f454 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20eede5ccd834862b00123310b5c3975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:02.661711 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a486a32c-c579-4aa7-852e-8a946f38f454 service neutron] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:02.662071 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a486a32c-c579-4aa7-852e-8a946f38f454 service neutron] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:02.662428 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a486a32c-c579-4aa7-852e-8a946f38f454 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:02.673558 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a486a32c-c579-4aa7-852e-8a946f38f454 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:02.675387 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a486a32c-c579-4aa7-852e-8a946f38f454 service neutron] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:02.691880 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1002/2006] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:42:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:42:03.111343 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631f0603-8d19-48de-b46e-b3a6d8b35956 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:03.112944 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-631f0603-8d19-48de-b46e-b3a6d8b35956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:42:03.130523 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631f0603-8d19-48de-b46e-b3a6d8b35956 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:03.174779 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf752fdd-9549-4f49-9414-318c4a938b0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:03.177738 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf752fdd-9549-4f49-9414-318c4a938b0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:03.202236 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf752fdd-9549-4f49-9414-318c4a938b0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:03.202897 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf752fdd-9549-4f49-9414-318c4a938b0c admin admin] PATH_INFO: `/v3/projects/d9ea725f646f4843a506533f24c1e7b0` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:03.205094 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf752fdd-9549-4f49-9414-318c4a938b0c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9ea725f646f4843a506533f24c1e7b0)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:03.207575 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf752fdd-9549-4f49-9414-318c4a938b0c admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:03.296880 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-bf752fdd-9549-4f49-9414-318c4a938b0c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9ea725f646f4843a506533f24c1e7b0', 'request_id': 'req-bf752fdd-9549-4f49-9414-318c4a938b0c'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:03.316505 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-bf752fdd-9549-4f49-9414-318c4a938b0c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9ea725f646f4843a506533f24c1e7b0', 'request_id': 'req-bf752fdd-9549-4f49-9414-318c4a938b0c'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:03.327370 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-bf752fdd-9549-4f49-9414-318c4a938b0c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9ea725f646f4843a506533f24c1e7b0', 'request_id': 'req-bf752fdd-9549-4f49-9414-318c4a938b0c'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:03.346056 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-bf752fdd-9549-4f49-9414-318c4a938b0c admin admin] The token cache is being invalidate because project d9ea725f646f4843a506533f24c1e7b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:42:03.346590 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-bf752fdd-9549-4f49-9414-318c4a938b0c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:03.347311 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-bf752fdd-9549-4f49-9414-318c4a938b0c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:03.352463 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1005/2007] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jul 11 14:42:03 2022] DELETE /identity/v3/projects/d9ea725f646f4843a506533f24c1e7b0 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:42:03.353918 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a486a32c-c579-4aa7-852e-8a946f38f454 service neutron] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:03.369556 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a486a32c-c579-4aa7-852e-8a946f38f454 service neutron] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:03.436665 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8a9d7a-c134-41b5-b4f5-4493804bbcb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:03.438573 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8a9d7a-c134-41b5-b4f5-4493804bbcb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:03.438967 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8a9d7a-c134-41b5-b4f5-4493804bbcb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:03.439677 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8a9d7a-c134-41b5-b4f5-4493804bbcb3 admin admin] PATH_INFO: `/v3/users/b9b93e3809b7471fbe3d4b94fe7f5499` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:03.441017 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8a9d7a-c134-41b5-b4f5-4493804bbcb3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9b93e3809b7471fbe3d4b94fe7f5499)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:03.443030 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8a9d7a-c134-41b5-b4f5-4493804bbcb3 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:03.480696 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:42:03.496952 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-0b8a9d7a-c134-41b5-b4f5-4493804bbcb3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9b93e3809b7471fbe3d4b94fe7f5499'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:03.504004 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-0b8a9d7a-c134-41b5-b4f5-4493804bbcb3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9b93e3809b7471fbe3d4b94fe7f5499'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:03.511651 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-0b8a9d7a-c134-41b5-b4f5-4493804bbcb3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9b93e3809b7471fbe3d4b94fe7f5499'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:03.512322 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-0b8a9d7a-c134-41b5-b4f5-4493804bbcb3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9b93e3809b7471fbe3d4b94fe7f5499'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:03.512910 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-0b8a9d7a-c134-41b5-b4f5-4493804bbcb3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9b93e3809b7471fbe3d4b94fe7f5499'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:03.531930 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1003/2008] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jul 11 14:42:03 2022] DELETE /identity/v3/users/b9b93e3809b7471fbe3d4b94fe7f5499 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:42:03.825671 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf752fdd-9549-4f49-9414-318c4a938b0c admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:03.827128 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-bf752fdd-9549-4f49-9414-318c4a938b0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:42:03.843050 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf752fdd-9549-4f49-9414-318c4a938b0c admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:03.911255 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba6a075-b226-432a-ae30-a1c79ce1cc92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:03.912135 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba6a075-b226-432a-ae30-a1c79ce1cc92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:03.912443 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba6a075-b226-432a-ae30-a1c79ce1cc92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:03.912713 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba6a075-b226-432a-ae30-a1c79ce1cc92 admin admin] PATH_INFO: `/v3/projects/1e15397b3c5a42018e5830fd0bd09ee4` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:03.913895 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba6a075-b226-432a-ae30-a1c79ce1cc92 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e15397b3c5a42018e5830fd0bd09ee4)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:03.915950 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba6a075-b226-432a-ae30-a1c79ce1cc92 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:03.929400 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:42:03.973492 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-eba6a075-b226-432a-ae30-a1c79ce1cc92 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e15397b3c5a42018e5830fd0bd09ee4', 'request_id': 'req-eba6a075-b226-432a-ae30-a1c79ce1cc92'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:03.979653 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-eba6a075-b226-432a-ae30-a1c79ce1cc92 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e15397b3c5a42018e5830fd0bd09ee4', 'request_id': 'req-eba6a075-b226-432a-ae30-a1c79ce1cc92'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:03.986196 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-eba6a075-b226-432a-ae30-a1c79ce1cc92 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e15397b3c5a42018e5830fd0bd09ee4', 'request_id': 'req-eba6a075-b226-432a-ae30-a1c79ce1cc92'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:03.999461 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-eba6a075-b226-432a-ae30-a1c79ce1cc92 admin admin] The token cache is being invalidate because project 1e15397b3c5a42018e5830fd0bd09ee4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:42:04.000285 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-eba6a075-b226-432a-ae30-a1c79ce1cc92 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:04.000459 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-eba6a075-b226-432a-ae30-a1c79ce1cc92 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:04.002092 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1006/2009] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jul 11 14:42:03 2022] DELETE /identity/v3/projects/1e15397b3c5a42018e5830fd0bd09ee4 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:42:04.007103 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957a4757-a3b3-4fb6-be10-d8c4bf437f21 None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:04.007403 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957a4757-a3b3-4fb6-be10-d8c4bf437f21 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:04.007689 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957a4757-a3b3-4fb6-be10-d8c4bf437f21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:04.027015 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-957a4757-a3b3-4fb6-be10-d8c4bf437f21 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:42:04.028277 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-957a4757-a3b3-4fb6-be10-d8c4bf437f21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:42:04.094628 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1004/2010] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:42:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:42:04.102148 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9941f1ab-ff56-4566-ab82-9ff0e361b111 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:04.103808 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9941f1ab-ff56-4566-ab82-9ff0e361b111 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:04.103808 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9941f1ab-ff56-4566-ab82-9ff0e361b111 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:04.128091 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-9941f1ab-ff56-4566-ab82-9ff0e361b111 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:42:04.129530 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-9941f1ab-ff56-4566-ab82-9ff0e361b111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:42:04.142097 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1007/2011] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:42:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:42:04.145187 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957a4757-a3b3-4fb6-be10-d8c4bf437f21 None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:04.169313 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957a4757-a3b3-4fb6-be10-d8c4bf437f21 None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:04.186785 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bfe4f5-0649-421e-80d3-6ba30edf437d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:04.187778 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bfe4f5-0649-421e-80d3-6ba30edf437d admin admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:04.188073 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bfe4f5-0649-421e-80d3-6ba30edf437d admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:04.188427 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bfe4f5-0649-421e-80d3-6ba30edf437d admin admin] PATH_INFO: `/v3/domains` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:04.189279 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bfe4f5-0649-421e-80d3-6ba30edf437d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:42:04.189852 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bfe4f5-0649-421e-80d3-6ba30edf437d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:04.192288 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bfe4f5-0649-421e-80d3-6ba30edf437d admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:04.227490 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1005/2012] 10.222.0.70 () {58 vars in 1152 bytes} [Mon Jul 11 14:42:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:42:04.232133 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9941f1ab-ff56-4566-ab82-9ff0e361b111 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:04.242948 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9941f1ab-ff56-4566-ab82-9ff0e361b111 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:04.249173 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fae3b3-2878-4029-93c1-474bd7869b59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:04.249906 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fae3b3-2878-4029-93c1-474bd7869b59 admin admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:04.250352 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fae3b3-2878-4029-93c1-474bd7869b59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:04.250637 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fae3b3-2878-4029-93c1-474bd7869b59 admin admin] PATH_INFO: `/v3/projects` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:04.251406 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fae3b3-2878-4029-93c1-474bd7869b59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:04.254673 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fae3b3-2878-4029-93c1-474bd7869b59 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:04.307972 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1008/2013] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jul 11 14:42:04 2022] POST /identity/v3/projects => generated 409 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:42:04.309736 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bfe4f5-0649-421e-80d3-6ba30edf437d admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:04.330235 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bfe4f5-0649-421e-80d3-6ba30edf437d admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:04.389953 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fae3b3-2878-4029-93c1-474bd7869b59 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:04.398103 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-50fae3b3-2878-4029-93c1-474bd7869b59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:42:04.438709 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ef17bf-265a-4357-80ef-1a15e183073c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:04.440017 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ef17bf-265a-4357-80ef-1a15e183073c admin admin] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:04.440511 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ef17bf-265a-4357-80ef-1a15e183073c admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:04.441074 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ef17bf-265a-4357-80ef-1a15e183073c admin admin] PATH_INFO: `/v3/users` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:04.442672 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ef17bf-265a-4357-80ef-1a15e183073c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:04.447780 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ef17bf-265a-4357-80ef-1a15e183073c admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:04.499182 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1006/2014] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jul 11 14:42:04 2022] POST /identity/v3/users => generated 305 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:42:04.500407 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ef17bf-265a-4357-80ef-1a15e183073c admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:04.520655 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ef17bf-265a-4357-80ef-1a15e183073c admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:04.527946 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fae3b3-2878-4029-93c1-474bd7869b59 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:04.531347 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c8de07-1d26-4fd9-ad89-13faf909ef87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:04.534119 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c8de07-1d26-4fd9-ad89-13faf909ef87 admin admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:04.534432 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c8de07-1d26-4fd9-ad89-13faf909ef87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:04.534554 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab36afb-a72d-40e7-abd3-01684de138f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:04.534712 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c8de07-1d26-4fd9-ad89-13faf909ef87 admin admin] PATH_INFO: `/v3/roles` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:04.535490 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c8de07-1d26-4fd9-ad89-13faf909ef87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:04.536026 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab36afb-a72d-40e7-abd3-01684de138f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:04.536531 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab36afb-a72d-40e7-abd3-01684de138f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:04.536912 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab36afb-a72d-40e7-abd3-01684de138f6 admin admin] PATH_INFO: `/v3/users/b68a55610f4143c5915a1a1f2c991d6b` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:04.537144 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c8de07-1d26-4fd9-ad89-13faf909ef87 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:04.538408 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab36afb-a72d-40e7-abd3-01684de138f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b68a55610f4143c5915a1a1f2c991d6b)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:04.540646 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab36afb-a72d-40e7-abd3-01684de138f6 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:04.573090 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1007/2015] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:42:04 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:42:04.580635 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c8de07-1d26-4fd9-ad89-13faf909ef87 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:04.606437 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c8de07-1d26-4fd9-ad89-13faf909ef87 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:04.622678 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8701df44-705e-4f95-b1fe-e8361d236bc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:04.623396 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8701df44-705e-4f95-b1fe-e8361d236bc5 admin admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:04.623688 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8701df44-705e-4f95-b1fe-e8361d236bc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:04.624113 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8701df44-705e-4f95-b1fe-e8361d236bc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:04.624911 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8701df44-705e-4f95-b1fe-e8361d236bc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:04.625826 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-bab36afb-a72d-40e7-abd3-01684de138f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b68a55610f4143c5915a1a1f2c991d6b'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:04.626726 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8701df44-705e-4f95-b1fe-e8361d236bc5 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:04.637881 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-bab36afb-a72d-40e7-abd3-01684de138f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b68a55610f4143c5915a1a1f2c991d6b'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:04.651134 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-bab36afb-a72d-40e7-abd3-01684de138f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b68a55610f4143c5915a1a1f2c991d6b'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:04.652082 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-bab36afb-a72d-40e7-abd3-01684de138f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b68a55610f4143c5915a1a1f2c991d6b'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:04.653161 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-bab36afb-a72d-40e7-abd3-01684de138f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b68a55610f4143c5915a1a1f2c991d6b'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:04.661354 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1008/2016] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:42:04 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:42:04.662303 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8701df44-705e-4f95-b1fe-e8361d236bc5 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:04.665506 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-8701df44-705e-4f95-b1fe-e8361d236bc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:42:04.675788 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:42:04.684417 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8701df44-705e-4f95-b1fe-e8361d236bc5 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:04.685082 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=81,keystone:DELETE=16,keystone:INSERT=3 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:42:04.706976 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b8237a-4aee-41b1-8829-6d8fc26063c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:04.708607 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1009/2017] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jul 11 14:42:04 2022] DELETE /identity/v3/users/b68a55610f4143c5915a1a1f2c991d6b => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:42:04.709927 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b8237a-4aee-41b1-8829-6d8fc26063c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:04.710359 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b8237a-4aee-41b1-8829-6d8fc26063c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:04.710644 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b8237a-4aee-41b1-8829-6d8fc26063c3 admin admin] PATH_INFO: `/v3/projects/8ca6178f2db742c199bc98afb89c35b9/users/b2c8114feb92426b8c9bd8712d30338c/roles/8eff41f243c843ed95505a488ca6eada` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:04.713491 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6070971-26a5-4da4-942a-f0c2dc2a4c6f None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:04.714018 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6070971-26a5-4da4-942a-f0c2dc2a4c6f None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:04.714492 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6070971-26a5-4da4-942a-f0c2dc2a4c6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:04.741259 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-d6070971-26a5-4da4-942a-f0c2dc2a4c6f None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:42:04.744625 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-d6070971-26a5-4da4-942a-f0c2dc2a4c6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:42:04.753154 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b8237a-4aee-41b1-8829-6d8fc26063c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ca6178f2db742c199bc98afb89c35b9, user_id=b2c8114feb92426b8c9bd8712d30338c, role_id=8eff41f243c843ed95505a488ca6eada)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:04.757380 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b8237a-4aee-41b1-8829-6d8fc26063c3 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:04.793943 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1009/2018] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jul 11 14:42:04 2022] PUT /identity/v3/projects/8ca6178f2db742c199bc98afb89c35b9/users/b2c8114feb92426b8c9bd8712d30338c/roles/8eff41f243c843ed95505a488ca6eada => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:42:04.796287 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e122084-76e5-4071-bbad-c720ed092ab4 None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:04.796582 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e122084-76e5-4071-bbad-c720ed092ab4 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:04.796861 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e122084-76e5-4071-bbad-c720ed092ab4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:04.861101 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-6e122084-76e5-4071-bbad-c720ed092ab4 None None] MFA Rules not processed for user `b2c8114feb92426b8c9bd8712d30338c`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:42:04.875356 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-6e122084-76e5-4071-bbad-c720ed092ab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:42:04.876739 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1010/2019] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:42:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:42:04.890401 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6070971-26a5-4da4-942a-f0c2dc2a4c6f None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:04.891751 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-d6070971-26a5-4da4-942a-f0c2dc2a4c6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:42:05.010835 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1010/2020] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:42:04 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:42:05.011912 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e122084-76e5-4071-bbad-c720ed092ab4 None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:05.013458 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6070971-26a5-4da4-942a-f0c2dc2a4c6f None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:05.100899 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799429f4-f655-4585-838c-b2e64f20c511 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20eede5ccd834862b00123310b5c3975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:05.101587 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799429f4-f655-4585-838c-b2e64f20c511 service neutron] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:05.103102 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799429f4-f655-4585-838c-b2e64f20c511 service neutron] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:05.103336 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799429f4-f655-4585-838c-b2e64f20c511 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:05.112058 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e122084-76e5-4071-bbad-c720ed092ab4 None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:05.118462 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799429f4-f655-4585-838c-b2e64f20c511 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:05.120235 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799429f4-f655-4585-838c-b2e64f20c511 service neutron] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:05.121470 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc54eda-7fb5-446a-8747-f7730f8a4dfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:05.122760 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc54eda-7fb5-446a-8747-f7730f8a4dfb admin admin] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:05.122999 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc54eda-7fb5-446a-8747-f7730f8a4dfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:05.123349 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc54eda-7fb5-446a-8747-f7730f8a4dfb admin admin] PATH_INFO: `/v3/projects` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:05.124530 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc54eda-7fb5-446a-8747-f7730f8a4dfb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:05.127568 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc54eda-7fb5-446a-8747-f7730f8a4dfb admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:05.132500 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1011/2021] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:42:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:42:05.164384 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1011/2022] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jul 11 14:42:05 2022] POST /identity/v3/projects => generated 407 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:42:05.169571 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799429f4-f655-4585-838c-b2e64f20c511 service neutron] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:05.181150 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799429f4-f655-4585-838c-b2e64f20c511 service neutron] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:05.244553 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:42:05.262054 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba8210c-bedf-46b1-9556-324978efb2fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:05.263000 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba8210c-bedf-46b1-9556-324978efb2fa admin admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:05.263346 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba8210c-bedf-46b1-9556-324978efb2fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:05.263727 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba8210c-bedf-46b1-9556-324978efb2fa admin admin] PATH_INFO: `/v3/users` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:05.264549 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba8210c-bedf-46b1-9556-324978efb2fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:05.266599 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba8210c-bedf-46b1-9556-324978efb2fa admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:05.294795 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1012/2023] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jul 11 14:42:05 2022] POST /identity/v3/users => generated 310 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:42:05.295542 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc54eda-7fb5-446a-8747-f7730f8a4dfb admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:05.307403 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc54eda-7fb5-446a-8747-f7730f8a4dfb admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:05.312870 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38196e8b-7ac0-4202-b07e-2fbf34a41b12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:05.313576 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38196e8b-7ac0-4202-b07e-2fbf34a41b12 admin admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:05.313865 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38196e8b-7ac0-4202-b07e-2fbf34a41b12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:05.314146 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38196e8b-7ac0-4202-b07e-2fbf34a41b12 admin admin] PATH_INFO: `/v3/roles` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:05.315179 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38196e8b-7ac0-4202-b07e-2fbf34a41b12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:05.317265 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38196e8b-7ac0-4202-b07e-2fbf34a41b12 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:05.353410 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1012/2024] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:42:05 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:42:05.357553 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba8210c-bedf-46b1-9556-324978efb2fa admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:05.370882 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba8210c-bedf-46b1-9556-324978efb2fa admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:05.376778 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc85908a-5d44-428f-9b6c-8270afba721c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:05.377701 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc85908a-5d44-428f-9b6c-8270afba721c admin admin] REQUEST_METHOD: `PUT` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:05.377983 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc85908a-5d44-428f-9b6c-8270afba721c admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:05.378252 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc85908a-5d44-428f-9b6c-8270afba721c admin admin] PATH_INFO: `/v3/projects/d13e1dea29274621afdd705a6d2267f5/users/1f8ff348b451417a9f6cf9a220c24522/roles/b46df176b0fe479da63c318db225bed4` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:05.397206 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc85908a-5d44-428f-9b6c-8270afba721c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d13e1dea29274621afdd705a6d2267f5, user_id=1f8ff348b451417a9f6cf9a220c24522, role_id=b46df176b0fe479da63c318db225bed4)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:05.400803 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc85908a-5d44-428f-9b6c-8270afba721c admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:05.419193 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1013/2025] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jul 11 14:42:05 2022] PUT /identity/v3/projects/d13e1dea29274621afdd705a6d2267f5/users/1f8ff348b451417a9f6cf9a220c24522/roles/b46df176b0fe479da63c318db225bed4 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:42:05.422688 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38196e8b-7ac0-4202-b07e-2fbf34a41b12 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:05.438708 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38196e8b-7ac0-4202-b07e-2fbf34a41b12 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:05.491223 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:42:05.522294 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc85908a-5d44-428f-9b6c-8270afba721c admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:05.525012 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef927e9-a873-4019-bfea-5ba8413468ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:05.525393 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-cc85908a-5d44-428f-9b6c-8270afba721c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:42:05.525820 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef927e9-a873-4019-bfea-5ba8413468ce admin admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:05.526111 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef927e9-a873-4019-bfea-5ba8413468ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:05.526441 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef927e9-a873-4019-bfea-5ba8413468ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:05.527411 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef927e9-a873-4019-bfea-5ba8413468ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:05.529222 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef927e9-a873-4019-bfea-5ba8413468ce admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:05.547043 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1013/2026] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:42:05 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:42:05.550249 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc85908a-5d44-428f-9b6c-8270afba721c admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:05.551103 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef927e9-a873-4019-bfea-5ba8413468ce admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:05.567726 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf05e6e-68e7-4716-8d71-edca358af836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:05.578607 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf05e6e-68e7-4716-8d71-edca358af836 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:05.578607 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf05e6e-68e7-4716-8d71-edca358af836 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:05.578821 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf05e6e-68e7-4716-8d71-edca358af836 admin admin] PATH_INFO: `/v3/projects/98bc4f231b1445109e12a926cd6795d4` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:05.580402 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf05e6e-68e7-4716-8d71-edca358af836 admin admin] RBAC: Authorizing `identity:delete_project(project_id=98bc4f231b1445109e12a926cd6795d4)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:05.586410 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef927e9-a873-4019-bfea-5ba8413468ce admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:05.588252 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf05e6e-68e7-4716-8d71-edca358af836 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:05.594259 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6f750e-5b0e-4c80-a110-7c09334b0245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:05.595964 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6f750e-5b0e-4c80-a110-7c09334b0245 admin admin] REQUEST_METHOD: `PUT` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:05.596289 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6f750e-5b0e-4c80-a110-7c09334b0245 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:05.597047 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6f750e-5b0e-4c80-a110-7c09334b0245 admin admin] PATH_INFO: `/v3/projects/d13e1dea29274621afdd705a6d2267f5/users/1f8ff348b451417a9f6cf9a220c24522/roles/b46df176b0fe479da63c318db225bed4` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:05.599166 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6f750e-5b0e-4c80-a110-7c09334b0245 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d13e1dea29274621afdd705a6d2267f5, user_id=1f8ff348b451417a9f6cf9a220c24522, role_id=b46df176b0fe479da63c318db225bed4)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:05.602378 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6f750e-5b0e-4c80-a110-7c09334b0245 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:05.614598 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1014/2027] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jul 11 14:42:05 2022] PUT /identity/v3/projects/d13e1dea29274621afdd705a6d2267f5/users/1f8ff348b451417a9f6cf9a220c24522/roles/b46df176b0fe479da63c318db225bed4 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:42:05.627253 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349ab60d-6dea-4514-8218-7120889e8e02 None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:05.627556 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349ab60d-6dea-4514-8218-7120889e8e02 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:05.627951 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349ab60d-6dea-4514-8218-7120889e8e02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:05.653351 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-cbf05e6e-68e7-4716-8d71-edca358af836 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98bc4f231b1445109e12a926cd6795d4', 'request_id': 'req-cbf05e6e-68e7-4716-8d71-edca358af836'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:05.659783 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-cbf05e6e-68e7-4716-8d71-edca358af836 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98bc4f231b1445109e12a926cd6795d4', 'request_id': 'req-cbf05e6e-68e7-4716-8d71-edca358af836'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:05.662447 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-349ab60d-6dea-4514-8218-7120889e8e02 None None] MFA Rules not processed for user `1f8ff348b451417a9f6cf9a220c24522`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:42:05.663734 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-349ab60d-6dea-4514-8218-7120889e8e02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:42:05.667504 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-cbf05e6e-68e7-4716-8d71-edca358af836 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98bc4f231b1445109e12a926cd6795d4', 'request_id': 'req-cbf05e6e-68e7-4716-8d71-edca358af836'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:05.685747 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-cbf05e6e-68e7-4716-8d71-edca358af836 admin admin] The token cache is being invalidate because project 98bc4f231b1445109e12a926cd6795d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:42:05.686263 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-cbf05e6e-68e7-4716-8d71-edca358af836 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:05.687289 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-cbf05e6e-68e7-4716-8d71-edca358af836 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:05.689627 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1014/2028] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jul 11 14:42:05 2022] DELETE /identity/v3/projects/98bc4f231b1445109e12a926cd6795d4 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:42:05.694123 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf05e6e-68e7-4716-8d71-edca358af836 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:05.696678 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-cbf05e6e-68e7-4716-8d71-edca358af836 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:42:05.769748 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1015/2029] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:42:05 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:42:05.792610 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349ab60d-6dea-4514-8218-7120889e8e02 None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:05.794243 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-349ab60d-6dea-4514-8218-7120889e8e02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:42:05.799826 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf05e6e-68e7-4716-8d71-edca358af836 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:05.814816 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1849c8c4-41a9-466e-9190-0d649aad7c7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:05.815729 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1849c8c4-41a9-466e-9190-0d649aad7c7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:05.816052 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1849c8c4-41a9-466e-9190-0d649aad7c7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:05.816378 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1849c8c4-41a9-466e-9190-0d649aad7c7e admin admin] PATH_INFO: `/v3/users/8347fd229e6549b1b68947486d399091` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:05.817677 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1849c8c4-41a9-466e-9190-0d649aad7c7e admin admin] RBAC: Authorizing `identity:delete_user(user_id=8347fd229e6549b1b68947486d399091)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:05.820420 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1849c8c4-41a9-466e-9190-0d649aad7c7e admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:05.861563 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349ab60d-6dea-4514-8218-7120889e8e02 None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:05.868159 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68396187-d2b4-4f8a-9e6b-37b85ea71a84 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '868e7c2dec264512b972c8736d659c34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:05.869492 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68396187-d2b4-4f8a-9e6b-37b85ea71a84 service cinder] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:05.869856 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68396187-d2b4-4f8a-9e6b-37b85ea71a84 service cinder] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:05.870211 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68396187-d2b4-4f8a-9e6b-37b85ea71a84 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:05.871472 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=83,keystone:INSERT=5,keystone:DELETE=12 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:42:05.887715 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-1849c8c4-41a9-466e-9190-0d649aad7c7e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8347fd229e6549b1b68947486d399091'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:05.889291 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68396187-d2b4-4f8a-9e6b-37b85ea71a84 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:05.890975 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68396187-d2b4-4f8a-9e6b-37b85ea71a84 service cinder] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:05.897958 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-1849c8c4-41a9-466e-9190-0d649aad7c7e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8347fd229e6549b1b68947486d399091'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:05.906009 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1016/2030] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:42:05 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:42:05.908507 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-1849c8c4-41a9-466e-9190-0d649aad7c7e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8347fd229e6549b1b68947486d399091'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:05.909759 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-1849c8c4-41a9-466e-9190-0d649aad7c7e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8347fd229e6549b1b68947486d399091'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:05.911767 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-1849c8c4-41a9-466e-9190-0d649aad7c7e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8347fd229e6549b1b68947486d399091'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:05.957749 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1015/2031] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jul 11 14:42:05 2022] DELETE /identity/v3/users/8347fd229e6549b1b68947486d399091 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:42:06.130678 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68396187-d2b4-4f8a-9e6b-37b85ea71a84 service cinder] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:06.132419 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-68396187-d2b4-4f8a-9e6b-37b85ea71a84 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:42:06.148580 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68396187-d2b4-4f8a-9e6b-37b85ea71a84 service cinder] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:06.162270 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1849c8c4-41a9-466e-9190-0d649aad7c7e admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:06.163844 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-1849c8c4-41a9-466e-9190-0d649aad7c7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:42:06.217835 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ee6a7b-448b-4e97-974b-9739ebd2e9b0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '868e7c2dec264512b972c8736d659c34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:06.218554 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ee6a7b-448b-4e97-974b-9739ebd2e9b0 service cinder] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:06.219130 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ee6a7b-448b-4e97-974b-9739ebd2e9b0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:06.219416 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ee6a7b-448b-4e97-974b-9739ebd2e9b0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:06.221835 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-87ee6a7b-448b-4e97-974b-9739ebd2e9b0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:42:06.230546 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:42:06.233581 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1849c8c4-41a9-466e-9190-0d649aad7c7e admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:06.238183 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85a2d58-d786-48c0-9666-db3a3243f96e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '868e7c2dec264512b972c8736d659c34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:06.239680 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85a2d58-d786-48c0-9666-db3a3243f96e service cinder] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:06.240169 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85a2d58-d786-48c0-9666-db3a3243f96e service cinder] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:06.240705 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85a2d58-d786-48c0-9666-db3a3243f96e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:06.243482 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-a85a2d58-d786-48c0-9666-db3a3243f96e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:42:06.315064 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ee6a7b-448b-4e97-974b-9739ebd2e9b0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:06.317173 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ee6a7b-448b-4e97-974b-9739ebd2e9b0 service cinder] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:06.327540 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85a2d58-d786-48c0-9666-db3a3243f96e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:06.329236 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85a2d58-d786-48c0-9666-db3a3243f96e service cinder] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:06.331030 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1017/2032] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:42:06 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:42:06.351249 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1016/2033] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:42:06 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:42:06.601449 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ee6a7b-448b-4e97-974b-9739ebd2e9b0 service cinder] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:06.604518 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-87ee6a7b-448b-4e97-974b-9739ebd2e9b0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:42:06.754160 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ee6a7b-448b-4e97-974b-9739ebd2e9b0 service cinder] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:06.768130 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ae1998-1e07-4bc4-b99a-404081672929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:06.769158 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ae1998-1e07-4bc4-b99a-404081672929 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:06.769546 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ae1998-1e07-4bc4-b99a-404081672929 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:06.769927 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ae1998-1e07-4bc4-b99a-404081672929 admin admin] PATH_INFO: `/v3/projects/a14d9382c08b4874830639eb16e71883` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:06.773024 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ae1998-1e07-4bc4-b99a-404081672929 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a14d9382c08b4874830639eb16e71883)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:06.780131 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ae1998-1e07-4bc4-b99a-404081672929 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:06.891798 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-83ae1998-1e07-4bc4-b99a-404081672929 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a14d9382c08b4874830639eb16e71883', 'request_id': 'req-83ae1998-1e07-4bc4-b99a-404081672929'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:06.911967 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-83ae1998-1e07-4bc4-b99a-404081672929 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a14d9382c08b4874830639eb16e71883', 'request_id': 'req-83ae1998-1e07-4bc4-b99a-404081672929'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:06.922735 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-83ae1998-1e07-4bc4-b99a-404081672929 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a14d9382c08b4874830639eb16e71883', 'request_id': 'req-83ae1998-1e07-4bc4-b99a-404081672929'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:06.957572 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-83ae1998-1e07-4bc4-b99a-404081672929 admin admin] The token cache is being invalidate because project a14d9382c08b4874830639eb16e71883 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80534) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:42:06.957877 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-83ae1998-1e07-4bc4-b99a-404081672929 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:06.964879 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-83ae1998-1e07-4bc4-b99a-404081672929 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:06.972643 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1018/2034] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jul 11 14:42:06 2022] DELETE /identity/v3/projects/a14d9382c08b4874830639eb16e71883 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:42:06.974288 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85a2d58-d786-48c0-9666-db3a3243f96e service cinder] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:06.985448 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85a2d58-d786-48c0-9666-db3a3243f96e service cinder] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:07.064164 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce98ec8-19f8-4fe1-abbf-d7358d28473a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:07.065389 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce98ec8-19f8-4fe1-abbf-d7358d28473a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:07.065705 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce98ec8-19f8-4fe1-abbf-d7358d28473a admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:07.065987 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce98ec8-19f8-4fe1-abbf-d7358d28473a admin admin] PATH_INFO: `/v3/users/4da2fe93ea26476c8e6494092ae0e4e8` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:07.067216 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce98ec8-19f8-4fe1-abbf-d7358d28473a admin admin] RBAC: Authorizing `identity:delete_user(user_id=4da2fe93ea26476c8e6494092ae0e4e8)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:07.069185 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce98ec8-19f8-4fe1-abbf-d7358d28473a admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:07.076355 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:42:07.124656 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-fce98ec8-19f8-4fe1-abbf-d7358d28473a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4da2fe93ea26476c8e6494092ae0e4e8'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:07.133350 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-fce98ec8-19f8-4fe1-abbf-d7358d28473a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4da2fe93ea26476c8e6494092ae0e4e8'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:07.144174 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-fce98ec8-19f8-4fe1-abbf-d7358d28473a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4da2fe93ea26476c8e6494092ae0e4e8'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:07.144936 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-fce98ec8-19f8-4fe1-abbf-d7358d28473a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4da2fe93ea26476c8e6494092ae0e4e8'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:07.145585 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-fce98ec8-19f8-4fe1-abbf-d7358d28473a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4da2fe93ea26476c8e6494092ae0e4e8'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:07.167308 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1017/2035] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jul 11 14:42:06 2022] DELETE /identity/v3/users/4da2fe93ea26476c8e6494092ae0e4e8 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:42:07.456883 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ae1998-1e07-4bc4-b99a-404081672929 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:07.458344 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-83ae1998-1e07-4bc4-b99a-404081672929 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:42:07.474778 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ae1998-1e07-4bc4-b99a-404081672929 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:07.513986 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:42:07.539768 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22b4674-92dc-4ea5-b82b-5a12a9b0ad73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:07.540674 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22b4674-92dc-4ea5-b82b-5a12a9b0ad73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:07.540960 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22b4674-92dc-4ea5-b82b-5a12a9b0ad73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:07.541235 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22b4674-92dc-4ea5-b82b-5a12a9b0ad73 admin admin] PATH_INFO: `/v3/projects/ae91866893854a0eaf63890dd1d2b811` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:07.542446 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22b4674-92dc-4ea5-b82b-5a12a9b0ad73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae91866893854a0eaf63890dd1d2b811)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:07.544406 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22b4674-92dc-4ea5-b82b-5a12a9b0ad73 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:07.615076 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-c22b4674-92dc-4ea5-b82b-5a12a9b0ad73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae91866893854a0eaf63890dd1d2b811', 'request_id': 'req-c22b4674-92dc-4ea5-b82b-5a12a9b0ad73'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:07.623783 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-c22b4674-92dc-4ea5-b82b-5a12a9b0ad73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae91866893854a0eaf63890dd1d2b811', 'request_id': 'req-c22b4674-92dc-4ea5-b82b-5a12a9b0ad73'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:07.636888 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-c22b4674-92dc-4ea5-b82b-5a12a9b0ad73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae91866893854a0eaf63890dd1d2b811', 'request_id': 'req-c22b4674-92dc-4ea5-b82b-5a12a9b0ad73'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:07.649412 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-c22b4674-92dc-4ea5-b82b-5a12a9b0ad73 admin admin] The token cache is being invalidate because project ae91866893854a0eaf63890dd1d2b811 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80534) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:42:07.649732 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-c22b4674-92dc-4ea5-b82b-5a12a9b0ad73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:07.650478 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-c22b4674-92dc-4ea5-b82b-5a12a9b0ad73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:07.652124 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1019/2036] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jul 11 14:42:07 2022] DELETE /identity/v3/projects/ae91866893854a0eaf63890dd1d2b811 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:42:07.658824 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533dc85f-4a46-477d-aaa0-ba5b4a7e0428 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:07.659292 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533dc85f-4a46-477d-aaa0-ba5b4a7e0428 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:07.659578 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533dc85f-4a46-477d-aaa0-ba5b4a7e0428 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:07.681213 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-533dc85f-4a46-477d-aaa0-ba5b4a7e0428 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:42:07.682002 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-533dc85f-4a46-477d-aaa0-ba5b4a7e0428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:42:07.752426 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1018/2037] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:42:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:42:07.761394 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c3eac3-33c5-4d91-8ef6-b7140698facd None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:07.761685 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c3eac3-33c5-4d91-8ef6-b7140698facd None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:07.761962 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c3eac3-33c5-4d91-8ef6-b7140698facd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:07.781616 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-86c3eac3-33c5-4d91-8ef6-b7140698facd None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:42:07.783047 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-86c3eac3-33c5-4d91-8ef6-b7140698facd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:42:07.793683 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1020/2038] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:42:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:42:07.798117 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533dc85f-4a46-477d-aaa0-ba5b4a7e0428 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:07.809015 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533dc85f-4a46-477d-aaa0-ba5b4a7e0428 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:07.813765 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07dbb06-9b94-402c-ac05-c3a8b873cbfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:07.814688 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07dbb06-9b94-402c-ac05-c3a8b873cbfe admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:07.814975 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07dbb06-9b94-402c-ac05-c3a8b873cbfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:07.815257 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07dbb06-9b94-402c-ac05-c3a8b873cbfe admin admin] PATH_INFO: `/v3/domains` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:07.815997 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07dbb06-9b94-402c-ac05-c3a8b873cbfe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:42:07.816422 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07dbb06-9b94-402c-ac05-c3a8b873cbfe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:07.817963 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07dbb06-9b94-402c-ac05-c3a8b873cbfe admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:07.830759 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1019/2039] 10.222.0.70 () {58 vars in 1152 bytes} [Mon Jul 11 14:42:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:42:07.835187 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c3eac3-33c5-4d91-8ef6-b7140698facd None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:07.844728 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c3eac3-33c5-4d91-8ef6-b7140698facd None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:07.849807 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd337f64-4212-45ca-b37f-7af917143058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:07.850487 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd337f64-4212-45ca-b37f-7af917143058 admin admin] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:07.850773 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd337f64-4212-45ca-b37f-7af917143058 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:07.851051 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd337f64-4212-45ca-b37f-7af917143058 admin admin] PATH_INFO: `/v3/projects` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:07.852317 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd337f64-4212-45ca-b37f-7af917143058 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:07.854250 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd337f64-4212-45ca-b37f-7af917143058 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:07.887475 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1021/2040] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jul 11 14:42:07 2022] POST /identity/v3/projects => generated 387 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:42:07.891455 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07dbb06-9b94-402c-ac05-c3a8b873cbfe admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:07.903444 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07dbb06-9b94-402c-ac05-c3a8b873cbfe admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:07.989217 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f3bc95-6ea5-457e-8aa9-3e8786fa8963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:07.990038 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f3bc95-6ea5-457e-8aa9-3e8786fa8963 admin admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:07.990692 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f3bc95-6ea5-457e-8aa9-3e8786fa8963 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:07.991191 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f3bc95-6ea5-457e-8aa9-3e8786fa8963 admin admin] PATH_INFO: `/v3/users` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:07.993272 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f3bc95-6ea5-457e-8aa9-3e8786fa8963 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:07.995003 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f3bc95-6ea5-457e-8aa9-3e8786fa8963 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:08.027583 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1020/2041] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jul 11 14:42:07 2022] POST /identity/v3/users => generated 294 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:42:08.028937 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd337f64-4212-45ca-b37f-7af917143058 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:08.041724 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd337f64-4212-45ca-b37f-7af917143058 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:08.048023 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c52d812-7410-4a24-a694-f88bbee7939d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:08.048924 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c52d812-7410-4a24-a694-f88bbee7939d admin admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:08.049382 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c52d812-7410-4a24-a694-f88bbee7939d admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:08.049756 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c52d812-7410-4a24-a694-f88bbee7939d admin admin] PATH_INFO: `/v3/roles` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:08.050882 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c52d812-7410-4a24-a694-f88bbee7939d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:08.053084 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c52d812-7410-4a24-a694-f88bbee7939d admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:08.067439 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1022/2042] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:42:08 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 14:42:08.071698 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f3bc95-6ea5-457e-8aa9-3e8786fa8963 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:08.089113 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:42:08.099869 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f3bc95-6ea5-457e-8aa9-3e8786fa8963 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:08.113181 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8979d04c-caef-4cae-b2a3-4b9e285bfbfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:08.113181 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8979d04c-caef-4cae-b2a3-4b9e285bfbfe admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:08.113181 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8979d04c-caef-4cae-b2a3-4b9e285bfbfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:08.113181 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8979d04c-caef-4cae-b2a3-4b9e285bfbfe admin admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:08.113902 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8979d04c-caef-4cae-b2a3-4b9e285bfbfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:08.115566 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8979d04c-caef-4cae-b2a3-4b9e285bfbfe admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:08.134340 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c52d812-7410-4a24-a694-f88bbee7939d admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:08.144768 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1021/2043] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:42:08 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 14:42:08.150803 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c52d812-7410-4a24-a694-f88bbee7939d admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:08.165519 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6da926f-304a-4d35-988b-e5d3c1eda276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:08.165519 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6da926f-304a-4d35-988b-e5d3c1eda276 admin admin] REQUEST_METHOD: `PUT` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:08.165519 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6da926f-304a-4d35-988b-e5d3c1eda276 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:08.165519 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6da926f-304a-4d35-988b-e5d3c1eda276 admin admin] PATH_INFO: `/v3/projects/ef889c93d4e249139bf73867ccf1220a/users/e42c036b1b9645ee95fafd7f1fe15ec3/roles/8eff41f243c843ed95505a488ca6eada` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:08.256421 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6da926f-304a-4d35-988b-e5d3c1eda276 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef889c93d4e249139bf73867ccf1220a, user_id=e42c036b1b9645ee95fafd7f1fe15ec3, role_id=8eff41f243c843ed95505a488ca6eada)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:08.265012 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6da926f-304a-4d35-988b-e5d3c1eda276 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:08.303775 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1023/2044] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jul 11 14:42:08 2022] PUT /identity/v3/projects/ef889c93d4e249139bf73867ccf1220a/users/e42c036b1b9645ee95fafd7f1fe15ec3/roles/8eff41f243c843ed95505a488ca6eada => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:42:08.319120 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52305b3e-a476-425d-8819-579d2a563d23 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:08.319734 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52305b3e-a476-425d-8819-579d2a563d23 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:08.320156 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52305b3e-a476-425d-8819-579d2a563d23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:08.369829 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-52305b3e-a476-425d-8819-579d2a563d23 None None] MFA Rules not processed for user `e42c036b1b9645ee95fafd7f1fe15ec3`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:42:08.372782 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-52305b3e-a476-425d-8819-579d2a563d23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:42:08.482080 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1022/2045] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:42:08 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:42:08.486118 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6da926f-304a-4d35-988b-e5d3c1eda276 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:08.590632 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6da926f-304a-4d35-988b-e5d3c1eda276 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:08.598402 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70777d91-62ac-4e29-8f1a-8b965cc55446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:08.599105 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70777d91-62ac-4e29-8f1a-8b965cc55446 admin admin] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:08.599428 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70777d91-62ac-4e29-8f1a-8b965cc55446 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:08.599802 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70777d91-62ac-4e29-8f1a-8b965cc55446 admin admin] PATH_INFO: `/v3/projects` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:08.600428 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70777d91-62ac-4e29-8f1a-8b965cc55446 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:08.602657 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70777d91-62ac-4e29-8f1a-8b965cc55446 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:08.613721 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:42:08.647338 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1024/2046] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jul 11 14:42:08 2022] POST /identity/v3/projects => generated 387 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:42:08.655205 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52305b3e-a476-425d-8819-579d2a563d23 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:08.672109 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52305b3e-a476-425d-8819-579d2a563d23 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:08.757050 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949c2b41-bcf1-4893-9423-b40e3a6bf06a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:08.757857 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949c2b41-bcf1-4893-9423-b40e3a6bf06a admin admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:08.758688 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949c2b41-bcf1-4893-9423-b40e3a6bf06a admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:08.759371 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949c2b41-bcf1-4893-9423-b40e3a6bf06a admin admin] PATH_INFO: `/v3/users` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:08.759641 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949c2b41-bcf1-4893-9423-b40e3a6bf06a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:08.761814 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949c2b41-bcf1-4893-9423-b40e3a6bf06a admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:08.807418 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1023/2047] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jul 11 14:42:08 2022] POST /identity/v3/users => generated 300 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:42:08.812343 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70777d91-62ac-4e29-8f1a-8b965cc55446 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:08.826508 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70777d91-62ac-4e29-8f1a-8b965cc55446 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:08.831606 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6b4d26-0c6e-44a7-8196-cdb9991183cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:08.832347 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6b4d26-0c6e-44a7-8196-cdb9991183cf admin admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:08.832639 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6b4d26-0c6e-44a7-8196-cdb9991183cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:08.832932 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6b4d26-0c6e-44a7-8196-cdb9991183cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:08.834031 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6b4d26-0c6e-44a7-8196-cdb9991183cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:08.836060 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6b4d26-0c6e-44a7-8196-cdb9991183cf admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:08.850523 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1025/2048] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:42:08 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:42:08.855195 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949c2b41-bcf1-4893-9423-b40e3a6bf06a admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:08.866153 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949c2b41-bcf1-4893-9423-b40e3a6bf06a admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:08.871836 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9327a7-a6ff-421a-88aa-cb6bd7454caa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:08.872777 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9327a7-a6ff-421a-88aa-cb6bd7454caa admin admin] REQUEST_METHOD: `PUT` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:08.873067 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9327a7-a6ff-421a-88aa-cb6bd7454caa admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:08.873347 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9327a7-a6ff-421a-88aa-cb6bd7454caa admin admin] PATH_INFO: `/v3/projects/2d43df02b5404bf2b000587ef6241f7b/users/8da3a43c26154b21a2f30ac44965d52a/roles/b46df176b0fe479da63c318db225bed4` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:08.889842 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9327a7-a6ff-421a-88aa-cb6bd7454caa admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d43df02b5404bf2b000587ef6241f7b, user_id=8da3a43c26154b21a2f30ac44965d52a, role_id=b46df176b0fe479da63c318db225bed4)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:08.892684 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9327a7-a6ff-421a-88aa-cb6bd7454caa admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:08.906488 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1024/2049] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jul 11 14:42:08 2022] PUT /identity/v3/projects/2d43df02b5404bf2b000587ef6241f7b/users/8da3a43c26154b21a2f30ac44965d52a/roles/b46df176b0fe479da63c318db225bed4 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:42:08.910577 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6b4d26-0c6e-44a7-8196-cdb9991183cf admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:08.921803 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6b4d26-0c6e-44a7-8196-cdb9991183cf admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:08.993638 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cf198e-875a-4a14-b9e4-cef6a9112093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:08.994128 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cf198e-875a-4a14-b9e4-cef6a9112093 admin admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:08.994473 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cf198e-875a-4a14-b9e4-cef6a9112093 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:08.994888 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cf198e-875a-4a14-b9e4-cef6a9112093 admin admin] PATH_INFO: `/v3/roles` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:08.995855 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cf198e-875a-4a14-b9e4-cef6a9112093 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:08.998404 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cf198e-875a-4a14-b9e4-cef6a9112093 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:09.011207 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1026/2050] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:42:08 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:42:09.015953 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9327a7-a6ff-421a-88aa-cb6bd7454caa admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:09.027831 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9327a7-a6ff-421a-88aa-cb6bd7454caa admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:09.032614 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652ed7be-e082-41f4-9ce4-01965697766e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:09.033557 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652ed7be-e082-41f4-9ce4-01965697766e admin admin] REQUEST_METHOD: `PUT` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:09.033837 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652ed7be-e082-41f4-9ce4-01965697766e admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:09.034108 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652ed7be-e082-41f4-9ce4-01965697766e admin admin] PATH_INFO: `/v3/projects/2d43df02b5404bf2b000587ef6241f7b/users/8da3a43c26154b21a2f30ac44965d52a/roles/b46df176b0fe479da63c318db225bed4` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:09.036531 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652ed7be-e082-41f4-9ce4-01965697766e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d43df02b5404bf2b000587ef6241f7b, user_id=8da3a43c26154b21a2f30ac44965d52a, role_id=b46df176b0fe479da63c318db225bed4)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:09.039193 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652ed7be-e082-41f4-9ce4-01965697766e admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:09.050928 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1025/2051] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jul 11 14:42:09 2022] PUT /identity/v3/projects/2d43df02b5404bf2b000587ef6241f7b/users/8da3a43c26154b21a2f30ac44965d52a/roles/b46df176b0fe479da63c318db225bed4 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:42:09.063006 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a51149-ab0e-4e28-be2c-b6c8fda47830 None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:09.063255 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a51149-ab0e-4e28-be2c-b6c8fda47830 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:09.063414 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a51149-ab0e-4e28-be2c-b6c8fda47830 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:09.094233 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-a7a51149-ab0e-4e28-be2c-b6c8fda47830 None None] MFA Rules not processed for user `8da3a43c26154b21a2f30ac44965d52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:42:09.095480 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-a7a51149-ab0e-4e28-be2c-b6c8fda47830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:42:09.183875 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1027/2052] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:42:09 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:42:09.196964 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652ed7be-e082-41f4-9ce4-01965697766e admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:09.198721 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-652ed7be-e082-41f4-9ce4-01965697766e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:42:09.238418 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:42:09.267882 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652ed7be-e082-41f4-9ce4-01965697766e admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:09.274017 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b830ae5e-028b-4fc9-9828-113c799d3535 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '868e7c2dec264512b972c8736d659c34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:09.274804 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b830ae5e-028b-4fc9-9828-113c799d3535 service cinder] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:09.275098 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b830ae5e-028b-4fc9-9828-113c799d3535 service cinder] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:09.275376 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b830ae5e-028b-4fc9-9828-113c799d3535 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:09.296870 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b830ae5e-028b-4fc9-9828-113c799d3535 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:09.298676 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b830ae5e-028b-4fc9-9828-113c799d3535 service cinder] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:09.316707 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1026/2053] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:42:09 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:42:10.511182 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a51149-ab0e-4e28-be2c-b6c8fda47830 None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:10.585202 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a51149-ab0e-4e28-be2c-b6c8fda47830 None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:10.593715 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17348281-d8b8-463a-934b-6d34d562a33a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:10.595597 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17348281-d8b8-463a-934b-6d34d562a33a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:10.596411 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17348281-d8b8-463a-934b-6d34d562a33a admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:10.596713 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17348281-d8b8-463a-934b-6d34d562a33a admin admin] PATH_INFO: `/v3/users/e42c036b1b9645ee95fafd7f1fe15ec3` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:10.598320 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17348281-d8b8-463a-934b-6d34d562a33a admin admin] RBAC: Authorizing `identity:delete_user(user_id=e42c036b1b9645ee95fafd7f1fe15ec3)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:10.602155 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17348281-d8b8-463a-934b-6d34d562a33a admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:10.604927 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:42:10.660788 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-17348281-d8b8-463a-934b-6d34d562a33a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e42c036b1b9645ee95fafd7f1fe15ec3'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:10.670755 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-17348281-d8b8-463a-934b-6d34d562a33a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e42c036b1b9645ee95fafd7f1fe15ec3'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:10.685587 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-17348281-d8b8-463a-934b-6d34d562a33a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e42c036b1b9645ee95fafd7f1fe15ec3'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:10.687559 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-17348281-d8b8-463a-934b-6d34d562a33a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e42c036b1b9645ee95fafd7f1fe15ec3'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:10.688082 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-17348281-d8b8-463a-934b-6d34d562a33a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e42c036b1b9645ee95fafd7f1fe15ec3'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:10.717311 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1028/2054] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jul 11 14:42:10 2022] DELETE /identity/v3/users/e42c036b1b9645ee95fafd7f1fe15ec3 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:42:10.723126 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b6e4d6-e266-420c-943f-131ad22a1fd0 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:10.723932 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b6e4d6-e266-420c-943f-131ad22a1fd0 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:10.724253 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b6e4d6-e266-420c-943f-131ad22a1fd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:10.744086 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-88b6e4d6-e266-420c-943f-131ad22a1fd0 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:42:10.745673 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-88b6e4d6-e266-420c-943f-131ad22a1fd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:42:10.837793 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1027/2055] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:42:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:42:10.845834 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17348281-d8b8-463a-934b-6d34d562a33a admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:10.847686 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-17348281-d8b8-463a-934b-6d34d562a33a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:42:10.929089 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17348281-d8b8-463a-934b-6d34d562a33a admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:10.934930 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44cd988-6774-4d3a-8ac9-e9d45325bfb1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20eede5ccd834862b00123310b5c3975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:10.935614 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44cd988-6774-4d3a-8ac9-e9d45325bfb1 service neutron] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:10.935910 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44cd988-6774-4d3a-8ac9-e9d45325bfb1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:10.936186 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44cd988-6774-4d3a-8ac9-e9d45325bfb1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:10.948521 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44cd988-6774-4d3a-8ac9-e9d45325bfb1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:10.950105 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44cd988-6774-4d3a-8ac9-e9d45325bfb1 service neutron] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:10.964858 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1029/2056] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:42:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:42:11.362965 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b6e4d6-e266-420c-943f-131ad22a1fd0 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:11.364449 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-88b6e4d6-e266-420c-943f-131ad22a1fd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:42:11.390278 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b6e4d6-e266-420c-943f-131ad22a1fd0 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:11.396595 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50953499-ca22-4a6d-b79e-5b5862086474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:11.398207 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50953499-ca22-4a6d-b79e-5b5862086474 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:11.398207 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50953499-ca22-4a6d-b79e-5b5862086474 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:11.398207 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50953499-ca22-4a6d-b79e-5b5862086474 admin admin] PATH_INFO: `/v3/projects/ef889c93d4e249139bf73867ccf1220a` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:11.399514 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50953499-ca22-4a6d-b79e-5b5862086474 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef889c93d4e249139bf73867ccf1220a)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:11.401696 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50953499-ca22-4a6d-b79e-5b5862086474 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:11.469502 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-50953499-ca22-4a6d-b79e-5b5862086474 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef889c93d4e249139bf73867ccf1220a', 'request_id': 'req-50953499-ca22-4a6d-b79e-5b5862086474'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:11.482641 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-50953499-ca22-4a6d-b79e-5b5862086474 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef889c93d4e249139bf73867ccf1220a', 'request_id': 'req-50953499-ca22-4a6d-b79e-5b5862086474'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:11.490563 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-50953499-ca22-4a6d-b79e-5b5862086474 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef889c93d4e249139bf73867ccf1220a', 'request_id': 'req-50953499-ca22-4a6d-b79e-5b5862086474'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:11.527311 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-50953499-ca22-4a6d-b79e-5b5862086474 admin admin] The token cache is being invalidate because project ef889c93d4e249139bf73867ccf1220a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:42:11.527762 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-50953499-ca22-4a6d-b79e-5b5862086474 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:11.528602 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-50953499-ca22-4a6d-b79e-5b5862086474 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:11.530462 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1028/2057] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jul 11 14:42:11 2022] DELETE /identity/v3/projects/ef889c93d4e249139bf73867ccf1220a => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:42:11.534589 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44cd988-6774-4d3a-8ac9-e9d45325bfb1 service neutron] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:11.549696 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44cd988-6774-4d3a-8ac9-e9d45325bfb1 service neutron] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:11.637034 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c91fbe-c5a0-4ad1-b170-064f508fc6af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:11.638758 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c91fbe-c5a0-4ad1-b170-064f508fc6af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:11.639144 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c91fbe-c5a0-4ad1-b170-064f508fc6af admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:11.639523 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c91fbe-c5a0-4ad1-b170-064f508fc6af admin admin] PATH_INFO: `/v3/users/8da3a43c26154b21a2f30ac44965d52a` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:11.640888 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c91fbe-c5a0-4ad1-b170-064f508fc6af admin admin] RBAC: Authorizing `identity:delete_user(user_id=8da3a43c26154b21a2f30ac44965d52a)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:11.643011 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c91fbe-c5a0-4ad1-b170-064f508fc6af admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:11.677458 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:42:11.727120 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-29c91fbe-c5a0-4ad1-b170-064f508fc6af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8da3a43c26154b21a2f30ac44965d52a'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:11.738304 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-29c91fbe-c5a0-4ad1-b170-064f508fc6af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8da3a43c26154b21a2f30ac44965d52a'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:11.753935 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-29c91fbe-c5a0-4ad1-b170-064f508fc6af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8da3a43c26154b21a2f30ac44965d52a'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:11.754752 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-29c91fbe-c5a0-4ad1-b170-064f508fc6af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8da3a43c26154b21a2f30ac44965d52a'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:11.755637 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-29c91fbe-c5a0-4ad1-b170-064f508fc6af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8da3a43c26154b21a2f30ac44965d52a'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:11.790415 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1030/2058] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jul 11 14:42:11 2022] DELETE /identity/v3/users/8da3a43c26154b21a2f30ac44965d52a => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:42:12.116484 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50953499-ca22-4a6d-b79e-5b5862086474 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:12.118091 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-50953499-ca22-4a6d-b79e-5b5862086474 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:42:12.134528 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50953499-ca22-4a6d-b79e-5b5862086474 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:12.209368 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3f5d9f-92e4-4c2c-bc32-5f53ec9bd890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:12.213780 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3f5d9f-92e4-4c2c-bc32-5f53ec9bd890 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:12.214718 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3f5d9f-92e4-4c2c-bc32-5f53ec9bd890 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:12.215132 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3f5d9f-92e4-4c2c-bc32-5f53ec9bd890 admin admin] PATH_INFO: `/v3/users/fbf08b798e684f95ade7d13d6f6b9294` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:12.221236 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3f5d9f-92e4-4c2c-bc32-5f53ec9bd890 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fbf08b798e684f95ade7d13d6f6b9294)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:12.226237 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c91fbe-c5a0-4ad1-b170-064f508fc6af admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:12.228284 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-29c91fbe-c5a0-4ad1-b170-064f508fc6af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:42:12.241725 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3f5d9f-92e4-4c2c-bc32-5f53ec9bd890 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:12.248052 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:42:12.252884 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c91fbe-c5a0-4ad1-b170-064f508fc6af admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:12.261419 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93905a9b-011d-4bd4-a6b8-763dec690a40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:12.262465 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93905a9b-011d-4bd4-a6b8-763dec690a40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:12.263807 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93905a9b-011d-4bd4-a6b8-763dec690a40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:12.264117 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93905a9b-011d-4bd4-a6b8-763dec690a40 admin admin] PATH_INFO: `/v3/projects/2d43df02b5404bf2b000587ef6241f7b` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:12.271627 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93905a9b-011d-4bd4-a6b8-763dec690a40 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d43df02b5404bf2b000587ef6241f7b)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:12.274615 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93905a9b-011d-4bd4-a6b8-763dec690a40 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:12.347518 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-2f3f5d9f-92e4-4c2c-bc32-5f53ec9bd890 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fbf08b798e684f95ade7d13d6f6b9294'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:12.357839 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-2f3f5d9f-92e4-4c2c-bc32-5f53ec9bd890 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fbf08b798e684f95ade7d13d6f6b9294'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:12.363177 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-93905a9b-011d-4bd4-a6b8-763dec690a40 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d43df02b5404bf2b000587ef6241f7b', 'request_id': 'req-93905a9b-011d-4bd4-a6b8-763dec690a40'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:12.369870 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-2f3f5d9f-92e4-4c2c-bc32-5f53ec9bd890 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fbf08b798e684f95ade7d13d6f6b9294'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:12.370865 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-2f3f5d9f-92e4-4c2c-bc32-5f53ec9bd890 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fbf08b798e684f95ade7d13d6f6b9294'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:12.371542 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-93905a9b-011d-4bd4-a6b8-763dec690a40 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d43df02b5404bf2b000587ef6241f7b', 'request_id': 'req-93905a9b-011d-4bd4-a6b8-763dec690a40'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:12.371812 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-2f3f5d9f-92e4-4c2c-bc32-5f53ec9bd890 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fbf08b798e684f95ade7d13d6f6b9294'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:12.383310 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-93905a9b-011d-4bd4-a6b8-763dec690a40 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d43df02b5404bf2b000587ef6241f7b', 'request_id': 'req-93905a9b-011d-4bd4-a6b8-763dec690a40'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:12.399920 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-93905a9b-011d-4bd4-a6b8-763dec690a40 admin admin] The token cache is being invalidate because project 2d43df02b5404bf2b000587ef6241f7b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80534) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:42:12.400238 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-93905a9b-011d-4bd4-a6b8-763dec690a40 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:12.403070 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1029/2059] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jul 11 14:42:12 2022] DELETE /identity/v3/users/fbf08b798e684f95ade7d13d6f6b9294 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:42:12.403638 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-93905a9b-011d-4bd4-a6b8-763dec690a40 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:12.403638 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1031/2060] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jul 11 14:42:12 2022] DELETE /identity/v3/projects/2d43df02b5404bf2b000587ef6241f7b => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:42:12.404548 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30eadcb-f965-4cb0-a821-1aa58ea80bac None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:12.404842 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30eadcb-f965-4cb0-a821-1aa58ea80bac None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:12.405171 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30eadcb-f965-4cb0-a821-1aa58ea80bac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:12.407954 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c427a82d-5e88-454c-9aea-df1be37fcd86 None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:12.408278 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c427a82d-5e88-454c-9aea-df1be37fcd86 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:12.408567 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c427a82d-5e88-454c-9aea-df1be37fcd86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:12.427822 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-c30eadcb-f965-4cb0-a821-1aa58ea80bac None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:42:12.428963 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-c427a82d-5e88-454c-9aea-df1be37fcd86 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:42:12.429699 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-c30eadcb-f965-4cb0-a821-1aa58ea80bac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:42:12.430247 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-c427a82d-5e88-454c-9aea-df1be37fcd86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:42:12.529791 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1030/2061] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:42:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:42:12.530002 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1032/2062] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:42:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:42:12.542683 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab72697-a922-4e96-a187-ab078fa86479 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:12.543170 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab72697-a922-4e96-a187-ab078fa86479 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:12.543638 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab72697-a922-4e96-a187-ab078fa86479 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:12.551970 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c427a82d-5e88-454c-9aea-df1be37fcd86 None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:12.555371 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-c427a82d-5e88-454c-9aea-df1be37fcd86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:42:12.608113 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:42:12.629087 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-5ab72697-a922-4e96-a187-ab078fa86479 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:42:12.631664 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-5ab72697-a922-4e96-a187-ab078fa86479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:42:12.646279 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1031/2063] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:42:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:42:12.650695 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab72697-a922-4e96-a187-ab078fa86479 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:12.653914 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c427a82d-5e88-454c-9aea-df1be37fcd86 None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:12.658324 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8558e4-e51d-470f-99c6-0e5fcb38e443 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20eede5ccd834862b00123310b5c3975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:12.658886 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8558e4-e51d-470f-99c6-0e5fcb38e443 service neutron] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:12.659277 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8558e4-e51d-470f-99c6-0e5fcb38e443 service neutron] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:12.659575 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8558e4-e51d-470f-99c6-0e5fcb38e443 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:12.666838 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab72697-a922-4e96-a187-ab078fa86479 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:12.672909 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a76cae7-d29e-4bd2-845b-5ebee8c4992f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:12.673714 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a76cae7-d29e-4bd2-845b-5ebee8c4992f admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:12.674573 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a76cae7-d29e-4bd2-845b-5ebee8c4992f admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:12.674573 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a76cae7-d29e-4bd2-845b-5ebee8c4992f admin admin] PATH_INFO: `/v3/domains` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:12.675394 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a76cae7-d29e-4bd2-845b-5ebee8c4992f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:42:12.675805 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a76cae7-d29e-4bd2-845b-5ebee8c4992f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:12.677772 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a76cae7-d29e-4bd2-845b-5ebee8c4992f admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:12.699966 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1032/2064] 10.222.0.70 () {58 vars in 1152 bytes} [Mon Jul 11 14:42:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:42:12.701079 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a76cae7-d29e-4bd2-845b-5ebee8c4992f admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:12.705521 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8558e4-e51d-470f-99c6-0e5fcb38e443 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:12.709265 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8558e4-e51d-470f-99c6-0e5fcb38e443 service neutron] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:12.715184 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a76cae7-d29e-4bd2-845b-5ebee8c4992f admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:12.726410 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2998f2-be1b-46e1-bfbc-0865e3b5d962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:12.727824 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2998f2-be1b-46e1-bfbc-0865e3b5d962 admin admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:12.728996 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2998f2-be1b-46e1-bfbc-0865e3b5d962 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:12.729360 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2998f2-be1b-46e1-bfbc-0865e3b5d962 admin admin] PATH_INFO: `/v3/projects` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:12.731344 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2998f2-be1b-46e1-bfbc-0865e3b5d962 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:12.744963 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2998f2-be1b-46e1-bfbc-0865e3b5d962 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:12.748778 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1033/2065] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:42:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:42:12.754796 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8558e4-e51d-470f-99c6-0e5fcb38e443 service neutron] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:12.760856 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-bb8558e4-e51d-470f-99c6-0e5fcb38e443 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:42:12.788843 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8558e4-e51d-470f-99c6-0e5fcb38e443 service neutron] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:12.791516 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1033/2066] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jul 11 14:42:12 2022] POST /identity/v3/projects => generated 375 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:42:12.798347 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2998f2-be1b-46e1-bfbc-0865e3b5d962 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:12.869028 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:42:12.897855 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540b59af-1a74-4031-80cb-0bba1b1065b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:12.899518 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2998f2-be1b-46e1-bfbc-0865e3b5d962 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:12.899648 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540b59af-1a74-4031-80cb-0bba1b1065b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:12.900375 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540b59af-1a74-4031-80cb-0bba1b1065b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:12.900827 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540b59af-1a74-4031-80cb-0bba1b1065b5 admin admin] PATH_INFO: `/v3/users/b2c8114feb92426b8c9bd8712d30338c` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:12.902447 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540b59af-1a74-4031-80cb-0bba1b1065b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2c8114feb92426b8c9bd8712d30338c)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:12.904974 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540b59af-1a74-4031-80cb-0bba1b1065b5 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:12.905667 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30252483-58ec-4823-8a35-4e294f6dddc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:12.906436 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30252483-58ec-4823-8a35-4e294f6dddc2 admin admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:12.906956 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30252483-58ec-4823-8a35-4e294f6dddc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:12.907313 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30252483-58ec-4823-8a35-4e294f6dddc2 admin admin] PATH_INFO: `/v3/users` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:12.908448 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30252483-58ec-4823-8a35-4e294f6dddc2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:12.910991 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30252483-58ec-4823-8a35-4e294f6dddc2 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:12.943221 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1034/2067] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jul 11 14:42:12 2022] POST /identity/v3/users => generated 288 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:42:12.948522 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30252483-58ec-4823-8a35-4e294f6dddc2 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:12.962787 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30252483-58ec-4823-8a35-4e294f6dddc2 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:12.969370 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efec6b96-b7f2-4229-acf3-1075a187764e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:12.970233 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efec6b96-b7f2-4229-acf3-1075a187764e admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:12.970684 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efec6b96-b7f2-4229-acf3-1075a187764e admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:12.971110 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efec6b96-b7f2-4229-acf3-1075a187764e admin admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:12.972384 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efec6b96-b7f2-4229-acf3-1075a187764e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:12.974578 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efec6b96-b7f2-4229-acf3-1075a187764e admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:12.974975 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-540b59af-1a74-4031-80cb-0bba1b1065b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2c8114feb92426b8c9bd8712d30338c'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:12.987788 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-540b59af-1a74-4031-80cb-0bba1b1065b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2c8114feb92426b8c9bd8712d30338c'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:13.002237 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1035/2068] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:42:12 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 14:42:13.008911 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-540b59af-1a74-4031-80cb-0bba1b1065b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2c8114feb92426b8c9bd8712d30338c'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:13.009495 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efec6b96-b7f2-4229-acf3-1075a187764e admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:13.009676 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-540b59af-1a74-4031-80cb-0bba1b1065b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2c8114feb92426b8c9bd8712d30338c'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:13.010290 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-540b59af-1a74-4031-80cb-0bba1b1065b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2c8114feb92426b8c9bd8712d30338c'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:13.011305 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-efec6b96-b7f2-4229-acf3-1075a187764e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:42:13.034329 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efec6b96-b7f2-4229-acf3-1075a187764e admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:13.040310 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1034/2069] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jul 11 14:42:12 2022] DELETE /identity/v3/users/b2c8114feb92426b8c9bd8712d30338c => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:42:13.041266 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c0587d-3414-420b-99fe-9c58dda918f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:13.042102 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c0587d-3414-420b-99fe-9c58dda918f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:13.042804 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c0587d-3414-420b-99fe-9c58dda918f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:13.042934 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c0587d-3414-420b-99fe-9c58dda918f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:13.043779 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c0587d-3414-420b-99fe-9c58dda918f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:13.045534 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c0587d-3414-420b-99fe-9c58dda918f0 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:13.046029 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0adda1-53e6-4dca-af5c-6d668a405138 None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:13.047257 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0adda1-53e6-4dca-af5c-6d668a405138 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:13.047813 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0adda1-53e6-4dca-af5c-6d668a405138 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:13.060365 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1036/2070] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:42:13 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 14:42:13.065743 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c0587d-3414-420b-99fe-9c58dda918f0 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:13.076098 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-3b0adda1-53e6-4dca-af5c-6d668a405138 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:42:13.078174 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-3b0adda1-53e6-4dca-af5c-6d668a405138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:42:13.080031 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c0587d-3414-420b-99fe-9c58dda918f0 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:13.149925 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:42:13.170242 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6f54a4-2c51-4263-ad77-6d3cf6fc04f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:13.171270 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6f54a4-2c51-4263-ad77-6d3cf6fc04f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:13.171755 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6f54a4-2c51-4263-ad77-6d3cf6fc04f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:13.172115 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6f54a4-2c51-4263-ad77-6d3cf6fc04f9 admin admin] PATH_INFO: `/v3/projects/d3961d5b4e114358befe283ddf926ffe/users/b36c948788954e008d66e9d4ab282956/roles/8eff41f243c843ed95505a488ca6eada` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:13.182289 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1035/2071] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:42:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:42:13.182920 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0adda1-53e6-4dca-af5c-6d668a405138 None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:13.184314 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-3b0adda1-53e6-4dca-af5c-6d668a405138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:42:13.200619 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0adda1-53e6-4dca-af5c-6d668a405138 None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:13.210072 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6f54a4-2c51-4263-ad77-6d3cf6fc04f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3961d5b4e114358befe283ddf926ffe, user_id=b36c948788954e008d66e9d4ab282956, role_id=8eff41f243c843ed95505a488ca6eada)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:13.215868 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6f54a4-2c51-4263-ad77-6d3cf6fc04f9 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:13.216917 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40031ba4-c06f-4108-8121-58138093dd2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:13.217828 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40031ba4-c06f-4108-8121-58138093dd2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:13.218054 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40031ba4-c06f-4108-8121-58138093dd2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:13.218453 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40031ba4-c06f-4108-8121-58138093dd2a admin admin] PATH_INFO: `/v3/projects/5c707cd4833d4282bd478d981d6c50c2` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:13.221313 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40031ba4-c06f-4108-8121-58138093dd2a admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c707cd4833d4282bd478d981d6c50c2)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:13.225727 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40031ba4-c06f-4108-8121-58138093dd2a admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:13.236699 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1037/2072] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jul 11 14:42:13 2022] PUT /identity/v3/projects/d3961d5b4e114358befe283ddf926ffe/users/b36c948788954e008d66e9d4ab282956/roles/8eff41f243c843ed95505a488ca6eada => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:42:13.237825 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6f54a4-2c51-4263-ad77-6d3cf6fc04f9 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:13.239474 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-9c6f54a4-2c51-4263-ad77-6d3cf6fc04f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:42:13.290569 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-40031ba4-c06f-4108-8121-58138093dd2a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c707cd4833d4282bd478d981d6c50c2', 'request_id': 'req-40031ba4-c06f-4108-8121-58138093dd2a'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:13.298299 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-40031ba4-c06f-4108-8121-58138093dd2a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c707cd4833d4282bd478d981d6c50c2', 'request_id': 'req-40031ba4-c06f-4108-8121-58138093dd2a'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:13.309217 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-40031ba4-c06f-4108-8121-58138093dd2a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c707cd4833d4282bd478d981d6c50c2', 'request_id': 'req-40031ba4-c06f-4108-8121-58138093dd2a'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:13.323975 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-40031ba4-c06f-4108-8121-58138093dd2a admin admin] The token cache is being invalidate because project 5c707cd4833d4282bd478d981d6c50c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80534) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:42:13.324309 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-40031ba4-c06f-4108-8121-58138093dd2a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:13.325027 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-40031ba4-c06f-4108-8121-58138093dd2a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:13.330156 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1036/2073] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jul 11 14:42:13 2022] DELETE /identity/v3/projects/5c707cd4833d4282bd478d981d6c50c2 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:42:13.330156 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375e3199-9bc8-49b8-8b69-b43440011241 None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:13.330156 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375e3199-9bc8-49b8-8b69-b43440011241 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:13.330156 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375e3199-9bc8-49b8-8b69-b43440011241 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:13.331792 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6f54a4-2c51-4263-ad77-6d3cf6fc04f9 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:13.362901 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-375e3199-9bc8-49b8-8b69-b43440011241 None None] MFA Rules not processed for user `b36c948788954e008d66e9d4ab282956`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:42:13.364194 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-375e3199-9bc8-49b8-8b69-b43440011241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:42:13.394965 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:42:13.408139 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fafd17b-e42c-49f3-9438-458694c4aa24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20eede5ccd834862b00123310b5c3975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:13.408837 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fafd17b-e42c-49f3-9438-458694c4aa24 service neutron] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:13.409267 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fafd17b-e42c-49f3-9438-458694c4aa24 service neutron] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:13.409552 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fafd17b-e42c-49f3-9438-458694c4aa24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:13.412132 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-6fafd17b-e42c-49f3-9438-458694c4aa24 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:42:13.448463 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1037/2074] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:42:13 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:42:13.449718 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375e3199-9bc8-49b8-8b69-b43440011241 None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:13.451742 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-375e3199-9bc8-49b8-8b69-b43440011241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:42:13.495134 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fafd17b-e42c-49f3-9438-458694c4aa24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:13.496707 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fafd17b-e42c-49f3-9438-458694c4aa24 service neutron] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:13.508114 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1038/2075] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:42:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:42:13.508977 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fafd17b-e42c-49f3-9438-458694c4aa24 service neutron] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:13.510470 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-6fafd17b-e42c-49f3-9438-458694c4aa24 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:42:13.532924 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375e3199-9bc8-49b8-8b69-b43440011241 None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:13.538568 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717e0671-6eb6-47e2-b264-bb0390646bb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:13.540812 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717e0671-6eb6-47e2-b264-bb0390646bb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:13.541170 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717e0671-6eb6-47e2-b264-bb0390646bb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:13.541518 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717e0671-6eb6-47e2-b264-bb0390646bb9 admin admin] PATH_INFO: `/v3/users/37113bb017f94f4eb91f5d76905b9856` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:13.542929 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717e0671-6eb6-47e2-b264-bb0390646bb9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=37113bb017f94f4eb91f5d76905b9856)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:13.545003 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717e0671-6eb6-47e2-b264-bb0390646bb9 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:13.546809 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:42:13.608634 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fafd17b-e42c-49f3-9438-458694c4aa24 service neutron] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:13.613303 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ad3bef-6e28-43cf-8068-f8d632ae54fc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '868e7c2dec264512b972c8736d659c34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:13.614137 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ad3bef-6e28-43cf-8068-f8d632ae54fc service cinder] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:13.614530 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ad3bef-6e28-43cf-8068-f8d632ae54fc service cinder] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:13.614881 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ad3bef-6e28-43cf-8068-f8d632ae54fc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:13.625544 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ad3bef-6e28-43cf-8068-f8d632ae54fc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:13.625741 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-717e0671-6eb6-47e2-b264-bb0390646bb9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37113bb017f94f4eb91f5d76905b9856'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:13.627402 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ad3bef-6e28-43cf-8068-f8d632ae54fc service cinder] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:13.635102 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-717e0671-6eb6-47e2-b264-bb0390646bb9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37113bb017f94f4eb91f5d76905b9856'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:13.641130 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1039/2076] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:42:13 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:42:13.644672 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-717e0671-6eb6-47e2-b264-bb0390646bb9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37113bb017f94f4eb91f5d76905b9856'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:13.645429 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-717e0671-6eb6-47e2-b264-bb0390646bb9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37113bb017f94f4eb91f5d76905b9856'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:13.646262 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-717e0671-6eb6-47e2-b264-bb0390646bb9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37113bb017f94f4eb91f5d76905b9856'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:13.678852 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1038/2077] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jul 11 14:42:13 2022] DELETE /identity/v3/users/37113bb017f94f4eb91f5d76905b9856 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:42:14.088147 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ad3bef-6e28-43cf-8068-f8d632ae54fc service cinder] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:14.089731 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-53ad3bef-6e28-43cf-8068-f8d632ae54fc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:42:14.134674 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ad3bef-6e28-43cf-8068-f8d632ae54fc service cinder] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:14.281378 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f87e32-0d01-4bec-8433-03e3f2a43da0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:14.282684 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f87e32-0d01-4bec-8433-03e3f2a43da0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:14.283165 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f87e32-0d01-4bec-8433-03e3f2a43da0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:14.283549 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f87e32-0d01-4bec-8433-03e3f2a43da0 admin admin] PATH_INFO: `/v3/projects/8ca6178f2db742c199bc98afb89c35b9` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:14.286036 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f87e32-0d01-4bec-8433-03e3f2a43da0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ca6178f2db742c199bc98afb89c35b9)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:14.288850 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f87e32-0d01-4bec-8433-03e3f2a43da0 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:14.355464 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:42:14.365054 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-c3f87e32-0d01-4bec-8433-03e3f2a43da0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ca6178f2db742c199bc98afb89c35b9', 'request_id': 'req-c3f87e32-0d01-4bec-8433-03e3f2a43da0'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:14.376127 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-c3f87e32-0d01-4bec-8433-03e3f2a43da0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ca6178f2db742c199bc98afb89c35b9', 'request_id': 'req-c3f87e32-0d01-4bec-8433-03e3f2a43da0'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:14.385673 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-c3f87e32-0d01-4bec-8433-03e3f2a43da0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ca6178f2db742c199bc98afb89c35b9', 'request_id': 'req-c3f87e32-0d01-4bec-8433-03e3f2a43da0'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:14.401466 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-c3f87e32-0d01-4bec-8433-03e3f2a43da0 admin admin] The token cache is being invalidate because project 8ca6178f2db742c199bc98afb89c35b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:42:14.401753 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-c3f87e32-0d01-4bec-8433-03e3f2a43da0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:14.402313 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-c3f87e32-0d01-4bec-8433-03e3f2a43da0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:14.403884 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1040/2078] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jul 11 14:42:14 2022] DELETE /identity/v3/projects/8ca6178f2db742c199bc98afb89c35b9 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:42:14.407885 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717e0671-6eb6-47e2-b264-bb0390646bb9 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:14.409525 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-717e0671-6eb6-47e2-b264-bb0390646bb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:42:14.423940 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717e0671-6eb6-47e2-b264-bb0390646bb9 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:14.495738 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b33bfe7-12e7-46ae-a0e8-e509604b0f02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:14.496864 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b33bfe7-12e7-46ae-a0e8-e509604b0f02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:14.497171 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b33bfe7-12e7-46ae-a0e8-e509604b0f02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:14.497563 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b33bfe7-12e7-46ae-a0e8-e509604b0f02 admin admin] PATH_INFO: `/v3/users/1f8ff348b451417a9f6cf9a220c24522` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:14.498935 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b33bfe7-12e7-46ae-a0e8-e509604b0f02 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f8ff348b451417a9f6cf9a220c24522)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:14.501001 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b33bfe7-12e7-46ae-a0e8-e509604b0f02 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:14.583120 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-7b33bfe7-12e7-46ae-a0e8-e509604b0f02 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f8ff348b451417a9f6cf9a220c24522'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:14.593223 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-7b33bfe7-12e7-46ae-a0e8-e509604b0f02 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f8ff348b451417a9f6cf9a220c24522'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:14.604879 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-7b33bfe7-12e7-46ae-a0e8-e509604b0f02 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f8ff348b451417a9f6cf9a220c24522'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:14.605775 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-7b33bfe7-12e7-46ae-a0e8-e509604b0f02 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f8ff348b451417a9f6cf9a220c24522'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:14.606531 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-7b33bfe7-12e7-46ae-a0e8-e509604b0f02 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f8ff348b451417a9f6cf9a220c24522'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:14.623096 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:42:14.629381 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1039/2079] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jul 11 14:42:14 2022] DELETE /identity/v3/users/1f8ff348b451417a9f6cf9a220c24522 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:42:15.115513 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f87e32-0d01-4bec-8433-03e3f2a43da0 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:15.117578 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-c3f87e32-0d01-4bec-8433-03e3f2a43da0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:42:15.134337 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f87e32-0d01-4bec-8433-03e3f2a43da0 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:15.214925 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc063327-751c-4ce3-aec1-46a5ec6e4896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:15.216005 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc063327-751c-4ce3-aec1-46a5ec6e4896 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:15.216491 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc063327-751c-4ce3-aec1-46a5ec6e4896 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:15.216876 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc063327-751c-4ce3-aec1-46a5ec6e4896 admin admin] PATH_INFO: `/v3/projects/b91b188b8d3d46f3a93311b33ee99062` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:15.218245 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc063327-751c-4ce3-aec1-46a5ec6e4896 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b91b188b8d3d46f3a93311b33ee99062)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:15.220995 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc063327-751c-4ce3-aec1-46a5ec6e4896 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:15.268599 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b33bfe7-12e7-46ae-a0e8-e509604b0f02 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:15.272150 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-7b33bfe7-12e7-46ae-a0e8-e509604b0f02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:42:15.297409 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-dc063327-751c-4ce3-aec1-46a5ec6e4896 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b91b188b8d3d46f3a93311b33ee99062', 'request_id': 'req-dc063327-751c-4ce3-aec1-46a5ec6e4896'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:15.297969 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b33bfe7-12e7-46ae-a0e8-e509604b0f02 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:15.309475 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-dc063327-751c-4ce3-aec1-46a5ec6e4896 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b91b188b8d3d46f3a93311b33ee99062', 'request_id': 'req-dc063327-751c-4ce3-aec1-46a5ec6e4896'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:15.319272 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-dc063327-751c-4ce3-aec1-46a5ec6e4896 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b91b188b8d3d46f3a93311b33ee99062', 'request_id': 'req-dc063327-751c-4ce3-aec1-46a5ec6e4896'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:15.359377 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-dc063327-751c-4ce3-aec1-46a5ec6e4896 admin admin] The token cache is being invalidate because project b91b188b8d3d46f3a93311b33ee99062 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:42:15.359945 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-dc063327-751c-4ce3-aec1-46a5ec6e4896 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:15.361292 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-dc063327-751c-4ce3-aec1-46a5ec6e4896 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:15.370485 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1041/2080] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jul 11 14:42:15 2022] DELETE /identity/v3/projects/b91b188b8d3d46f3a93311b33ee99062 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:42:15.374030 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de1a13c-b8b9-43ff-ae4d-c679f61bc286 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:15.377535 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de1a13c-b8b9-43ff-ae4d-c679f61bc286 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:15.378448 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de1a13c-b8b9-43ff-ae4d-c679f61bc286 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:15.411208 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631c8ba7-e244-4046-a8be-e28b28eb2b32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:15.414790 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631c8ba7-e244-4046-a8be-e28b28eb2b32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:15.415344 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631c8ba7-e244-4046-a8be-e28b28eb2b32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:15.415789 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631c8ba7-e244-4046-a8be-e28b28eb2b32 admin admin] PATH_INFO: `/v3/projects/d13e1dea29274621afdd705a6d2267f5` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:15.419307 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631c8ba7-e244-4046-a8be-e28b28eb2b32 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d13e1dea29274621afdd705a6d2267f5)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:15.424240 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-2de1a13c-b8b9-43ff-ae4d-c679f61bc286 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:42:15.425252 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-2de1a13c-b8b9-43ff-ae4d-c679f61bc286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:42:15.427955 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631c8ba7-e244-4046-a8be-e28b28eb2b32 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:15.436236 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1042/2081] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:42:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:42:15.446947 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511150a9-1078-4fb6-986a-07dcb78451d4 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:15.447312 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511150a9-1078-4fb6-986a-07dcb78451d4 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:15.447531 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511150a9-1078-4fb6-986a-07dcb78451d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:15.470449 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-511150a9-1078-4fb6-986a-07dcb78451d4 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:42:15.472013 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-511150a9-1078-4fb6-986a-07dcb78451d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:42:15.490395 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1043/2082] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:42:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:42:15.493614 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511150a9-1078-4fb6-986a-07dcb78451d4 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:15.503839 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511150a9-1078-4fb6-986a-07dcb78451d4 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:15.509706 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27173ccf-c55e-40d1-b7c1-fe36c0924fec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:15.510388 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27173ccf-c55e-40d1-b7c1-fe36c0924fec admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:15.510678 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27173ccf-c55e-40d1-b7c1-fe36c0924fec admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:15.511289 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27173ccf-c55e-40d1-b7c1-fe36c0924fec admin admin] PATH_INFO: `/v3/domains` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:15.512049 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27173ccf-c55e-40d1-b7c1-fe36c0924fec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:42:15.512414 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27173ccf-c55e-40d1-b7c1-fe36c0924fec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:15.514194 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27173ccf-c55e-40d1-b7c1-fe36c0924fec admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:15.535733 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1044/2083] 10.222.0.70 () {58 vars in 1152 bytes} [Mon Jul 11 14:42:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:42:15.535733 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27173ccf-c55e-40d1-b7c1-fe36c0924fec admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:15.550576 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-631c8ba7-e244-4046-a8be-e28b28eb2b32 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd13e1dea29274621afdd705a6d2267f5', 'request_id': 'req-631c8ba7-e244-4046-a8be-e28b28eb2b32'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:15.589634 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-631c8ba7-e244-4046-a8be-e28b28eb2b32 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd13e1dea29274621afdd705a6d2267f5', 'request_id': 'req-631c8ba7-e244-4046-a8be-e28b28eb2b32'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:15.598096 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27173ccf-c55e-40d1-b7c1-fe36c0924fec admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:15.608029 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-631c8ba7-e244-4046-a8be-e28b28eb2b32 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd13e1dea29274621afdd705a6d2267f5', 'request_id': 'req-631c8ba7-e244-4046-a8be-e28b28eb2b32'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:15.634281 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-631c8ba7-e244-4046-a8be-e28b28eb2b32 admin admin] The token cache is being invalidate because project d13e1dea29274621afdd705a6d2267f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80534) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:42:15.635278 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-631c8ba7-e244-4046-a8be-e28b28eb2b32 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:15.636277 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-631c8ba7-e244-4046-a8be-e28b28eb2b32 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:15.642732 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1040/2084] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jul 11 14:42:15 2022] DELETE /identity/v3/projects/d13e1dea29274621afdd705a6d2267f5 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:42:15.644838 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39cae93-de42-4664-bcd3-1bfd0bd3a00f None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:15.645301 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39cae93-de42-4664-bcd3-1bfd0bd3a00f None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:15.645961 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39cae93-de42-4664-bcd3-1bfd0bd3a00f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:15.670586 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:42:15.675763 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-e39cae93-de42-4664-bcd3-1bfd0bd3a00f None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:42:15.677127 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-e39cae93-de42-4664-bcd3-1bfd0bd3a00f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:42:15.709955 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5addf8-fd3e-4589-93ce-b9d756cbe58c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:15.712468 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5addf8-fd3e-4589-93ce-b9d756cbe58c admin admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:15.712791 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5addf8-fd3e-4589-93ce-b9d756cbe58c admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:15.713226 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5addf8-fd3e-4589-93ce-b9d756cbe58c admin admin] PATH_INFO: `/v3/projects` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:15.714543 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5addf8-fd3e-4589-93ce-b9d756cbe58c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:15.716840 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5addf8-fd3e-4589-93ce-b9d756cbe58c admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:15.761210 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1045/2085] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jul 11 14:42:15 2022] POST /identity/v3/projects => generated 381 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:42:15.766316 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5addf8-fd3e-4589-93ce-b9d756cbe58c admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:15.771554 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-5a5addf8-fd3e-4589-93ce-b9d756cbe58c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:42:15.799382 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1041/2086] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:42:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:42:15.808092 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e213155-c35d-42c8-a671-83a82bc97605 None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:15.808714 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e213155-c35d-42c8-a671-83a82bc97605 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:15.809261 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e213155-c35d-42c8-a671-83a82bc97605 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:15.836982 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-5e213155-c35d-42c8-a671-83a82bc97605 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:42:15.838216 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-5e213155-c35d-42c8-a671-83a82bc97605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:42:15.866261 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:42:15.880812 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5addf8-fd3e-4589-93ce-b9d756cbe58c admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:15.887236 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1574b28a-1367-45ed-bfc1-376e08ac8f97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:15.888293 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1574b28a-1367-45ed-bfc1-376e08ac8f97 admin admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:15.888592 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1574b28a-1367-45ed-bfc1-376e08ac8f97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:15.888896 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1574b28a-1367-45ed-bfc1-376e08ac8f97 admin admin] PATH_INFO: `/v3/users` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:15.889596 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1574b28a-1367-45ed-bfc1-376e08ac8f97 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:15.891524 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1574b28a-1367-45ed-bfc1-376e08ac8f97 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:15.917042 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1046/2087] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jul 11 14:42:15 2022] POST /identity/v3/users => generated 291 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:42:15.917711 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1042/2088] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:42:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:42:15.924115 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e213155-c35d-42c8-a671-83a82bc97605 None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:15.924371 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1574b28a-1367-45ed-bfc1-376e08ac8f97 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:15.935977 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e213155-c35d-42c8-a671-83a82bc97605 None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:15.936242 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1574b28a-1367-45ed-bfc1-376e08ac8f97 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:15.941046 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8538073a-cd55-413c-a7d7-65723548f2ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:15.941355 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0332a7-8106-40d0-ab3e-7c505dc0f5e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:15.941719 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8538073a-cd55-413c-a7d7-65723548f2ba admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:15.942007 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0332a7-8106-40d0-ab3e-7c505dc0f5e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:15.942102 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8538073a-cd55-413c-a7d7-65723548f2ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:15.942295 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0332a7-8106-40d0-ab3e-7c505dc0f5e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:15.942433 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8538073a-cd55-413c-a7d7-65723548f2ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:15.942570 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0332a7-8106-40d0-ab3e-7c505dc0f5e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:15.943035 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8538073a-cd55-413c-a7d7-65723548f2ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:15.943293 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0332a7-8106-40d0-ab3e-7c505dc0f5e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:42:15.943598 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0332a7-8106-40d0-ab3e-7c505dc0f5e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:15.944686 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8538073a-cd55-413c-a7d7-65723548f2ba admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:15.945828 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0332a7-8106-40d0-ab3e-7c505dc0f5e7 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:15.956237 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1047/2089] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:42:15 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:42:15.958115 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1043/2090] 10.222.0.70 () {58 vars in 1152 bytes} [Mon Jul 11 14:42:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:42:15.960599 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8538073a-cd55-413c-a7d7-65723548f2ba admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:15.962668 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0332a7-8106-40d0-ab3e-7c505dc0f5e7 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:15.971734 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8538073a-cd55-413c-a7d7-65723548f2ba admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:15.972595 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0332a7-8106-40d0-ab3e-7c505dc0f5e7 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:15.976910 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ee512c-0d43-4c01-a121-00163eca6694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:15.977572 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ee512c-0d43-4c01-a121-00163eca6694 admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:15.977851 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ee512c-0d43-4c01-a121-00163eca6694 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:15.978126 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ee512c-0d43-4c01-a121-00163eca6694 admin admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:15.978395 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4203775c-6094-47d4-8864-baed7160835a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:15.978851 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ee512c-0d43-4c01-a121-00163eca6694 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:15.979391 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4203775c-6094-47d4-8864-baed7160835a admin admin] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:15.979689 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4203775c-6094-47d4-8864-baed7160835a admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:15.979969 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4203775c-6094-47d4-8864-baed7160835a admin admin] PATH_INFO: `/v3/projects` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:15.980523 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ee512c-0d43-4c01-a121-00163eca6694 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:15.980852 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4203775c-6094-47d4-8864-baed7160835a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:15.983470 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4203775c-6094-47d4-8864-baed7160835a admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:15.991653 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1048/2091] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:42:15 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 14:42:15.996682 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ee512c-0d43-4c01-a121-00163eca6694 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:16.008878 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ee512c-0d43-4c01-a121-00163eca6694 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:16.013848 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72687dbb-a287-4bf0-9cef-fba10c0738ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:16.014744 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72687dbb-a287-4bf0-9cef-fba10c0738ae admin admin] REQUEST_METHOD: `PUT` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:16.015030 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72687dbb-a287-4bf0-9cef-fba10c0738ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:16.015305 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72687dbb-a287-4bf0-9cef-fba10c0738ae admin admin] PATH_INFO: `/v3/projects/8d10aa70a73447f8afd8b3274aca4e26/users/de0abe64bdfb4dbd85fb3911aa20810a/roles/8eff41f243c843ed95505a488ca6eada` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:16.016888 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1044/2092] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jul 11 14:42:15 2022] POST /identity/v3/projects => generated 377 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:42:16.021048 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4203775c-6094-47d4-8864-baed7160835a admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:16.031898 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72687dbb-a287-4bf0-9cef-fba10c0738ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d10aa70a73447f8afd8b3274aca4e26, user_id=de0abe64bdfb4dbd85fb3911aa20810a, role_id=8eff41f243c843ed95505a488ca6eada)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:16.034614 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72687dbb-a287-4bf0-9cef-fba10c0738ae admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:16.049755 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1049/2093] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jul 11 14:42:15 2022] PUT /identity/v3/projects/8d10aa70a73447f8afd8b3274aca4e26/users/de0abe64bdfb4dbd85fb3911aa20810a/roles/8eff41f243c843ed95505a488ca6eada => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:42:16.062531 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87666b55-eb8c-4173-95ca-8f46a941f97f None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:16.062858 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87666b55-eb8c-4173-95ca-8f46a941f97f None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:16.063117 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87666b55-eb8c-4173-95ca-8f46a941f97f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:16.095897 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-87666b55-eb8c-4173-95ca-8f46a941f97f None None] MFA Rules not processed for user `de0abe64bdfb4dbd85fb3911aa20810a`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:42:16.097186 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-87666b55-eb8c-4173-95ca-8f46a941f97f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:42:16.098383 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4203775c-6094-47d4-8864-baed7160835a admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:16.149475 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:42:16.158108 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afef15b-2f13-4f23-b31e-f9cfff31e9ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:16.158786 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afef15b-2f13-4f23-b31e-f9cfff31e9ca admin admin] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:16.159077 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afef15b-2f13-4f23-b31e-f9cfff31e9ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:16.159485 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afef15b-2f13-4f23-b31e-f9cfff31e9ca admin admin] PATH_INFO: `/v3/users` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:16.160050 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afef15b-2f13-4f23-b31e-f9cfff31e9ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:16.162000 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afef15b-2f13-4f23-b31e-f9cfff31e9ca admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:16.170348 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1050/2094] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:42:16 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:42:16.182151 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87666b55-eb8c-4173-95ca-8f46a941f97f None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:16.183621 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-87666b55-eb8c-4173-95ca-8f46a941f97f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:42:16.185606 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1045/2095] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jul 11 14:42:16 2022] POST /identity/v3/users => generated 289 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:42:16.189981 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afef15b-2f13-4f23-b31e-f9cfff31e9ca admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:16.202019 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afef15b-2f13-4f23-b31e-f9cfff31e9ca admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:16.206728 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287031b0-ccd6-492d-b7bb-b70d7cd340b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:16.207888 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287031b0-ccd6-492d-b7bb-b70d7cd340b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:16.208176 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287031b0-ccd6-492d-b7bb-b70d7cd340b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:16.208483 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287031b0-ccd6-492d-b7bb-b70d7cd340b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:16.209213 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287031b0-ccd6-492d-b7bb-b70d7cd340b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:16.211438 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287031b0-ccd6-492d-b7bb-b70d7cd340b5 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:16.224884 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1046/2096] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:42:16 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:42:16.227229 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287031b0-ccd6-492d-b7bb-b70d7cd340b5 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:16.237696 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287031b0-ccd6-492d-b7bb-b70d7cd340b5 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:16.243983 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858654c6-f2cc-417c-9593-d0b5d7f5b1a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:16.244835 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858654c6-f2cc-417c-9593-d0b5d7f5b1a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:16.245181 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858654c6-f2cc-417c-9593-d0b5d7f5b1a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:16.245529 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858654c6-f2cc-417c-9593-d0b5d7f5b1a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:16.246586 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858654c6-f2cc-417c-9593-d0b5d7f5b1a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:16.248477 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858654c6-f2cc-417c-9593-d0b5d7f5b1a6 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:16.264303 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1047/2097] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:42:16 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 14:42:16.265845 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87666b55-eb8c-4173-95ca-8f46a941f97f None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:16.269851 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858654c6-f2cc-417c-9593-d0b5d7f5b1a6 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:16.270729 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4dfa3a-13bc-45bb-9302-6ca9ecfe5663 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '868e7c2dec264512b972c8736d659c34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:16.271402 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4dfa3a-13bc-45bb-9302-6ca9ecfe5663 service cinder] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:16.271785 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4dfa3a-13bc-45bb-9302-6ca9ecfe5663 service cinder] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:16.272388 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4dfa3a-13bc-45bb-9302-6ca9ecfe5663 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:16.287813 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4dfa3a-13bc-45bb-9302-6ca9ecfe5663 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:16.289508 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858654c6-f2cc-417c-9593-d0b5d7f5b1a6 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:16.291051 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4dfa3a-13bc-45bb-9302-6ca9ecfe5663 service cinder] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:16.294620 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9ea666-9d1b-46c8-b019-4451de8a2f98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:16.295538 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9ea666-9d1b-46c8-b019-4451de8a2f98 admin admin] REQUEST_METHOD: `PUT` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:16.295822 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9ea666-9d1b-46c8-b019-4451de8a2f98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:16.296102 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9ea666-9d1b-46c8-b019-4451de8a2f98 admin admin] PATH_INFO: `/v3/projects/ef63473e3a6e46fc9413df7057d239f6/users/f27998108bd1466a8491bf2639434537/roles/8eff41f243c843ed95505a488ca6eada` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:16.302320 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:42:16.313173 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1051/2098] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:42:16 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:42:16.327528 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9ea666-9d1b-46c8-b019-4451de8a2f98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef63473e3a6e46fc9413df7057d239f6, user_id=f27998108bd1466a8491bf2639434537, role_id=8eff41f243c843ed95505a488ca6eada)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:16.330284 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9ea666-9d1b-46c8-b019-4451de8a2f98 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:16.347044 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1048/2099] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jul 11 14:42:16 2022] PUT /identity/v3/projects/ef63473e3a6e46fc9413df7057d239f6/users/f27998108bd1466a8491bf2639434537/roles/8eff41f243c843ed95505a488ca6eada => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:42:16.360326 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47ce671-6eca-4ea3-b65a-73a53ea51d01 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:16.360747 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47ce671-6eca-4ea3-b65a-73a53ea51d01 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:16.361133 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47ce671-6eca-4ea3-b65a-73a53ea51d01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:16.403378 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-e47ce671-6eca-4ea3-b65a-73a53ea51d01 None None] MFA Rules not processed for user `f27998108bd1466a8491bf2639434537`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:42:16.404960 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-e47ce671-6eca-4ea3-b65a-73a53ea51d01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:42:16.484475 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1052/2100] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:42:16 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:42:16.489760 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9ea666-9d1b-46c8-b019-4451de8a2f98 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:16.567885 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9ea666-9d1b-46c8-b019-4451de8a2f98 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:16.576489 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149ba824-d280-45b1-b2b9-297c68734394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:16.577561 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149ba824-d280-45b1-b2b9-297c68734394 admin admin] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:16.577869 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149ba824-d280-45b1-b2b9-297c68734394 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:16.578164 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149ba824-d280-45b1-b2b9-297c68734394 admin admin] PATH_INFO: `/v3/projects` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:16.579263 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149ba824-d280-45b1-b2b9-297c68734394 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:16.581879 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149ba824-d280-45b1-b2b9-297c68734394 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:16.636894 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1049/2101] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jul 11 14:42:16 2022] POST /identity/v3/projects => generated 381 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:42:16.640667 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47ce671-6eca-4ea3-b65a-73a53ea51d01 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:16.657394 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47ce671-6eca-4ea3-b65a-73a53ea51d01 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:16.737713 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07beb3c-9a7f-4652-ab6a-1809ac71cf5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:16.738523 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07beb3c-9a7f-4652-ab6a-1809ac71cf5b admin admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:16.738931 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07beb3c-9a7f-4652-ab6a-1809ac71cf5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:16.739279 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07beb3c-9a7f-4652-ab6a-1809ac71cf5b admin admin] PATH_INFO: `/v3/users` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:16.740063 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07beb3c-9a7f-4652-ab6a-1809ac71cf5b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:16.742245 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07beb3c-9a7f-4652-ab6a-1809ac71cf5b admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:16.768508 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1053/2102] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jul 11 14:42:16 2022] POST /identity/v3/users => generated 297 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:42:16.772672 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149ba824-d280-45b1-b2b9-297c68734394 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:16.788975 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149ba824-d280-45b1-b2b9-297c68734394 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:16.799623 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d76cd8b-ec31-49dc-8e81-3fe1e04f79f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:16.800761 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d76cd8b-ec31-49dc-8e81-3fe1e04f79f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:16.801323 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d76cd8b-ec31-49dc-8e81-3fe1e04f79f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:16.801784 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d76cd8b-ec31-49dc-8e81-3fe1e04f79f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:16.803035 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d76cd8b-ec31-49dc-8e81-3fe1e04f79f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:16.806286 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d76cd8b-ec31-49dc-8e81-3fe1e04f79f3 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:16.836510 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1050/2103] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:42:16 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:42:16.837594 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07beb3c-9a7f-4652-ab6a-1809ac71cf5b admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:16.852819 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07beb3c-9a7f-4652-ab6a-1809ac71cf5b admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:16.861150 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141b6dfa-0ad9-44f7-971e-5e8b163c8ae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:16.862282 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141b6dfa-0ad9-44f7-971e-5e8b163c8ae1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:16.862796 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141b6dfa-0ad9-44f7-971e-5e8b163c8ae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:16.863206 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141b6dfa-0ad9-44f7-971e-5e8b163c8ae1 admin admin] PATH_INFO: `/v3/projects/1dd1b0b4f6664ac5aa91cb140de6c8ae/users/0cf80ff2114d45f5a4a5b046a1f4b0a9/roles/b46df176b0fe479da63c318db225bed4` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:16.874555 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:42:16.884810 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141b6dfa-0ad9-44f7-971e-5e8b163c8ae1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1dd1b0b4f6664ac5aa91cb140de6c8ae, user_id=0cf80ff2114d45f5a4a5b046a1f4b0a9, role_id=b46df176b0fe479da63c318db225bed4)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:16.889037 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141b6dfa-0ad9-44f7-971e-5e8b163c8ae1 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:16.912518 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1054/2104] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jul 11 14:42:16 2022] PUT /identity/v3/projects/1dd1b0b4f6664ac5aa91cb140de6c8ae/users/0cf80ff2114d45f5a4a5b046a1f4b0a9/roles/b46df176b0fe479da63c318db225bed4 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:42:16.916941 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d76cd8b-ec31-49dc-8e81-3fe1e04f79f3 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:16.938829 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d76cd8b-ec31-49dc-8e81-3fe1e04f79f3 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:17.027860 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aece2f16-9795-4ce6-9416-055574b2b8e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:17.028161 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aece2f16-9795-4ce6-9416-055574b2b8e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:17.028720 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aece2f16-9795-4ce6-9416-055574b2b8e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:17.029012 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aece2f16-9795-4ce6-9416-055574b2b8e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:17.029767 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aece2f16-9795-4ce6-9416-055574b2b8e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:17.031404 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aece2f16-9795-4ce6-9416-055574b2b8e8 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:17.043364 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1051/2105] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:42:16 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:42:17.050956 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141b6dfa-0ad9-44f7-971e-5e8b163c8ae1 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:17.067381 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141b6dfa-0ad9-44f7-971e-5e8b163c8ae1 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:17.073340 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ad2bc0-0505-4525-b792-e45d9edb9336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:17.074260 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ad2bc0-0505-4525-b792-e45d9edb9336 admin admin] REQUEST_METHOD: `PUT` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:17.074559 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ad2bc0-0505-4525-b792-e45d9edb9336 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:17.074826 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ad2bc0-0505-4525-b792-e45d9edb9336 admin admin] PATH_INFO: `/v3/projects/1dd1b0b4f6664ac5aa91cb140de6c8ae/users/0cf80ff2114d45f5a4a5b046a1f4b0a9/roles/b46df176b0fe479da63c318db225bed4` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:17.077013 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ad2bc0-0505-4525-b792-e45d9edb9336 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1dd1b0b4f6664ac5aa91cb140de6c8ae, user_id=0cf80ff2114d45f5a4a5b046a1f4b0a9, role_id=b46df176b0fe479da63c318db225bed4)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:17.079748 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ad2bc0-0505-4525-b792-e45d9edb9336 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:17.097087 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1055/2106] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jul 11 14:42:17 2022] PUT /identity/v3/projects/1dd1b0b4f6664ac5aa91cb140de6c8ae/users/0cf80ff2114d45f5a4a5b046a1f4b0a9/roles/b46df176b0fe479da63c318db225bed4 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:42:17.111701 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1b333a-c42f-476a-b78d-b0ceea770594 None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:17.112021 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1b333a-c42f-476a-b78d-b0ceea770594 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:17.112435 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1b333a-c42f-476a-b78d-b0ceea770594 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:17.143999 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-ec1b333a-c42f-476a-b78d-b0ceea770594 None None] MFA Rules not processed for user `0cf80ff2114d45f5a4a5b046a1f4b0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:42:17.145301 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-ec1b333a-c42f-476a-b78d-b0ceea770594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:42:17.196280 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:42:17.233195 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1052/2107] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:42:17 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:42:17.245917 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ad2bc0-0505-4525-b792-e45d9edb9336 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:17.247814 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-b5ad2bc0-0505-4525-b792-e45d9edb9336 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:42:17.312799 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ad2bc0-0505-4525-b792-e45d9edb9336 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:17.317414 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bae7f9e-ca85-466b-8cb7-e4dcaf84004a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '868e7c2dec264512b972c8736d659c34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:17.318320 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bae7f9e-ca85-466b-8cb7-e4dcaf84004a service cinder] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:17.318605 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bae7f9e-ca85-466b-8cb7-e4dcaf84004a service cinder] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:17.318947 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bae7f9e-ca85-466b-8cb7-e4dcaf84004a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:17.330297 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bae7f9e-ca85-466b-8cb7-e4dcaf84004a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:17.331818 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bae7f9e-ca85-466b-8cb7-e4dcaf84004a service cinder] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:17.343792 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1056/2108] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:42:17 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:42:17.777728 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1b333a-c42f-476a-b78d-b0ceea770594 None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:17.872303 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1b333a-c42f-476a-b78d-b0ceea770594 None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:17.885008 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897b6bb6-9a50-493f-a624-448e905d3009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:17.886645 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897b6bb6-9a50-493f-a624-448e905d3009 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:17.887107 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897b6bb6-9a50-493f-a624-448e905d3009 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:17.887837 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897b6bb6-9a50-493f-a624-448e905d3009 admin admin] PATH_INFO: `/v3/users/f27998108bd1466a8491bf2639434537` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:17.890185 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897b6bb6-9a50-493f-a624-448e905d3009 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f27998108bd1466a8491bf2639434537)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:17.894061 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897b6bb6-9a50-493f-a624-448e905d3009 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:17.983727 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-897b6bb6-9a50-493f-a624-448e905d3009 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f27998108bd1466a8491bf2639434537'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:18.000491 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-897b6bb6-9a50-493f-a624-448e905d3009 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f27998108bd1466a8491bf2639434537'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:18.014845 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-897b6bb6-9a50-493f-a624-448e905d3009 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f27998108bd1466a8491bf2639434537'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:18.015666 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-897b6bb6-9a50-493f-a624-448e905d3009 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f27998108bd1466a8491bf2639434537'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:18.016735 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-897b6bb6-9a50-493f-a624-448e905d3009 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f27998108bd1466a8491bf2639434537'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:18.036947 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1053/2109] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jul 11 14:42:17 2022] DELETE /identity/v3/users/f27998108bd1466a8491bf2639434537 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:42:18.042148 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b6ec03-b52e-4f89-8ff1-34cc07065b70 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:18.042443 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b6ec03-b52e-4f89-8ff1-34cc07065b70 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:18.042720 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b6ec03-b52e-4f89-8ff1-34cc07065b70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:18.061812 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-f3b6ec03-b52e-4f89-8ff1-34cc07065b70 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:42:18.063032 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-f3b6ec03-b52e-4f89-8ff1-34cc07065b70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:42:18.144177 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1057/2110] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:42:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:42:18.155458 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897b6bb6-9a50-493f-a624-448e905d3009 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:18.157167 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-897b6bb6-9a50-493f-a624-448e905d3009 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:42:18.230064 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897b6bb6-9a50-493f-a624-448e905d3009 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:18.234090 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac5a7b1-250d-4864-8009-7ef54abd94d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20eede5ccd834862b00123310b5c3975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:18.234755 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac5a7b1-250d-4864-8009-7ef54abd94d6 service neutron] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:18.235035 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac5a7b1-250d-4864-8009-7ef54abd94d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:18.235311 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac5a7b1-250d-4864-8009-7ef54abd94d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:18.246510 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac5a7b1-250d-4864-8009-7ef54abd94d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:18.247990 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac5a7b1-250d-4864-8009-7ef54abd94d6 service neutron] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:18.262360 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1054/2111] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:42:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:42:18.552803 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b6ec03-b52e-4f89-8ff1-34cc07065b70 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:18.554977 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-f3b6ec03-b52e-4f89-8ff1-34cc07065b70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:42:18.574331 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b6ec03-b52e-4f89-8ff1-34cc07065b70 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:18.583848 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f8b766-120a-4cbc-8f93-0ccf35cd22c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:18.585415 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f8b766-120a-4cbc-8f93-0ccf35cd22c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:18.585711 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f8b766-120a-4cbc-8f93-0ccf35cd22c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:18.585992 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f8b766-120a-4cbc-8f93-0ccf35cd22c3 admin admin] PATH_INFO: `/v3/projects/ef63473e3a6e46fc9413df7057d239f6` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:18.587308 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f8b766-120a-4cbc-8f93-0ccf35cd22c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef63473e3a6e46fc9413df7057d239f6)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:18.589302 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f8b766-120a-4cbc-8f93-0ccf35cd22c3 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:18.646742 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-13f8b766-120a-4cbc-8f93-0ccf35cd22c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef63473e3a6e46fc9413df7057d239f6', 'request_id': 'req-13f8b766-120a-4cbc-8f93-0ccf35cd22c3'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:18.655079 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-13f8b766-120a-4cbc-8f93-0ccf35cd22c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef63473e3a6e46fc9413df7057d239f6', 'request_id': 'req-13f8b766-120a-4cbc-8f93-0ccf35cd22c3'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:18.662204 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-13f8b766-120a-4cbc-8f93-0ccf35cd22c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef63473e3a6e46fc9413df7057d239f6', 'request_id': 'req-13f8b766-120a-4cbc-8f93-0ccf35cd22c3'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:18.677161 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:42:18.684997 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-13f8b766-120a-4cbc-8f93-0ccf35cd22c3 admin admin] The token cache is being invalidate because project ef63473e3a6e46fc9413df7057d239f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:42:18.685820 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-13f8b766-120a-4cbc-8f93-0ccf35cd22c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:18.687124 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-13f8b766-120a-4cbc-8f93-0ccf35cd22c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:18.689686 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1058/2112] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jul 11 14:42:18 2022] DELETE /identity/v3/projects/ef63473e3a6e46fc9413df7057d239f6 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:42:18.694199 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac5a7b1-250d-4864-8009-7ef54abd94d6 service neutron] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:18.702730 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:42:18.709946 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac5a7b1-250d-4864-8009-7ef54abd94d6 service neutron] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:18.791900 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f55994-a55b-4b39-a9a6-6ab571341c80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:18.792738 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f55994-a55b-4b39-a9a6-6ab571341c80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:18.793024 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f55994-a55b-4b39-a9a6-6ab571341c80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:18.793302 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f55994-a55b-4b39-a9a6-6ab571341c80 admin admin] PATH_INFO: `/v3/users/0cf80ff2114d45f5a4a5b046a1f4b0a9` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:18.794545 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f55994-a55b-4b39-a9a6-6ab571341c80 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0cf80ff2114d45f5a4a5b046a1f4b0a9)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:18.796536 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f55994-a55b-4b39-a9a6-6ab571341c80 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:18.853823 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-94f55994-a55b-4b39-a9a6-6ab571341c80 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0cf80ff2114d45f5a4a5b046a1f4b0a9'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:18.861342 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-94f55994-a55b-4b39-a9a6-6ab571341c80 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0cf80ff2114d45f5a4a5b046a1f4b0a9'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:18.870361 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-94f55994-a55b-4b39-a9a6-6ab571341c80 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0cf80ff2114d45f5a4a5b046a1f4b0a9'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:18.871088 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-94f55994-a55b-4b39-a9a6-6ab571341c80 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0cf80ff2114d45f5a4a5b046a1f4b0a9'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:18.871756 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-94f55994-a55b-4b39-a9a6-6ab571341c80 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0cf80ff2114d45f5a4a5b046a1f4b0a9'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:18.892132 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1055/2113] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jul 11 14:42:18 2022] DELETE /identity/v3/users/0cf80ff2114d45f5a4a5b046a1f4b0a9 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:42:19.239253 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f8b766-120a-4cbc-8f93-0ccf35cd22c3 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:19.240814 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-13f8b766-120a-4cbc-8f93-0ccf35cd22c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:42:19.263443 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f8b766-120a-4cbc-8f93-0ccf35cd22c3 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:19.418658 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f7aff7-92e6-4cc3-b794-9e673fdc348a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:19.420377 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f7aff7-92e6-4cc3-b794-9e673fdc348a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:19.420943 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f7aff7-92e6-4cc3-b794-9e673fdc348a admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:19.421397 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f7aff7-92e6-4cc3-b794-9e673fdc348a admin admin] PATH_INFO: `/v3/projects/1dd1b0b4f6664ac5aa91cb140de6c8ae` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:19.423711 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f7aff7-92e6-4cc3-b794-9e673fdc348a admin admin] RBAC: Authorizing `identity:delete_project(project_id=1dd1b0b4f6664ac5aa91cb140de6c8ae)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:19.426178 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f7aff7-92e6-4cc3-b794-9e673fdc348a admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:19.550189 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-83f7aff7-92e6-4cc3-b794-9e673fdc348a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1dd1b0b4f6664ac5aa91cb140de6c8ae', 'request_id': 'req-83f7aff7-92e6-4cc3-b794-9e673fdc348a'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:19.558306 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-83f7aff7-92e6-4cc3-b794-9e673fdc348a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1dd1b0b4f6664ac5aa91cb140de6c8ae', 'request_id': 'req-83f7aff7-92e6-4cc3-b794-9e673fdc348a'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:19.569799 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-83f7aff7-92e6-4cc3-b794-9e673fdc348a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1dd1b0b4f6664ac5aa91cb140de6c8ae', 'request_id': 'req-83f7aff7-92e6-4cc3-b794-9e673fdc348a'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:19.596555 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-83f7aff7-92e6-4cc3-b794-9e673fdc348a admin admin] The token cache is being invalidate because project 1dd1b0b4f6664ac5aa91cb140de6c8ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:42:19.596971 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-83f7aff7-92e6-4cc3-b794-9e673fdc348a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:19.597950 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-83f7aff7-92e6-4cc3-b794-9e673fdc348a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:19.600551 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1059/2114] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jul 11 14:42:19 2022] DELETE /identity/v3/projects/1dd1b0b4f6664ac5aa91cb140de6c8ae => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:42:19.609445 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407eb0e4-a4f2-4f4f-bfc0-c37b839c482e None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:19.609883 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407eb0e4-a4f2-4f4f-bfc0-c37b839c482e None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:19.610425 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407eb0e4-a4f2-4f4f-bfc0-c37b839c482e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:19.636564 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-407eb0e4-a4f2-4f4f-bfc0-c37b839c482e None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:42:19.637366 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-407eb0e4-a4f2-4f4f-bfc0-c37b839c482e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:42:19.734509 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1056/2115] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:42:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:42:19.744602 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bab52ba-e996-45ea-9fb5-e87a9ad3c2ea None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:19.745066 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bab52ba-e996-45ea-9fb5-e87a9ad3c2ea None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:19.745349 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bab52ba-e996-45ea-9fb5-e87a9ad3c2ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:19.817091 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-5bab52ba-e996-45ea-9fb5-e87a9ad3c2ea None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:42:19.818918 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-5bab52ba-e996-45ea-9fb5-e87a9ad3c2ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:42:19.832464 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1060/2116] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:42:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:42:19.833828 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407eb0e4-a4f2-4f4f-bfc0-c37b839c482e None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:19.846091 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407eb0e4-a4f2-4f4f-bfc0-c37b839c482e None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:19.855817 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3a2b7e-7af1-4555-90dd-3f58500c3034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:19.857005 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3a2b7e-7af1-4555-90dd-3f58500c3034 admin admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:19.857746 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3a2b7e-7af1-4555-90dd-3f58500c3034 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:19.858304 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3a2b7e-7af1-4555-90dd-3f58500c3034 admin admin] PATH_INFO: `/v3/domains` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:19.859132 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3a2b7e-7af1-4555-90dd-3f58500c3034 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:42:19.859727 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3a2b7e-7af1-4555-90dd-3f58500c3034 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:19.862547 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3a2b7e-7af1-4555-90dd-3f58500c3034 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:19.889673 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1057/2117] 10.222.0.70 () {58 vars in 1152 bytes} [Mon Jul 11 14:42:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:42:19.890603 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bab52ba-e996-45ea-9fb5-e87a9ad3c2ea None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:19.906963 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bab52ba-e996-45ea-9fb5-e87a9ad3c2ea None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:19.920281 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce14f05-ebd2-49c9-aabd-ec65b07a4cad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:19.921207 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce14f05-ebd2-49c9-aabd-ec65b07a4cad admin admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:19.921604 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce14f05-ebd2-49c9-aabd-ec65b07a4cad admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:19.922016 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce14f05-ebd2-49c9-aabd-ec65b07a4cad admin admin] PATH_INFO: `/v3/projects` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:19.922813 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce14f05-ebd2-49c9-aabd-ec65b07a4cad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:19.925251 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce14f05-ebd2-49c9-aabd-ec65b07a4cad admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:19.973658 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1061/2118] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jul 11 14:42:19 2022] POST /identity/v3/projects => generated 375 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:42:19.978594 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3a2b7e-7af1-4555-90dd-3f58500c3034 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:19.990821 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3a2b7e-7af1-4555-90dd-3f58500c3034 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:19.999168 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:42:20.099433 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6224cd-04ff-4752-b387-c7d2699d7c25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:20.100327 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6224cd-04ff-4752-b387-c7d2699d7c25 admin admin] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:20.100778 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6224cd-04ff-4752-b387-c7d2699d7c25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:20.101624 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6224cd-04ff-4752-b387-c7d2699d7c25 admin admin] PATH_INFO: `/v3/users` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:20.102549 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6224cd-04ff-4752-b387-c7d2699d7c25 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:20.104973 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6224cd-04ff-4752-b387-c7d2699d7c25 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:20.140510 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1058/2119] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jul 11 14:42:19 2022] POST /identity/v3/users => generated 288 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:42:20.145044 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce14f05-ebd2-49c9-aabd-ec65b07a4cad admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:20.157086 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce14f05-ebd2-49c9-aabd-ec65b07a4cad admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:20.162148 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0bfcb8-b870-4689-b966-f18152ce4fb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:20.162940 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0bfcb8-b870-4689-b966-f18152ce4fb8 admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:20.164447 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0bfcb8-b870-4689-b966-f18152ce4fb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:20.164447 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0bfcb8-b870-4689-b966-f18152ce4fb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:20.165245 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0bfcb8-b870-4689-b966-f18152ce4fb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:20.167237 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0bfcb8-b870-4689-b966-f18152ce4fb8 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:20.183235 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1062/2120] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:42:20 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 14:42:20.185133 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6224cd-04ff-4752-b387-c7d2699d7c25 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:20.197448 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6224cd-04ff-4752-b387-c7d2699d7c25 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:20.202790 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1792a0c1-4b35-43d1-b599-afa3aa5618df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:20.203564 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1792a0c1-4b35-43d1-b599-afa3aa5618df admin admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:20.203928 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1792a0c1-4b35-43d1-b599-afa3aa5618df admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:20.204288 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1792a0c1-4b35-43d1-b599-afa3aa5618df admin admin] PATH_INFO: `/v3/roles` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:20.205360 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1792a0c1-4b35-43d1-b599-afa3aa5618df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:20.206954 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1792a0c1-4b35-43d1-b599-afa3aa5618df admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:20.231628 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1059/2121] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:42:20 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:42:20.236239 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0bfcb8-b870-4689-b966-f18152ce4fb8 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:20.250771 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0bfcb8-b870-4689-b966-f18152ce4fb8 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:20.260034 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c66964-467f-4ad6-877e-18c73982578e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:20.261388 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c66964-467f-4ad6-877e-18c73982578e admin admin] REQUEST_METHOD: `PUT` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:20.261765 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c66964-467f-4ad6-877e-18c73982578e admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:20.262058 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c66964-467f-4ad6-877e-18c73982578e admin admin] PATH_INFO: `/v3/projects/cecf3a9600b64d07a8a49dc2dae961b7/users/604c0a74efce41b9b882fdaf2da4806e/roles/8eff41f243c843ed95505a488ca6eada` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:20.292359 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c66964-467f-4ad6-877e-18c73982578e admin admin] RBAC: Authorizing `identity:create_grant(project_id=cecf3a9600b64d07a8a49dc2dae961b7, user_id=604c0a74efce41b9b882fdaf2da4806e, role_id=8eff41f243c843ed95505a488ca6eada)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:20.293232 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c66964-467f-4ad6-877e-18c73982578e admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:20.314752 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1063/2122] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jul 11 14:42:20 2022] PUT /identity/v3/projects/cecf3a9600b64d07a8a49dc2dae961b7/users/604c0a74efce41b9b882fdaf2da4806e/roles/8eff41f243c843ed95505a488ca6eada => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:42:20.390986 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d68cddb-2a0a-4cb3-be2d-30c5a3e51b91 None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:20.391300 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d68cddb-2a0a-4cb3-be2d-30c5a3e51b91 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:20.391545 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d68cddb-2a0a-4cb3-be2d-30c5a3e51b91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:20.426115 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-0d68cddb-2a0a-4cb3-be2d-30c5a3e51b91 None None] MFA Rules not processed for user `604c0a74efce41b9b882fdaf2da4806e`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:42:20.427533 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-0d68cddb-2a0a-4cb3-be2d-30c5a3e51b91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:42:20.523556 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1060/2123] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:42:20 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:42:20.535050 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c66964-467f-4ad6-877e-18c73982578e admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:20.536946 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-76c66964-467f-4ad6-877e-18c73982578e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:42:20.593010 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:42:20.636167 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c66964-467f-4ad6-877e-18c73982578e admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:20.640178 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18049fb6-a14e-47d3-a8c4-133c1d7e5267 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '868e7c2dec264512b972c8736d659c34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:20.641161 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18049fb6-a14e-47d3-a8c4-133c1d7e5267 service cinder] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:20.642032 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18049fb6-a14e-47d3-a8c4-133c1d7e5267 service cinder] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:20.642569 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18049fb6-a14e-47d3-a8c4-133c1d7e5267 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:20.662303 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18049fb6-a14e-47d3-a8c4-133c1d7e5267 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:20.664416 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18049fb6-a14e-47d3-a8c4-133c1d7e5267 service cinder] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:20.685835 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1064/2124] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:42:20 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:42:22.528732 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d68cddb-2a0a-4cb3-be2d-30c5a3e51b91 None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:22.530652 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-0d68cddb-2a0a-4cb3-be2d-30c5a3e51b91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:42:22.728363 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d68cddb-2a0a-4cb3-be2d-30c5a3e51b91 None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:22.736347 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da95508-6573-41f7-ad93-a53812ae8bbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:22.740172 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da95508-6573-41f7-ad93-a53812ae8bbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:22.743572 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da95508-6573-41f7-ad93-a53812ae8bbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:22.744058 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da95508-6573-41f7-ad93-a53812ae8bbf admin admin] PATH_INFO: `/v3/users/de0abe64bdfb4dbd85fb3911aa20810a` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:22.746781 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da95508-6573-41f7-ad93-a53812ae8bbf admin admin] RBAC: Authorizing `identity:delete_user(user_id=de0abe64bdfb4dbd85fb3911aa20810a)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:22.752067 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da95508-6573-41f7-ad93-a53812ae8bbf admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:22.839064 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:42:22.893338 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-8da95508-6573-41f7-ad93-a53812ae8bbf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de0abe64bdfb4dbd85fb3911aa20810a'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:22.910611 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-8da95508-6573-41f7-ad93-a53812ae8bbf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de0abe64bdfb4dbd85fb3911aa20810a'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:22.938049 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-8da95508-6573-41f7-ad93-a53812ae8bbf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de0abe64bdfb4dbd85fb3911aa20810a'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:22.939637 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-8da95508-6573-41f7-ad93-a53812ae8bbf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de0abe64bdfb4dbd85fb3911aa20810a'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:22.947253 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-8da95508-6573-41f7-ad93-a53812ae8bbf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de0abe64bdfb4dbd85fb3911aa20810a'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:22.994408 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1061/2125] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jul 11 14:42:22 2022] DELETE /identity/v3/users/de0abe64bdfb4dbd85fb3911aa20810a => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:42:22.999669 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db21ead-ddd3-4b77-ba91-1bd760a27d88 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:23.000175 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db21ead-ddd3-4b77-ba91-1bd760a27d88 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:23.000380 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db21ead-ddd3-4b77-ba91-1bd760a27d88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:23.047712 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-7db21ead-ddd3-4b77-ba91-1bd760a27d88 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:42:23.049298 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-7db21ead-ddd3-4b77-ba91-1bd760a27d88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:42:23.160287 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1065/2126] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:42:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:42:23.175399 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da95508-6573-41f7-ad93-a53812ae8bbf admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:23.175399 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-8da95508-6573-41f7-ad93-a53812ae8bbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:42:23.289592 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db21ead-ddd3-4b77-ba91-1bd760a27d88 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:23.294424 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-7db21ead-ddd3-4b77-ba91-1bd760a27d88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:42:23.311669 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db21ead-ddd3-4b77-ba91-1bd760a27d88 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:23.312306 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da95508-6573-41f7-ad93-a53812ae8bbf admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:23.318647 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c988041-01c9-48a5-8b4d-b1a9aa6eccac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:23.320001 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c988041-01c9-48a5-8b4d-b1a9aa6eccac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:23.320701 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c988041-01c9-48a5-8b4d-b1a9aa6eccac admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:23.321313 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c988041-01c9-48a5-8b4d-b1a9aa6eccac admin admin] PATH_INFO: `/v3/users/61a806b41a1442188b56d371cbf713d1` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:23.323477 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c988041-01c9-48a5-8b4d-b1a9aa6eccac admin admin] RBAC: Authorizing `identity:delete_user(user_id=61a806b41a1442188b56d371cbf713d1)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:23.326846 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c988041-01c9-48a5-8b4d-b1a9aa6eccac admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:23.330001 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42ff068-c67e-4dc2-8c22-4f4f5ab66958 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20eede5ccd834862b00123310b5c3975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:23.330841 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42ff068-c67e-4dc2-8c22-4f4f5ab66958 service neutron] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:23.330999 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42ff068-c67e-4dc2-8c22-4f4f5ab66958 service neutron] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:23.331366 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42ff068-c67e-4dc2-8c22-4f4f5ab66958 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:23.354741 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42ff068-c67e-4dc2-8c22-4f4f5ab66958 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:23.356859 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42ff068-c67e-4dc2-8c22-4f4f5ab66958 service neutron] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:23.374384 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1062/2127] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:42:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:42:23.415198 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-3c988041-01c9-48a5-8b4d-b1a9aa6eccac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61a806b41a1442188b56d371cbf713d1'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:23.422866 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-3c988041-01c9-48a5-8b4d-b1a9aa6eccac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61a806b41a1442188b56d371cbf713d1'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:23.432794 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-3c988041-01c9-48a5-8b4d-b1a9aa6eccac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61a806b41a1442188b56d371cbf713d1'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:23.434165 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-3c988041-01c9-48a5-8b4d-b1a9aa6eccac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61a806b41a1442188b56d371cbf713d1'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:23.434829 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-3c988041-01c9-48a5-8b4d-b1a9aa6eccac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61a806b41a1442188b56d371cbf713d1'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:23.472691 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1066/2128] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jul 11 14:42:23 2022] DELETE /identity/v3/users/61a806b41a1442188b56d371cbf713d1 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:42:23.762005 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42ff068-c67e-4dc2-8c22-4f4f5ab66958 service neutron] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:23.779930 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42ff068-c67e-4dc2-8c22-4f4f5ab66958 service neutron] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:23.824880 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c988041-01c9-48a5-8b4d-b1a9aa6eccac admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:23.826463 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-3c988041-01c9-48a5-8b4d-b1a9aa6eccac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:42:23.869754 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7095a831-9305-47f9-9ff2-168c363f7885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:23.870633 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7095a831-9305-47f9-9ff2-168c363f7885 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:23.871287 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7095a831-9305-47f9-9ff2-168c363f7885 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:23.871982 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7095a831-9305-47f9-9ff2-168c363f7885 admin admin] PATH_INFO: `/v3/projects/26bf43591445472585b2e35428f6d07e` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:23.873369 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7095a831-9305-47f9-9ff2-168c363f7885 admin admin] RBAC: Authorizing `identity:delete_project(project_id=26bf43591445472585b2e35428f6d07e)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:23.875456 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7095a831-9305-47f9-9ff2-168c363f7885 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:23.889114 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:42:23.915385 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c988041-01c9-48a5-8b4d-b1a9aa6eccac admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:23.926327 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:42:23.940045 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-7095a831-9305-47f9-9ff2-168c363f7885 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26bf43591445472585b2e35428f6d07e', 'request_id': 'req-7095a831-9305-47f9-9ff2-168c363f7885'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:23.950860 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-7095a831-9305-47f9-9ff2-168c363f7885 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26bf43591445472585b2e35428f6d07e', 'request_id': 'req-7095a831-9305-47f9-9ff2-168c363f7885'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:23.959745 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-7095a831-9305-47f9-9ff2-168c363f7885 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26bf43591445472585b2e35428f6d07e', 'request_id': 'req-7095a831-9305-47f9-9ff2-168c363f7885'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:23.973910 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-7095a831-9305-47f9-9ff2-168c363f7885 admin admin] The token cache is being invalidate because project 26bf43591445472585b2e35428f6d07e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80534) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:42:23.974231 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-7095a831-9305-47f9-9ff2-168c363f7885 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:23.974929 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-7095a831-9305-47f9-9ff2-168c363f7885 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:23.976737 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1063/2129] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jul 11 14:42:23 2022] DELETE /identity/v3/projects/26bf43591445472585b2e35428f6d07e => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:42:23.982413 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed616e2-20f2-48a6-981c-97dd46aefe9f None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:23.982413 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed616e2-20f2-48a6-981c-97dd46aefe9f None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:23.982413 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed616e2-20f2-48a6-981c-97dd46aefe9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:24.004092 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-4ed616e2-20f2-48a6-981c-97dd46aefe9f None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:42:24.004351 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3b9c4a-fdb6-4401-a2c0-1cc1206d7c1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:24.005153 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3b9c4a-fdb6-4401-a2c0-1cc1206d7c1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:24.005363 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-4ed616e2-20f2-48a6-981c-97dd46aefe9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:42:24.005484 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3b9c4a-fdb6-4401-a2c0-1cc1206d7c1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:24.005694 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3b9c4a-fdb6-4401-a2c0-1cc1206d7c1a admin admin] PATH_INFO: `/v3/projects/8d10aa70a73447f8afd8b3274aca4e26` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:24.009313 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3b9c4a-fdb6-4401-a2c0-1cc1206d7c1a admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d10aa70a73447f8afd8b3274aca4e26)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:24.011283 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3b9c4a-fdb6-4401-a2c0-1cc1206d7c1a admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:24.022183 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1064/2130] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:42:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:42:24.031132 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7301dadc-a245-459f-a3ed-2ec50f56b431 None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:24.031420 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7301dadc-a245-459f-a3ed-2ec50f56b431 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:24.031793 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7301dadc-a245-459f-a3ed-2ec50f56b431 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:24.051468 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-7301dadc-a245-459f-a3ed-2ec50f56b431 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:42:24.052848 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-7301dadc-a245-459f-a3ed-2ec50f56b431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:42:24.072137 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-5a3b9c4a-fdb6-4401-a2c0-1cc1206d7c1a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d10aa70a73447f8afd8b3274aca4e26', 'request_id': 'req-5a3b9c4a-fdb6-4401-a2c0-1cc1206d7c1a'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:24.082478 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-5a3b9c4a-fdb6-4401-a2c0-1cc1206d7c1a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d10aa70a73447f8afd8b3274aca4e26', 'request_id': 'req-5a3b9c4a-fdb6-4401-a2c0-1cc1206d7c1a'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:24.089640 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-5a3b9c4a-fdb6-4401-a2c0-1cc1206d7c1a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d10aa70a73447f8afd8b3274aca4e26', 'request_id': 'req-5a3b9c4a-fdb6-4401-a2c0-1cc1206d7c1a'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:24.106085 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-5a3b9c4a-fdb6-4401-a2c0-1cc1206d7c1a admin admin] The token cache is being invalidate because project 8d10aa70a73447f8afd8b3274aca4e26 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:42:24.106376 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-5a3b9c4a-fdb6-4401-a2c0-1cc1206d7c1a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:24.107182 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-5a3b9c4a-fdb6-4401-a2c0-1cc1206d7c1a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:24.110470 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1067/2131] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jul 11 14:42:23 2022] DELETE /identity/v3/projects/8d10aa70a73447f8afd8b3274aca4e26 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:42:24.114724 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9a2889-c72a-4c02-a481-f9aeee68e71b None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:24.115019 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9a2889-c72a-4c02-a481-f9aeee68e71b None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:24.115301 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9a2889-c72a-4c02-a481-f9aeee68e71b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:24.131226 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1065/2132] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:42:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:42:24.135478 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7301dadc-a245-459f-a3ed-2ec50f56b431 None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:24.137025 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-bc9a2889-c72a-4c02-a481-f9aeee68e71b None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:42:24.138316 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-bc9a2889-c72a-4c02-a481-f9aeee68e71b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:42:24.145702 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7301dadc-a245-459f-a3ed-2ec50f56b431 None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:24.147573 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1068/2133] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:42:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:42:24.153255 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c43ddb6-2d9f-4643-b145-04364e32f9ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:24.154223 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c43ddb6-2d9f-4643-b145-04364e32f9ad admin admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:24.154509 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c43ddb6-2d9f-4643-b145-04364e32f9ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:24.154791 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c43ddb6-2d9f-4643-b145-04364e32f9ad admin admin] PATH_INFO: `/v3/domains` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:24.155423 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5b002f-d130-422c-ba78-305bcdf77077 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:24.155542 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c43ddb6-2d9f-4643-b145-04364e32f9ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:42:24.155723 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5b002f-d130-422c-ba78-305bcdf77077 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:24.155843 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c43ddb6-2d9f-4643-b145-04364e32f9ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:24.156036 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5b002f-d130-422c-ba78-305bcdf77077 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:24.157512 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c43ddb6-2d9f-4643-b145-04364e32f9ad admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:24.171148 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1066/2134] 10.222.0.70 () {58 vars in 1152 bytes} [Mon Jul 11 14:42:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:42:24.175360 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c43ddb6-2d9f-4643-b145-04364e32f9ad admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:24.176925 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-4b5b002f-d130-422c-ba78-305bcdf77077 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:42:24.178258 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-4b5b002f-d130-422c-ba78-305bcdf77077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:42:24.186229 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c43ddb6-2d9f-4643-b145-04364e32f9ad admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:24.188038 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1069/2135] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:42:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:42:24.192808 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5b002f-d130-422c-ba78-305bcdf77077 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:24.193637 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e8928f-ab7d-401f-b62f-c50bcca57e1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:24.194303 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e8928f-ab7d-401f-b62f-c50bcca57e1c admin admin] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:24.194722 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e8928f-ab7d-401f-b62f-c50bcca57e1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:24.195118 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e8928f-ab7d-401f-b62f-c50bcca57e1c admin admin] PATH_INFO: `/v3/projects` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:24.195821 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e8928f-ab7d-401f-b62f-c50bcca57e1c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:24.197779 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e8928f-ab7d-401f-b62f-c50bcca57e1c admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:24.204047 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5b002f-d130-422c-ba78-305bcdf77077 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:24.209616 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c492c33-4662-4a48-9745-e781fe343fa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:24.211281 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c492c33-4662-4a48-9745-e781fe343fa1 admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:24.211658 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c492c33-4662-4a48-9745-e781fe343fa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:24.212047 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c492c33-4662-4a48-9745-e781fe343fa1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:24.212783 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c492c33-4662-4a48-9745-e781fe343fa1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:42:24.213131 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c492c33-4662-4a48-9745-e781fe343fa1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:24.214887 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c492c33-4662-4a48-9745-e781fe343fa1 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:24.231006 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1070/2136] 10.222.0.70 () {58 vars in 1152 bytes} [Mon Jul 11 14:42:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:42:24.234886 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c492c33-4662-4a48-9745-e781fe343fa1 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:24.239482 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1067/2137] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jul 11 14:42:24 2022] POST /identity/v3/projects => generated 357 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:42:24.244682 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e8928f-ab7d-401f-b62f-c50bcca57e1c admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:24.251424 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c492c33-4662-4a48-9745-e781fe343fa1 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:24.303605 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:42:24.315789 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67012fc-2691-4749-8bce-221c6daca0a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:24.317112 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67012fc-2691-4749-8bce-221c6daca0a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:24.317791 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67012fc-2691-4749-8bce-221c6daca0a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:24.318312 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67012fc-2691-4749-8bce-221c6daca0a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:24.319697 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67012fc-2691-4749-8bce-221c6daca0a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:24.322154 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e8928f-ab7d-401f-b62f-c50bcca57e1c admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:24.322293 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67012fc-2691-4749-8bce-221c6daca0a4 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:24.328987 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afd2973-44d3-4b37-aae2-e17547b283a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:24.329735 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afd2973-44d3-4b37-aae2-e17547b283a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:24.330087 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afd2973-44d3-4b37-aae2-e17547b283a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:24.330463 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afd2973-44d3-4b37-aae2-e17547b283a6 admin admin] PATH_INFO: `/v3/users` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:24.331271 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afd2973-44d3-4b37-aae2-e17547b283a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:24.333922 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afd2973-44d3-4b37-aae2-e17547b283a6 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:24.361204 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1068/2138] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jul 11 14:42:24 2022] POST /identity/v3/users => generated 279 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:42:24.364879 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afd2973-44d3-4b37-aae2-e17547b283a6 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:24.366037 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1071/2139] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jul 11 14:42:24 2022] POST /identity/v3/projects => generated 373 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:42:24.371096 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67012fc-2691-4749-8bce-221c6daca0a4 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:24.376140 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afd2973-44d3-4b37-aae2-e17547b283a6 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:24.392963 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:42:24.456555 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67012fc-2691-4749-8bce-221c6daca0a4 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:24.461274 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca219c8-8634-4992-8ac9-205990ecb9d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:24.461938 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca219c8-8634-4992-8ac9-205990ecb9d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:24.462224 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca219c8-8634-4992-8ac9-205990ecb9d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:24.462542 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca219c8-8634-4992-8ac9-205990ecb9d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:24.463465 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca219c8-8634-4992-8ac9-205990ecb9d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:24.464545 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b259961-c834-44f2-bf3e-f69c1c772285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:24.465506 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b259961-c834-44f2-bf3e-f69c1c772285 admin admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:24.465623 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca219c8-8634-4992-8ac9-205990ecb9d4 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:24.465832 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b259961-c834-44f2-bf3e-f69c1c772285 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:24.466120 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b259961-c834-44f2-bf3e-f69c1c772285 admin admin] PATH_INFO: `/v3/users` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:24.466923 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b259961-c834-44f2-bf3e-f69c1c772285 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:24.469233 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b259961-c834-44f2-bf3e-f69c1c772285 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:24.479598 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1069/2140] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:42:24 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 14:42:24.484101 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca219c8-8634-4992-8ac9-205990ecb9d4 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:24.495974 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca219c8-8634-4992-8ac9-205990ecb9d4 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:24.500356 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1072/2141] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jul 11 14:42:24 2022] POST /identity/v3/users => generated 287 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:42:24.503920 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d552f9-4236-417a-951f-e2938c4eac82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:24.504747 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d552f9-4236-417a-951f-e2938c4eac82 admin admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:24.504923 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d552f9-4236-417a-951f-e2938c4eac82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:24.505206 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d552f9-4236-417a-951f-e2938c4eac82 admin admin] PATH_INFO: `/v3/roles` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:24.506077 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d552f9-4236-417a-951f-e2938c4eac82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:24.508098 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d552f9-4236-417a-951f-e2938c4eac82 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:24.510516 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b259961-c834-44f2-bf3e-f69c1c772285 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:24.517950 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-9b259961-c834-44f2-bf3e-f69c1c772285 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:42:24.521338 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1070/2142] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:42:24 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 14:42:24.525507 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d552f9-4236-417a-951f-e2938c4eac82 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:24.536262 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b259961-c834-44f2-bf3e-f69c1c772285 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:24.540437 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d552f9-4236-417a-951f-e2938c4eac82 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:24.543045 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ffbc6a-6bc6-4626-bffc-eff7268fbdb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:24.543935 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ffbc6a-6bc6-4626-bffc-eff7268fbdb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:24.544240 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ffbc6a-6bc6-4626-bffc-eff7268fbdb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:24.544527 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ffbc6a-6bc6-4626-bffc-eff7268fbdb3 admin admin] PATH_INFO: `/v3/users/604c0a74efce41b9b882fdaf2da4806e` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:24.545909 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ffbc6a-6bc6-4626-bffc-eff7268fbdb3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=604c0a74efce41b9b882fdaf2da4806e)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:24.546045 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72295b59-8f03-420b-be37-2097d1951ae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:24.547020 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72295b59-8f03-420b-be37-2097d1951ae3 admin admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:24.547413 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72295b59-8f03-420b-be37-2097d1951ae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:24.547761 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72295b59-8f03-420b-be37-2097d1951ae3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:24.547867 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ffbc6a-6bc6-4626-bffc-eff7268fbdb3 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:24.548667 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72295b59-8f03-420b-be37-2097d1951ae3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:24.550542 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72295b59-8f03-420b-be37-2097d1951ae3 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:24.566373 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1071/2143] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:42:24 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:42:24.567542 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72295b59-8f03-420b-be37-2097d1951ae3 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:24.578732 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72295b59-8f03-420b-be37-2097d1951ae3 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:24.586785 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c69d5f-1929-480c-9884-2b541a4d6ffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:24.587872 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c69d5f-1929-480c-9884-2b541a4d6ffc admin admin] REQUEST_METHOD: `PUT` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:24.588338 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c69d5f-1929-480c-9884-2b541a4d6ffc admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:24.588554 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c69d5f-1929-480c-9884-2b541a4d6ffc admin admin] PATH_INFO: `/v3/projects/0cc5ffa3d8114c3b92c470e325aa6ca7/users/f04f1d7fd00e4e34b1106cfaa9c9d149/roles/8eff41f243c843ed95505a488ca6eada` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:24.605848 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c69d5f-1929-480c-9884-2b541a4d6ffc admin admin] RBAC: Authorizing `identity:create_grant(project_id=0cc5ffa3d8114c3b92c470e325aa6ca7, user_id=f04f1d7fd00e4e34b1106cfaa9c9d149, role_id=8eff41f243c843ed95505a488ca6eada)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:24.608535 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c69d5f-1929-480c-9884-2b541a4d6ffc admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:24.610307 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-89ffbc6a-6bc6-4626-bffc-eff7268fbdb3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '604c0a74efce41b9b882fdaf2da4806e'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:24.618832 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-89ffbc6a-6bc6-4626-bffc-eff7268fbdb3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '604c0a74efce41b9b882fdaf2da4806e'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:24.627254 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1072/2144] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jul 11 14:42:24 2022] PUT /identity/v3/projects/0cc5ffa3d8114c3b92c470e325aa6ca7/users/f04f1d7fd00e4e34b1106cfaa9c9d149/roles/8eff41f243c843ed95505a488ca6eada => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:42:24.637599 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c69d5f-1929-480c-9884-2b541a4d6ffc admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:24.641858 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-89ffbc6a-6bc6-4626-bffc-eff7268fbdb3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '604c0a74efce41b9b882fdaf2da4806e'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:24.643196 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-89ffbc6a-6bc6-4626-bffc-eff7268fbdb3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '604c0a74efce41b9b882fdaf2da4806e'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:24.644422 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-89ffbc6a-6bc6-4626-bffc-eff7268fbdb3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '604c0a74efce41b9b882fdaf2da4806e'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:24.678124 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1073/2145] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jul 11 14:42:24 2022] DELETE /identity/v3/users/604c0a74efce41b9b882fdaf2da4806e => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:42:24.680071 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2189fac0-ef9a-46a8-8f64-9ba844728d94 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:24.680465 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2189fac0-ef9a-46a8-8f64-9ba844728d94 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:24.681035 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2189fac0-ef9a-46a8-8f64-9ba844728d94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:24.717979 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-2189fac0-ef9a-46a8-8f64-9ba844728d94 None None] MFA Rules not processed for user `f04f1d7fd00e4e34b1106cfaa9c9d149`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:42:24.719121 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-2189fac0-ef9a-46a8-8f64-9ba844728d94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:42:24.735723 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c69d5f-1929-480c-9884-2b541a4d6ffc admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:24.756588 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:42:24.805997 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1074/2146] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:42:24 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:42:24.807730 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca9db01-df29-410d-8c1c-26a61bb98623 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:24.808024 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca9db01-df29-410d-8c1c-26a61bb98623 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:24.808144 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0695f5cc-1d13-41ab-8730-3346bb30a903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:24.808617 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca9db01-df29-410d-8c1c-26a61bb98623 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:24.808772 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0695f5cc-1d13-41ab-8730-3346bb30a903 admin admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:24.809056 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0695f5cc-1d13-41ab-8730-3346bb30a903 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:24.809332 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0695f5cc-1d13-41ab-8730-3346bb30a903 admin admin] PATH_INFO: `/v3/roles` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:24.810124 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0695f5cc-1d13-41ab-8730-3346bb30a903 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:24.811901 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0695f5cc-1d13-41ab-8730-3346bb30a903 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:24.827711 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1073/2147] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:42:24 2022] GET /identity/v3/roles => generated 1420 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:42:24.828549 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0695f5cc-1d13-41ab-8730-3346bb30a903 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:24.831818 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-0695f5cc-1d13-41ab-8730-3346bb30a903 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:42:24.834721 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-aca9db01-df29-410d-8c1c-26a61bb98623 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:42:24.836796 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-aca9db01-df29-410d-8c1c-26a61bb98623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:42:24.846665 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1075/2148] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:42:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:42:24.847393 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca9db01-df29-410d-8c1c-26a61bb98623 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:24.851478 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0695f5cc-1d13-41ab-8730-3346bb30a903 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:24.858934 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67d3167-9328-4566-93a9-5f5c5abbed9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:24.859141 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-aca9db01-df29-410d-8c1c-26a61bb98623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:42:24.859685 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67d3167-9328-4566-93a9-5f5c5abbed9a admin admin] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:24.860269 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67d3167-9328-4566-93a9-5f5c5abbed9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:24.860698 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67d3167-9328-4566-93a9-5f5c5abbed9a admin admin] PATH_INFO: `/v3/projects` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:24.862072 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67d3167-9328-4566-93a9-5f5c5abbed9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:24.865872 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67d3167-9328-4566-93a9-5f5c5abbed9a admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:24.873635 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca9db01-df29-410d-8c1c-26a61bb98623 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:24.879270 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccb30d3-fccc-48ed-928f-883addb15460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:24.880422 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccb30d3-fccc-48ed-928f-883addb15460 admin admin] REQUEST_METHOD: `PUT` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:24.880783 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccb30d3-fccc-48ed-928f-883addb15460 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:24.881163 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccb30d3-fccc-48ed-928f-883addb15460 admin admin] PATH_INFO: `/v3/projects/d78001a18ac54116a48532d5fc77d112/users/b2f6acc1beb64332a72035426c36c9c8/roles/8eff41f243c843ed95505a488ca6eada` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:24.885348 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:42:24.904572 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccb30d3-fccc-48ed-928f-883addb15460 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d78001a18ac54116a48532d5fc77d112, user_id=b2f6acc1beb64332a72035426c36c9c8, role_id=8eff41f243c843ed95505a488ca6eada)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:24.908782 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccb30d3-fccc-48ed-928f-883addb15460 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:24.920334 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1074/2149] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jul 11 14:42:24 2022] POST /identity/v3/projects => generated 355 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:42:24.920334 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67d3167-9328-4566-93a9-5f5c5abbed9a admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:24.920334 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-c67d3167-9328-4566-93a9-5f5c5abbed9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:42:24.929907 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1076/2150] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jul 11 14:42:24 2022] PUT /identity/v3/projects/d78001a18ac54116a48532d5fc77d112/users/b2f6acc1beb64332a72035426c36c9c8/roles/8eff41f243c843ed95505a488ca6eada => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:42:24.930597 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccb30d3-fccc-48ed-928f-883addb15460 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:24.993262 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67d3167-9328-4566-93a9-5f5c5abbed9a admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:25.011351 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccb30d3-fccc-48ed-928f-883addb15460 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:25.016490 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d093576e-aa99-4670-a712-ec1c4285e958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:25.017180 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d093576e-aa99-4670-a712-ec1c4285e958 admin admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:25.017468 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d093576e-aa99-4670-a712-ec1c4285e958 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:25.017893 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d093576e-aa99-4670-a712-ec1c4285e958 admin admin] PATH_INFO: `/v3/users` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:25.018601 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d093576e-aa99-4670-a712-ec1c4285e958 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:25.020733 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d093576e-aa99-4670-a712-ec1c4285e958 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:25.043178 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1077/2151] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jul 11 14:42:24 2022] POST /identity/v3/users => generated 284 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:42:25.047478 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9372f092-2539-4cd2-a048-9229d73ed673 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:25.047778 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9372f092-2539-4cd2-a048-9229d73ed673 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:25.047978 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25288ab9-7fd1-4731-9cf1-c1e66ca67cca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20eede5ccd834862b00123310b5c3975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:25.048345 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9372f092-2539-4cd2-a048-9229d73ed673 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:25.048705 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25288ab9-7fd1-4731-9cf1-c1e66ca67cca service neutron] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:25.048987 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25288ab9-7fd1-4731-9cf1-c1e66ca67cca service neutron] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:25.049273 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25288ab9-7fd1-4731-9cf1-c1e66ca67cca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:25.061385 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25288ab9-7fd1-4731-9cf1-c1e66ca67cca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:25.063267 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25288ab9-7fd1-4731-9cf1-c1e66ca67cca service neutron] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:25.075380 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1075/2152] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:42:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:42:25.076118 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25288ab9-7fd1-4731-9cf1-c1e66ca67cca service neutron] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:25.079626 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-9372f092-2539-4cd2-a048-9229d73ed673 None None] MFA Rules not processed for user `b2f6acc1beb64332a72035426c36c9c8`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:42:25.080969 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-9372f092-2539-4cd2-a048-9229d73ed673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:42:25.087464 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25288ab9-7fd1-4731-9cf1-c1e66ca67cca service neutron] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:25.092959 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aebd634-e03b-4925-8ec5-8db04cda42d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:25.093637 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aebd634-e03b-4925-8ec5-8db04cda42d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:25.093921 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aebd634-e03b-4925-8ec5-8db04cda42d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:25.094191 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aebd634-e03b-4925-8ec5-8db04cda42d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:25.094917 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aebd634-e03b-4925-8ec5-8db04cda42d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:25.096622 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aebd634-e03b-4925-8ec5-8db04cda42d2 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:25.109495 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1076/2153] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:42:25 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:42:25.114701 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aebd634-e03b-4925-8ec5-8db04cda42d2 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:25.131128 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aebd634-e03b-4925-8ec5-8db04cda42d2 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:25.137236 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed10c2f-8cd7-449a-89e1-f71ef95c2dd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:25.138322 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed10c2f-8cd7-449a-89e1-f71ef95c2dd0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:25.138596 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed10c2f-8cd7-449a-89e1-f71ef95c2dd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:25.138872 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed10c2f-8cd7-449a-89e1-f71ef95c2dd0 admin admin] PATH_INFO: `/v3/projects/74ea4db692bd420a953a9759b2fc2030/users/ea71acf979fa4272a09f325de6927421/roles/b46df176b0fe479da63c318db225bed4` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:25.164849 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed10c2f-8cd7-449a-89e1-f71ef95c2dd0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74ea4db692bd420a953a9759b2fc2030, user_id=ea71acf979fa4272a09f325de6927421, role_id=b46df176b0fe479da63c318db225bed4)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:25.169048 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed10c2f-8cd7-449a-89e1-f71ef95c2dd0 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:25.193084 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1077/2154] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jul 11 14:42:25 2022] PUT /identity/v3/projects/74ea4db692bd420a953a9759b2fc2030/users/ea71acf979fa4272a09f325de6927421/roles/b46df176b0fe479da63c318db225bed4 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:42:25.195811 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed10c2f-8cd7-449a-89e1-f71ef95c2dd0 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:25.213823 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1078/2155] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:42:25 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:42:25.218264 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9372f092-2539-4cd2-a048-9229d73ed673 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:25.234320 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9372f092-2539-4cd2-a048-9229d73ed673 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:25.268777 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:42:25.281746 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed10c2f-8cd7-449a-89e1-f71ef95c2dd0 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:25.290936 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03843db8-477c-4740-8f7a-07eda1706f78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:25.291815 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03843db8-477c-4740-8f7a-07eda1706f78 admin admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:25.291951 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03843db8-477c-4740-8f7a-07eda1706f78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:25.292357 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03843db8-477c-4740-8f7a-07eda1706f78 admin admin] PATH_INFO: `/v3/roles` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:25.293109 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03843db8-477c-4740-8f7a-07eda1706f78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:25.294748 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03843db8-477c-4740-8f7a-07eda1706f78 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:25.306795 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1078/2156] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:42:25 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:42:25.310755 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03843db8-477c-4740-8f7a-07eda1706f78 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:25.321827 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03843db8-477c-4740-8f7a-07eda1706f78 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:25.327416 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800676e4-c94b-435e-80a5-6eab07416db6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:25.328357 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800676e4-c94b-435e-80a5-6eab07416db6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:25.328643 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800676e4-c94b-435e-80a5-6eab07416db6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:25.328927 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800676e4-c94b-435e-80a5-6eab07416db6 admin admin] PATH_INFO: `/v3/projects/74ea4db692bd420a953a9759b2fc2030/users/ea71acf979fa4272a09f325de6927421/roles/b46df176b0fe479da63c318db225bed4` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:25.330073 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e237ab23-3af6-4551-a910-2f35a08d55a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:25.330980 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e237ab23-3af6-4551-a910-2f35a08d55a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:25.331110 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800676e4-c94b-435e-80a5-6eab07416db6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74ea4db692bd420a953a9759b2fc2030, user_id=ea71acf979fa4272a09f325de6927421, role_id=b46df176b0fe479da63c318db225bed4)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:25.331792 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e237ab23-3af6-4551-a910-2f35a08d55a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:25.332314 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e237ab23-3af6-4551-a910-2f35a08d55a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:25.333288 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e237ab23-3af6-4551-a910-2f35a08d55a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:25.333947 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800676e4-c94b-435e-80a5-6eab07416db6 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:25.336729 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e237ab23-3af6-4551-a910-2f35a08d55a1 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:25.338590 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:42:25.365018 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1079/2157] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jul 11 14:42:25 2022] PUT /identity/v3/projects/74ea4db692bd420a953a9759b2fc2030/users/ea71acf979fa4272a09f325de6927421/roles/b46df176b0fe479da63c318db225bed4 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:42:25.366939 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fef3807-4301-4d0b-82e6-baf1c4a02001 None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:25.367295 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fef3807-4301-4d0b-82e6-baf1c4a02001 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:25.367609 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fef3807-4301-4d0b-82e6-baf1c4a02001 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:25.380825 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1079/2158] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jul 11 14:42:25 2022] POST /identity/v3/projects => generated 373 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:42:25.386372 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e237ab23-3af6-4551-a910-2f35a08d55a1 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:25.403217 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-3fef3807-4301-4d0b-82e6-baf1c4a02001 None None] MFA Rules not processed for user `ea71acf979fa4272a09f325de6927421`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:42:25.405132 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-3fef3807-4301-4d0b-82e6-baf1c4a02001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:42:25.477501 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e237ab23-3af6-4551-a910-2f35a08d55a1 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:25.482644 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70125f15-af79-4055-b00b-33a694604ddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:25.483319 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70125f15-af79-4055-b00b-33a694604ddd admin admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:25.483609 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70125f15-af79-4055-b00b-33a694604ddd admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:25.483889 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70125f15-af79-4055-b00b-33a694604ddd admin admin] PATH_INFO: `/v3/users` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:25.484687 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70125f15-af79-4055-b00b-33a694604ddd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:25.486589 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70125f15-af79-4055-b00b-33a694604ddd admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:25.491645 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1080/2159] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:42:25 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:42:25.492761 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fef3807-4301-4d0b-82e6-baf1c4a02001 None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:25.493840 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-3fef3807-4301-4d0b-82e6-baf1c4a02001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:42:25.510240 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1080/2160] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jul 11 14:42:25 2022] POST /identity/v3/users => generated 293 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:42:25.511082 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70125f15-af79-4055-b00b-33a694604ddd admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:25.512965 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-70125f15-af79-4055-b00b-33a694604ddd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:42:25.514412 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fef3807-4301-4d0b-82e6-baf1c4a02001 None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:25.519737 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c656525-7b5e-4055-bd97-86751b0324a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:25.520668 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c656525-7b5e-4055-bd97-86751b0324a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:25.520949 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c656525-7b5e-4055-bd97-86751b0324a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:25.521220 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c656525-7b5e-4055-bd97-86751b0324a5 admin admin] PATH_INFO: `/v3/projects/cecf3a9600b64d07a8a49dc2dae961b7` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:25.523047 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c656525-7b5e-4055-bd97-86751b0324a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cecf3a9600b64d07a8a49dc2dae961b7)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:25.525077 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c656525-7b5e-4055-bd97-86751b0324a5 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:25.590682 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-2c656525-7b5e-4055-bd97-86751b0324a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cecf3a9600b64d07a8a49dc2dae961b7', 'request_id': 'req-2c656525-7b5e-4055-bd97-86751b0324a5'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:25.590965 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70125f15-af79-4055-b00b-33a694604ddd admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:25.598387 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-2c656525-7b5e-4055-bd97-86751b0324a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cecf3a9600b64d07a8a49dc2dae961b7', 'request_id': 'req-2c656525-7b5e-4055-bd97-86751b0324a5'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:25.609096 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-2c656525-7b5e-4055-bd97-86751b0324a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cecf3a9600b64d07a8a49dc2dae961b7', 'request_id': 'req-2c656525-7b5e-4055-bd97-86751b0324a5'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:25.621016 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-2c656525-7b5e-4055-bd97-86751b0324a5 admin admin] The token cache is being invalidate because project cecf3a9600b64d07a8a49dc2dae961b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80534) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:42:25.621330 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-2c656525-7b5e-4055-bd97-86751b0324a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:25.621977 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-2c656525-7b5e-4055-bd97-86751b0324a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:25.639433 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1081/2161] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jul 11 14:42:25 2022] DELETE /identity/v3/projects/cecf3a9600b64d07a8a49dc2dae961b7 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:42:25.639433 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c656525-7b5e-4055-bd97-86751b0324a5 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:25.639433 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-2c656525-7b5e-4055-bd97-86751b0324a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:42:25.667136 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:42:25.672038 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb4a15f-f603-44e0-b6b7-29efbb581368 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '868e7c2dec264512b972c8736d659c34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:25.672748 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb4a15f-f603-44e0-b6b7-29efbb581368 service cinder] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:25.673033 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb4a15f-f603-44e0-b6b7-29efbb581368 service cinder] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:25.673312 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb4a15f-f603-44e0-b6b7-29efbb581368 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:25.675314 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-5eb4a15f-f603-44e0-b6b7-29efbb581368 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:42:25.715325 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c656525-7b5e-4055-bd97-86751b0324a5 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:25.722935 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94c0af3-0f17-4e03-bd9d-513823d38122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:25.723644 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94c0af3-0f17-4e03-bd9d-513823d38122 admin admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:25.723933 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94c0af3-0f17-4e03-bd9d-513823d38122 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:25.724229 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94c0af3-0f17-4e03-bd9d-513823d38122 admin admin] PATH_INFO: `/v3/roles` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:25.725856 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94c0af3-0f17-4e03-bd9d-513823d38122 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:25.728394 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94c0af3-0f17-4e03-bd9d-513823d38122 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:25.735690 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:42:25.754984 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1082/2162] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:42:25 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:42:25.756346 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94c0af3-0f17-4e03-bd9d-513823d38122 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:25.772256 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94c0af3-0f17-4e03-bd9d-513823d38122 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:25.778203 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb4a15f-f603-44e0-b6b7-29efbb581368 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:25.779897 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb4a15f-f603-44e0-b6b7-29efbb581368 service cinder] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:25.790415 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc4254f-7a0d-4633-9cd7-7c67ee2c71e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:25.792042 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc4254f-7a0d-4633-9cd7-7c67ee2c71e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:25.792778 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc4254f-7a0d-4633-9cd7-7c67ee2c71e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:25.793285 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc4254f-7a0d-4633-9cd7-7c67ee2c71e6 admin admin] PATH_INFO: `/v3/projects/17e761c6f7124f4d9888292fe67cd2ae/users/75228532777a42beb1a11d21318440bb/roles/b46df176b0fe479da63c318db225bed4` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:25.805604 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1081/2163] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:42:25 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:42:25.815637 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc4254f-7a0d-4633-9cd7-7c67ee2c71e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17e761c6f7124f4d9888292fe67cd2ae, user_id=75228532777a42beb1a11d21318440bb, role_id=b46df176b0fe479da63c318db225bed4)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:25.818748 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc4254f-7a0d-4633-9cd7-7c67ee2c71e6 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:25.844104 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1083/2164] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jul 11 14:42:25 2022] PUT /identity/v3/projects/17e761c6f7124f4d9888292fe67cd2ae/users/75228532777a42beb1a11d21318440bb/roles/b46df176b0fe479da63c318db225bed4 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:42:25.845334 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb4a15f-f603-44e0-b6b7-29efbb581368 service cinder] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:25.857823 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb4a15f-f603-44e0-b6b7-29efbb581368 service cinder] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:25.890522 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc4254f-7a0d-4633-9cd7-7c67ee2c71e6 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:25.895118 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-7cc4254f-7a0d-4633-9cd7-7c67ee2c71e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:42:25.955183 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad69a55-2371-4d1a-938b-b3f1447a5db5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:25.956017 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad69a55-2371-4d1a-938b-b3f1447a5db5 admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:25.956514 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad69a55-2371-4d1a-938b-b3f1447a5db5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:25.958964 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad69a55-2371-4d1a-938b-b3f1447a5db5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:25.960141 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad69a55-2371-4d1a-938b-b3f1447a5db5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:25.962461 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad69a55-2371-4d1a-938b-b3f1447a5db5 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:25.986686 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1082/2165] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:42:25 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:42:25.992711 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad69a55-2371-4d1a-938b-b3f1447a5db5 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:26.001878 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc4254f-7a0d-4633-9cd7-7c67ee2c71e6 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:26.010764 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef8e53e-94d7-4886-9f6d-7c8797ac764d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '868e7c2dec264512b972c8736d659c34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:26.011458 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef8e53e-94d7-4886-9f6d-7c8797ac764d service cinder] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:26.012463 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef8e53e-94d7-4886-9f6d-7c8797ac764d service cinder] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:26.012463 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef8e53e-94d7-4886-9f6d-7c8797ac764d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:26.014269 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad69a55-2371-4d1a-938b-b3f1447a5db5 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:26.014771 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-eef8e53e-94d7-4886-9f6d-7c8797ac764d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:42:26.022535 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c20b85-ebcb-454a-83b4-48daca2634e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:26.025895 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c20b85-ebcb-454a-83b4-48daca2634e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:26.025895 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c20b85-ebcb-454a-83b4-48daca2634e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:26.025895 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c20b85-ebcb-454a-83b4-48daca2634e5 admin admin] PATH_INFO: `/v3/projects/17e761c6f7124f4d9888292fe67cd2ae/users/75228532777a42beb1a11d21318440bb/roles/b46df176b0fe479da63c318db225bed4` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:26.030171 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c20b85-ebcb-454a-83b4-48daca2634e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17e761c6f7124f4d9888292fe67cd2ae, user_id=75228532777a42beb1a11d21318440bb, role_id=b46df176b0fe479da63c318db225bed4)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:26.033461 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c20b85-ebcb-454a-83b4-48daca2634e5 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:26.046501 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1083/2166] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jul 11 14:42:25 2022] PUT /identity/v3/projects/17e761c6f7124f4d9888292fe67cd2ae/users/75228532777a42beb1a11d21318440bb/roles/b46df176b0fe479da63c318db225bed4 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:42:26.058581 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08860b3-2ae2-40d9-bf45-6d1930dca8c2 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:26.058875 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08860b3-2ae2-40d9-bf45-6d1930dca8c2 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:26.059158 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08860b3-2ae2-40d9-bf45-6d1930dca8c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:26.091300 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-a08860b3-2ae2-40d9-bf45-6d1930dca8c2 None None] MFA Rules not processed for user `75228532777a42beb1a11d21318440bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:42:26.092706 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-a08860b3-2ae2-40d9-bf45-6d1930dca8c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:42:26.103338 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef8e53e-94d7-4886-9f6d-7c8797ac764d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:26.104839 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef8e53e-94d7-4886-9f6d-7c8797ac764d service cinder] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:26.114465 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1084/2167] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:42:25 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:42:26.179514 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1084/2168] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:42:26 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:42:26.191016 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef8e53e-94d7-4886-9f6d-7c8797ac764d service cinder] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:26.192521 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-eef8e53e-94d7-4886-9f6d-7c8797ac764d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:42:26.204969 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef8e53e-94d7-4886-9f6d-7c8797ac764d service cinder] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:26.281932 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6399c0cc-73b5-40a4-b5dd-d0380f9051d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '868e7c2dec264512b972c8736d659c34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:26.283427 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6399c0cc-73b5-40a4-b5dd-d0380f9051d0 service cinder] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:26.284197 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6399c0cc-73b5-40a4-b5dd-d0380f9051d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:26.284917 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6399c0cc-73b5-40a4-b5dd-d0380f9051d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:26.287432 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-6399c0cc-73b5-40a4-b5dd-d0380f9051d0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:42:26.337231 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:42:26.353143 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6399c0cc-73b5-40a4-b5dd-d0380f9051d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:26.354664 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6399c0cc-73b5-40a4-b5dd-d0380f9051d0 service cinder] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:26.363914 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1085/2169] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:42:26 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:42:28.442473 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08860b3-2ae2-40d9-bf45-6d1930dca8c2 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:28.444125 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-a08860b3-2ae2-40d9-bf45-6d1930dca8c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:42:28.455039 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:42:28.522746 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08860b3-2ae2-40d9-bf45-6d1930dca8c2 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:28.527638 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f129c42-ea59-4ff5-ae6a-d2543704a6a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:28.528544 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f129c42-ea59-4ff5-ae6a-d2543704a6a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:28.528831 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f129c42-ea59-4ff5-ae6a-d2543704a6a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:28.529109 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f129c42-ea59-4ff5-ae6a-d2543704a6a2 admin admin] PATH_INFO: `/v3/users/b36c948788954e008d66e9d4ab282956` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:28.530309 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f129c42-ea59-4ff5-ae6a-d2543704a6a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b36c948788954e008d66e9d4ab282956)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:28.532251 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f129c42-ea59-4ff5-ae6a-d2543704a6a2 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:28.593123 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-4f129c42-ea59-4ff5-ae6a-d2543704a6a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b36c948788954e008d66e9d4ab282956'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:28.602288 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-4f129c42-ea59-4ff5-ae6a-d2543704a6a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b36c948788954e008d66e9d4ab282956'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:28.610484 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-4f129c42-ea59-4ff5-ae6a-d2543704a6a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b36c948788954e008d66e9d4ab282956'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:28.611124 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-4f129c42-ea59-4ff5-ae6a-d2543704a6a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b36c948788954e008d66e9d4ab282956'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:28.611733 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-4f129c42-ea59-4ff5-ae6a-d2543704a6a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b36c948788954e008d66e9d4ab282956'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:28.630992 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1085/2170] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jul 11 14:42:28 2022] DELETE /identity/v3/users/b36c948788954e008d66e9d4ab282956 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:42:28.636726 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1293bc0-1d1c-4e78-957b-cacd4d3797f2 None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:28.637248 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1293bc0-1d1c-4e78-957b-cacd4d3797f2 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:28.637497 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1293bc0-1d1c-4e78-957b-cacd4d3797f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:28.658604 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-a1293bc0-1d1c-4e78-957b-cacd4d3797f2 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:42:28.659846 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-a1293bc0-1d1c-4e78-957b-cacd4d3797f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:42:28.729412 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1086/2171] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:42:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:42:28.739009 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f129c42-ea59-4ff5-ae6a-d2543704a6a2 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:28.740588 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-4f129c42-ea59-4ff5-ae6a-d2543704a6a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:42:28.815216 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f129c42-ea59-4ff5-ae6a-d2543704a6a2 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:28.820055 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32acfd58-3084-462d-af8b-18b139cb7a15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20eede5ccd834862b00123310b5c3975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:28.820790 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32acfd58-3084-462d-af8b-18b139cb7a15 service neutron] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:28.821087 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32acfd58-3084-462d-af8b-18b139cb7a15 service neutron] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:28.821371 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32acfd58-3084-462d-af8b-18b139cb7a15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:28.832441 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32acfd58-3084-462d-af8b-18b139cb7a15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:28.834145 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32acfd58-3084-462d-af8b-18b139cb7a15 service neutron] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:28.848908 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1086/2172] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:42:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:42:28.939825 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1293bc0-1d1c-4e78-957b-cacd4d3797f2 None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:28.941360 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-a1293bc0-1d1c-4e78-957b-cacd4d3797f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:42:28.957093 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1293bc0-1d1c-4e78-957b-cacd4d3797f2 None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:28.963181 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b665508-d3b2-437e-ab7e-ab441b1d2e8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:28.963507 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b665508-d3b2-437e-ab7e-ab441b1d2e8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:28.963850 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b665508-d3b2-437e-ab7e-ab441b1d2e8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:28.964250 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b665508-d3b2-437e-ab7e-ab441b1d2e8c admin admin] PATH_INFO: `/v3/users/b2f6acc1beb64332a72035426c36c9c8` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:28.965389 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b665508-d3b2-437e-ab7e-ab441b1d2e8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2f6acc1beb64332a72035426c36c9c8)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:28.967435 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b665508-d3b2-437e-ab7e-ab441b1d2e8c admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:29.032269 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-9b665508-d3b2-437e-ab7e-ab441b1d2e8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2f6acc1beb64332a72035426c36c9c8'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:29.042666 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-9b665508-d3b2-437e-ab7e-ab441b1d2e8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2f6acc1beb64332a72035426c36c9c8'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:29.051917 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-9b665508-d3b2-437e-ab7e-ab441b1d2e8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2f6acc1beb64332a72035426c36c9c8'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:29.052662 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-9b665508-d3b2-437e-ab7e-ab441b1d2e8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2f6acc1beb64332a72035426c36c9c8'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:29.053277 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-9b665508-d3b2-437e-ab7e-ab441b1d2e8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2f6acc1beb64332a72035426c36c9c8'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:29.072664 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1087/2173] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jul 11 14:42:28 2022] DELETE /identity/v3/users/b2f6acc1beb64332a72035426c36c9c8 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:42:29.077370 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9baa55-b9d2-4258-914e-09527fccbe9e None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:29.077722 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9baa55-b9d2-4258-914e-09527fccbe9e None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:29.078010 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9baa55-b9d2-4258-914e-09527fccbe9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:29.096908 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-9f9baa55-b9d2-4258-914e-09527fccbe9e None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:42:29.098155 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-9f9baa55-b9d2-4258-914e-09527fccbe9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:42:29.126569 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:42:29.153487 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b665508-d3b2-437e-ab7e-ab441b1d2e8c admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:29.155022 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-9b665508-d3b2-437e-ab7e-ab441b1d2e8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:42:29.179628 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1087/2174] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:42:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:42:29.190195 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9baa55-b9d2-4258-914e-09527fccbe9e None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:29.191616 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-9f9baa55-b9d2-4258-914e-09527fccbe9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:42:29.240733 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:42:29.245155 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b665508-d3b2-437e-ab7e-ab441b1d2e8c admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:29.252860 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8caccb1-1c1e-49e4-837c-0805f64c7c76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:29.253869 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8caccb1-1c1e-49e4-837c-0805f64c7c76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:29.254167 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8caccb1-1c1e-49e4-837c-0805f64c7c76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:29.254877 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8caccb1-1c1e-49e4-837c-0805f64c7c76 admin admin] PATH_INFO: `/v3/projects/d3961d5b4e114358befe283ddf926ffe` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:29.256560 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8caccb1-1c1e-49e4-837c-0805f64c7c76 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3961d5b4e114358befe283ddf926ffe)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:29.259296 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8caccb1-1c1e-49e4-837c-0805f64c7c76 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:29.265564 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9baa55-b9d2-4258-914e-09527fccbe9e None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:29.269258 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f971b00-95e0-4127-8d19-f96eb1957368 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20eede5ccd834862b00123310b5c3975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:29.269913 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f971b00-95e0-4127-8d19-f96eb1957368 service neutron] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:29.270195 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f971b00-95e0-4127-8d19-f96eb1957368 service neutron] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:29.270480 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f971b00-95e0-4127-8d19-f96eb1957368 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:29.281478 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f971b00-95e0-4127-8d19-f96eb1957368 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:29.283008 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f971b00-95e0-4127-8d19-f96eb1957368 service neutron] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:29.294820 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1088/2175] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:42:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:42:29.316399 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-a8caccb1-1c1e-49e4-837c-0805f64c7c76 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3961d5b4e114358befe283ddf926ffe', 'request_id': 'req-a8caccb1-1c1e-49e4-837c-0805f64c7c76'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:29.323100 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-a8caccb1-1c1e-49e4-837c-0805f64c7c76 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3961d5b4e114358befe283ddf926ffe', 'request_id': 'req-a8caccb1-1c1e-49e4-837c-0805f64c7c76'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:29.331872 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-a8caccb1-1c1e-49e4-837c-0805f64c7c76 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3961d5b4e114358befe283ddf926ffe', 'request_id': 'req-a8caccb1-1c1e-49e4-837c-0805f64c7c76'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:29.345354 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-a8caccb1-1c1e-49e4-837c-0805f64c7c76 admin admin] The token cache is being invalidate because project d3961d5b4e114358befe283ddf926ffe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80534) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:42:29.345688 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-a8caccb1-1c1e-49e4-837c-0805f64c7c76 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:29.346446 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-a8caccb1-1c1e-49e4-837c-0805f64c7c76 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:29.348128 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1088/2176] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jul 11 14:42:29 2022] DELETE /identity/v3/projects/d3961d5b4e114358befe283ddf926ffe => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:42:29.354086 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8ececd-04ec-4f53-904a-d434633a6f26 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:29.354379 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8ececd-04ec-4f53-904a-d434633a6f26 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:29.354660 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8ececd-04ec-4f53-904a-d434633a6f26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:29.375054 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-2d8ececd-04ec-4f53-904a-d434633a6f26 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:42:29.376310 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-2d8ececd-04ec-4f53-904a-d434633a6f26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:42:29.443989 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1089/2177] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:42:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:42:29.453079 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87dd949-b2c1-4682-b5a2-9d42b3c1ee61 None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:29.459611 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87dd949-b2c1-4682-b5a2-9d42b3c1ee61 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:29.460588 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87dd949-b2c1-4682-b5a2-9d42b3c1ee61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:29.483984 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-a87dd949-b2c1-4682-b5a2-9d42b3c1ee61 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:42:29.485247 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-a87dd949-b2c1-4682-b5a2-9d42b3c1ee61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:42:29.495305 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1089/2178] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:42:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:42:29.499480 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8ececd-04ec-4f53-904a-d434633a6f26 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:29.512303 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8ececd-04ec-4f53-904a-d434633a6f26 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:29.517182 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726c27db-aa4a-46b3-bf69-1346abb6a135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:29.517857 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726c27db-aa4a-46b3-bf69-1346abb6a135 admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:29.518146 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726c27db-aa4a-46b3-bf69-1346abb6a135 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:29.518421 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726c27db-aa4a-46b3-bf69-1346abb6a135 admin admin] PATH_INFO: `/v3/domains` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:29.519167 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726c27db-aa4a-46b3-bf69-1346abb6a135 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:42:29.519691 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726c27db-aa4a-46b3-bf69-1346abb6a135 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:29.521363 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726c27db-aa4a-46b3-bf69-1346abb6a135 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:29.534653 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1090/2179] 10.222.0.70 () {58 vars in 1152 bytes} [Mon Jul 11 14:42:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:42:29.541143 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87dd949-b2c1-4682-b5a2-9d42b3c1ee61 None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:29.549014 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87dd949-b2c1-4682-b5a2-9d42b3c1ee61 None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:29.553652 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8792007d-f475-4c37-a420-c897a62fce92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:29.554322 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8792007d-f475-4c37-a420-c897a62fce92 admin admin] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:29.554614 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8792007d-f475-4c37-a420-c897a62fce92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:29.554876 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8792007d-f475-4c37-a420-c897a62fce92 admin admin] PATH_INFO: `/v3/projects` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:29.555567 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8792007d-f475-4c37-a420-c897a62fce92 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:29.558078 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8792007d-f475-4c37-a420-c897a62fce92 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:29.588644 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1090/2180] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jul 11 14:42:29 2022] POST /identity/v3/projects => generated 383 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:42:29.592556 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726c27db-aa4a-46b3-bf69-1346abb6a135 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:29.603760 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726c27db-aa4a-46b3-bf69-1346abb6a135 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:29.669173 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8792007d-f475-4c37-a420-c897a62fce92 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:29.671145 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8dfaa3-8cfd-43ca-b432-9a7ac4343afb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:29.671958 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8dfaa3-8cfd-43ca-b432-9a7ac4343afb admin admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:29.672329 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8dfaa3-8cfd-43ca-b432-9a7ac4343afb admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:29.672673 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8dfaa3-8cfd-43ca-b432-9a7ac4343afb admin admin] PATH_INFO: `/v3/users` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:29.673510 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8dfaa3-8cfd-43ca-b432-9a7ac4343afb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:29.673923 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-8792007d-f475-4c37-a420-c897a62fce92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:42:29.675700 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8dfaa3-8cfd-43ca-b432-9a7ac4343afb admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:29.682929 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:42:29.690366 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8792007d-f475-4c37-a420-c897a62fce92 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:29.696269 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218bf7b4-4f85-4880-bda5-f7b48fb2d086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:29.697156 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218bf7b4-4f85-4880-bda5-f7b48fb2d086 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:29.697436 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218bf7b4-4f85-4880-bda5-f7b48fb2d086 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:29.697717 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218bf7b4-4f85-4880-bda5-f7b48fb2d086 admin admin] PATH_INFO: `/v3/projects/d78001a18ac54116a48532d5fc77d112` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:29.699158 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218bf7b4-4f85-4880-bda5-f7b48fb2d086 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d78001a18ac54116a48532d5fc77d112)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:29.701805 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1091/2181] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jul 11 14:42:29 2022] POST /identity/v3/users => generated 292 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:42:29.701947 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218bf7b4-4f85-4880-bda5-f7b48fb2d086 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:29.705659 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8dfaa3-8cfd-43ca-b432-9a7ac4343afb admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:29.718572 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8dfaa3-8cfd-43ca-b432-9a7ac4343afb admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:29.723641 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e00483b-cdda-4a2a-be52-032404532a85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:29.724402 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e00483b-cdda-4a2a-be52-032404532a85 admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:29.724693 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e00483b-cdda-4a2a-be52-032404532a85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:29.724977 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e00483b-cdda-4a2a-be52-032404532a85 admin admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:29.726487 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e00483b-cdda-4a2a-be52-032404532a85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:29.728136 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e00483b-cdda-4a2a-be52-032404532a85 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:29.739578 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1092/2182] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:42:29 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 14:42:29.744623 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e00483b-cdda-4a2a-be52-032404532a85 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:29.755067 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e00483b-cdda-4a2a-be52-032404532a85 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:29.759899 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-218bf7b4-4f85-4880-bda5-f7b48fb2d086 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd78001a18ac54116a48532d5fc77d112', 'request_id': 'req-218bf7b4-4f85-4880-bda5-f7b48fb2d086'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:29.768816 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-218bf7b4-4f85-4880-bda5-f7b48fb2d086 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd78001a18ac54116a48532d5fc77d112', 'request_id': 'req-218bf7b4-4f85-4880-bda5-f7b48fb2d086'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:29.781359 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-218bf7b4-4f85-4880-bda5-f7b48fb2d086 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd78001a18ac54116a48532d5fc77d112', 'request_id': 'req-218bf7b4-4f85-4880-bda5-f7b48fb2d086'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:29.794408 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-218bf7b4-4f85-4880-bda5-f7b48fb2d086 admin admin] The token cache is being invalidate because project d78001a18ac54116a48532d5fc77d112 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80534) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:42:29.794690 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-218bf7b4-4f85-4880-bda5-f7b48fb2d086 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:29.795357 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-218bf7b4-4f85-4880-bda5-f7b48fb2d086 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:29.797210 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1091/2183] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jul 11 14:42:29 2022] DELETE /identity/v3/projects/d78001a18ac54116a48532d5fc77d112 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:42:29.800720 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218bf7b4-4f85-4880-bda5-f7b48fb2d086 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:29.802339 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-218bf7b4-4f85-4880-bda5-f7b48fb2d086 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:42:29.827709 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1984fd-1682-4f73-af95-fce885adba09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:29.828484 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1984fd-1682-4f73-af95-fce885adba09 admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:29.828700 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1984fd-1682-4f73-af95-fce885adba09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:29.828978 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1984fd-1682-4f73-af95-fce885adba09 admin admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:29.829712 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1984fd-1682-4f73-af95-fce885adba09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:29.831297 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1984fd-1682-4f73-af95-fce885adba09 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:29.843651 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1093/2184] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:42:29 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:42:29.848055 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1984fd-1682-4f73-af95-fce885adba09 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:29.849785 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-1b1984fd-1682-4f73-af95-fce885adba09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:42:29.850260 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:42:29.864334 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1984fd-1682-4f73-af95-fce885adba09 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:29.869876 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736e4ac5-8e67-49a6-80e4-e34eadd847cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:29.870789 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736e4ac5-8e67-49a6-80e4-e34eadd847cc admin admin] REQUEST_METHOD: `PUT` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:29.871068 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736e4ac5-8e67-49a6-80e4-e34eadd847cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:29.871340 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736e4ac5-8e67-49a6-80e4-e34eadd847cc admin admin] PATH_INFO: `/v3/projects/d51a355c87b74fef8e8f80549f513767/users/6a0194cfc1de449b966332ad2bff1f1e/roles/8eff41f243c843ed95505a488ca6eada` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:29.871497 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218bf7b4-4f85-4880-bda5-f7b48fb2d086 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:29.877824 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5c51b9-0ab5-4870-ae46-12bdd60d5754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:29.878713 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5c51b9-0ab5-4870-ae46-12bdd60d5754 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:29.878996 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5c51b9-0ab5-4870-ae46-12bdd60d5754 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:29.879272 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5c51b9-0ab5-4870-ae46-12bdd60d5754 admin admin] PATH_INFO: `/v3/users/75228532777a42beb1a11d21318440bb` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:29.880524 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5c51b9-0ab5-4870-ae46-12bdd60d5754 admin admin] RBAC: Authorizing `identity:delete_user(user_id=75228532777a42beb1a11d21318440bb)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:29.883309 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5c51b9-0ab5-4870-ae46-12bdd60d5754 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:29.890368 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736e4ac5-8e67-49a6-80e4-e34eadd847cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=d51a355c87b74fef8e8f80549f513767, user_id=6a0194cfc1de449b966332ad2bff1f1e, role_id=8eff41f243c843ed95505a488ca6eada)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:29.893048 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736e4ac5-8e67-49a6-80e4-e34eadd847cc admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:29.909971 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1094/2185] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jul 11 14:42:29 2022] PUT /identity/v3/projects/d51a355c87b74fef8e8f80549f513767/users/6a0194cfc1de449b966332ad2bff1f1e/roles/8eff41f243c843ed95505a488ca6eada => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:42:29.923024 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fef9253-a8ce-496c-92bb-390f40ac4027 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:29.923269 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fef9253-a8ce-496c-92bb-390f40ac4027 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:29.923554 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fef9253-a8ce-496c-92bb-390f40ac4027 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:29.941957 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-4b5c51b9-0ab5-4870-ae46-12bdd60d5754 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75228532777a42beb1a11d21318440bb'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:29.950636 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-4b5c51b9-0ab5-4870-ae46-12bdd60d5754 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75228532777a42beb1a11d21318440bb'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:29.958712 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-4b5c51b9-0ab5-4870-ae46-12bdd60d5754 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75228532777a42beb1a11d21318440bb'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:29.959488 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-4b5c51b9-0ab5-4870-ae46-12bdd60d5754 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75228532777a42beb1a11d21318440bb'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:29.960368 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-4b5c51b9-0ab5-4870-ae46-12bdd60d5754 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75228532777a42beb1a11d21318440bb'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:29.968672 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-8fef9253-a8ce-496c-92bb-390f40ac4027 None None] MFA Rules not processed for user `6a0194cfc1de449b966332ad2bff1f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:42:29.969983 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-8fef9253-a8ce-496c-92bb-390f40ac4027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:42:30.000592 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1092/2186] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jul 11 14:42:29 2022] DELETE /identity/v3/users/75228532777a42beb1a11d21318440bb => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:42:30.064272 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1095/2187] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:42:29 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:42:30.070882 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5c51b9-0ab5-4870-ae46-12bdd60d5754 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:30.072560 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-4b5c51b9-0ab5-4870-ae46-12bdd60d5754 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:42:30.170703 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5c51b9-0ab5-4870-ae46-12bdd60d5754 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:30.177192 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43630d4-506a-4969-a0d5-87761f703be3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:30.177939 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43630d4-506a-4969-a0d5-87761f703be3 admin admin] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:30.178376 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43630d4-506a-4969-a0d5-87761f703be3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:30.179287 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43630d4-506a-4969-a0d5-87761f703be3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:30.180194 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43630d4-506a-4969-a0d5-87761f703be3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:30.182453 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43630d4-506a-4969-a0d5-87761f703be3 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:30.220947 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1093/2188] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jul 11 14:42:30 2022] POST /identity/v3/projects => generated 381 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:42:30.224491 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fef9253-a8ce-496c-92bb-390f40ac4027 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:30.277534 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:42:30.303772 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fef9253-a8ce-496c-92bb-390f40ac4027 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:30.333651 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43630d4-506a-4969-a0d5-87761f703be3 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:30.338914 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-a43630d4-506a-4969-a0d5-87761f703be3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:42:30.392038 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dea5512-45cc-4877-802b-be04a118bd04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:30.393099 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dea5512-45cc-4877-802b-be04a118bd04 admin admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:30.393480 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dea5512-45cc-4877-802b-be04a118bd04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:30.393831 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dea5512-45cc-4877-802b-be04a118bd04 admin admin] PATH_INFO: `/v3/users` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:30.394652 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dea5512-45cc-4877-802b-be04a118bd04 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:30.396728 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dea5512-45cc-4877-802b-be04a118bd04 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:30.407475 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:42:30.420702 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1096/2189] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jul 11 14:42:30 2022] POST /identity/v3/users => generated 291 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:42:30.424650 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dea5512-45cc-4877-802b-be04a118bd04 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:30.432532 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43630d4-506a-4969-a0d5-87761f703be3 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:30.436933 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dea5512-45cc-4877-802b-be04a118bd04 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:30.440471 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd893f31-2d41-4da2-b716-6f231a48cd37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:30.441462 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd893f31-2d41-4da2-b716-6f231a48cd37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:30.441746 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd893f31-2d41-4da2-b716-6f231a48cd37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:30.442021 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd893f31-2d41-4da2-b716-6f231a48cd37 admin admin] PATH_INFO: `/v3/projects/17e761c6f7124f4d9888292fe67cd2ae` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:30.442736 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6ca03d-8005-4929-b22d-6d80ae27c61e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:30.443226 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd893f31-2d41-4da2-b716-6f231a48cd37 admin admin] RBAC: Authorizing `identity:delete_project(project_id=17e761c6f7124f4d9888292fe67cd2ae)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:30.443533 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6ca03d-8005-4929-b22d-6d80ae27c61e admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:30.445860 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd893f31-2d41-4da2-b716-6f231a48cd37 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:30.446210 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6ca03d-8005-4929-b22d-6d80ae27c61e admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:30.446643 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6ca03d-8005-4929-b22d-6d80ae27c61e admin admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:30.447566 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6ca03d-8005-4929-b22d-6d80ae27c61e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:30.450621 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6ca03d-8005-4929-b22d-6d80ae27c61e admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:30.462865 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1097/2190] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:42:30 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 14:42:30.466747 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6ca03d-8005-4929-b22d-6d80ae27c61e admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:30.478508 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6ca03d-8005-4929-b22d-6d80ae27c61e admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:30.483557 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9152ef-7dc7-4bdd-ad42-35f2aed462db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:30.484311 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9152ef-7dc7-4bdd-ad42-35f2aed462db admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:30.486073 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9152ef-7dc7-4bdd-ad42-35f2aed462db admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:30.486073 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9152ef-7dc7-4bdd-ad42-35f2aed462db admin admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:30.486594 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9152ef-7dc7-4bdd-ad42-35f2aed462db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:30.488303 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9152ef-7dc7-4bdd-ad42-35f2aed462db admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:30.512013 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1098/2191] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:42:30 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 14:42:30.512917 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9152ef-7dc7-4bdd-ad42-35f2aed462db admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:30.528680 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-bd893f31-2d41-4da2-b716-6f231a48cd37 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17e761c6f7124f4d9888292fe67cd2ae', 'request_id': 'req-bd893f31-2d41-4da2-b716-6f231a48cd37'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:30.529199 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9152ef-7dc7-4bdd-ad42-35f2aed462db admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:30.535119 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-bd893f31-2d41-4da2-b716-6f231a48cd37 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17e761c6f7124f4d9888292fe67cd2ae', 'request_id': 'req-bd893f31-2d41-4da2-b716-6f231a48cd37'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:30.543108 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-bd893f31-2d41-4da2-b716-6f231a48cd37 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17e761c6f7124f4d9888292fe67cd2ae', 'request_id': 'req-bd893f31-2d41-4da2-b716-6f231a48cd37'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:30.555661 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-bd893f31-2d41-4da2-b716-6f231a48cd37 admin admin] The token cache is being invalidate because project 17e761c6f7124f4d9888292fe67cd2ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80534) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:42:30.555955 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-bd893f31-2d41-4da2-b716-6f231a48cd37 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:30.556759 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-bd893f31-2d41-4da2-b716-6f231a48cd37 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:30.560268 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1094/2192] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jul 11 14:42:30 2022] DELETE /identity/v3/projects/17e761c6f7124f4d9888292fe67cd2ae => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:42:30.564466 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca1ec55-6bcb-4f46-a245-98ded35f1fe1 None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:30.564861 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca1ec55-6bcb-4f46-a245-98ded35f1fe1 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:30.565147 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca1ec55-6bcb-4f46-a245-98ded35f1fe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:30.585677 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-8ca1ec55-6bcb-4f46-a245-98ded35f1fe1 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:42:30.586995 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-8ca1ec55-6bcb-4f46-a245-98ded35f1fe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:42:30.597189 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fe6dd5-f08a-413a-acd0-1d8a7ad5b1e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:30.598479 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fe6dd5-f08a-413a-acd0-1d8a7ad5b1e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:30.598594 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fe6dd5-f08a-413a-acd0-1d8a7ad5b1e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:30.598885 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fe6dd5-f08a-413a-acd0-1d8a7ad5b1e6 admin admin] PATH_INFO: `/v3/projects/1a3c6d14bf004609ad68ac972aeffb38/users/5c64f31983af441ab439089b529ce7c7/roles/8eff41f243c843ed95505a488ca6eada` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:30.615216 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fe6dd5-f08a-413a-acd0-1d8a7ad5b1e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a3c6d14bf004609ad68ac972aeffb38, user_id=5c64f31983af441ab439089b529ce7c7, role_id=8eff41f243c843ed95505a488ca6eada)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:30.618614 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fe6dd5-f08a-413a-acd0-1d8a7ad5b1e6 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:30.644428 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1099/2193] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jul 11 14:42:30 2022] PUT /identity/v3/projects/1a3c6d14bf004609ad68ac972aeffb38/users/5c64f31983af441ab439089b529ce7c7/roles/8eff41f243c843ed95505a488ca6eada => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:42:30.647032 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c82a9d-d45f-432e-ab61-08cf1229d4f1 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:30.647863 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c82a9d-d45f-432e-ab61-08cf1229d4f1 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:30.648005 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c82a9d-d45f-432e-ab61-08cf1229d4f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:30.656254 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1095/2194] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:42:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:42:30.665802 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ed34d9-5cdf-40f2-a9b5-3378b9fb579a None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:30.666122 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ed34d9-5cdf-40f2-a9b5-3378b9fb579a None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:30.666405 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ed34d9-5cdf-40f2-a9b5-3378b9fb579a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:30.676425 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-a3c82a9d-d45f-432e-ab61-08cf1229d4f1 None None] MFA Rules not processed for user `5c64f31983af441ab439089b529ce7c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:42:30.677652 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-a3c82a9d-d45f-432e-ab61-08cf1229d4f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:42:30.687881 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-86ed34d9-5cdf-40f2-a9b5-3378b9fb579a None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:42:30.689383 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-86ed34d9-5cdf-40f2-a9b5-3378b9fb579a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:42:30.710171 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:42:30.771805 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1100/2195] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:42:30 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:42:30.777181 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c82a9d-d45f-432e-ab61-08cf1229d4f1 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:30.777640 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1096/2196] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:42:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:42:30.778855 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-a3c82a9d-d45f-432e-ab61-08cf1229d4f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:42:30.781938 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ed34d9-5cdf-40f2-a9b5-3378b9fb579a None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:30.793170 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ed34d9-5cdf-40f2-a9b5-3378b9fb579a None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:30.798282 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fc5554-e79c-4c8b-a0d5-aacf779dcab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:30.798959 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fc5554-e79c-4c8b-a0d5-aacf779dcab2 admin admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:30.799279 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fc5554-e79c-4c8b-a0d5-aacf779dcab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:30.799516 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fc5554-e79c-4c8b-a0d5-aacf779dcab2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:30.800276 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fc5554-e79c-4c8b-a0d5-aacf779dcab2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:42:30.800588 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fc5554-e79c-4c8b-a0d5-aacf779dcab2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:30.802907 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c82a9d-d45f-432e-ab61-08cf1229d4f1 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:30.803044 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fc5554-e79c-4c8b-a0d5-aacf779dcab2 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:30.808930 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147d5c73-9836-4606-ba86-60649426e613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:30.809613 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147d5c73-9836-4606-ba86-60649426e613 admin admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:30.809900 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147d5c73-9836-4606-ba86-60649426e613 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:30.810178 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147d5c73-9836-4606-ba86-60649426e613 admin admin] PATH_INFO: `/v3/projects` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:30.811388 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147d5c73-9836-4606-ba86-60649426e613 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:30.814434 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147d5c73-9836-4606-ba86-60649426e613 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:30.823876 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1097/2197] 10.222.0.70 () {58 vars in 1152 bytes} [Mon Jul 11 14:42:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:42:30.828109 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fc5554-e79c-4c8b-a0d5-aacf779dcab2 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:30.834664 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:42:30.840856 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fc5554-e79c-4c8b-a0d5-aacf779dcab2 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:30.848486 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420f8601-6453-4e5a-a6c8-53412284f592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:30.849133 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420f8601-6453-4e5a-a6c8-53412284f592 admin admin] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:30.849425 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420f8601-6453-4e5a-a6c8-53412284f592 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:30.849699 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420f8601-6453-4e5a-a6c8-53412284f592 admin admin] PATH_INFO: `/v3/projects` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:30.850956 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420f8601-6453-4e5a-a6c8-53412284f592 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:30.853701 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420f8601-6453-4e5a-a6c8-53412284f592 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:30.856801 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1101/2198] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jul 11 14:42:30 2022] POST /identity/v3/projects => generated 385 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:42:30.860666 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147d5c73-9836-4606-ba86-60649426e613 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:30.896645 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1098/2199] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jul 11 14:42:30 2022] POST /identity/v3/projects => generated 385 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:42:30.898523 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420f8601-6453-4e5a-a6c8-53412284f592 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:30.936035 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147d5c73-9836-4606-ba86-60649426e613 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:30.964640 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420f8601-6453-4e5a-a6c8-53412284f592 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:30.970933 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9441ce-ee46-420d-8583-4d374bb8f9a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:30.972685 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9441ce-ee46-420d-8583-4d374bb8f9a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:30.973012 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9441ce-ee46-420d-8583-4d374bb8f9a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:30.973291 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9441ce-ee46-420d-8583-4d374bb8f9a8 admin admin] PATH_INFO: `/v3/users` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:30.974004 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9441ce-ee46-420d-8583-4d374bb8f9a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:30.976871 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9441ce-ee46-420d-8583-4d374bb8f9a8 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:31.005490 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52d97f9-ed96-49ad-8642-f39a9895fa0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:31.006264 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52d97f9-ed96-49ad-8642-f39a9895fa0f admin admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:31.006582 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52d97f9-ed96-49ad-8642-f39a9895fa0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:31.006899 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52d97f9-ed96-49ad-8642-f39a9895fa0f admin admin] PATH_INFO: `/v3/users` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:31.007623 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52d97f9-ed96-49ad-8642-f39a9895fa0f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:31.008463 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1099/2200] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jul 11 14:42:30 2022] POST /identity/v3/users => generated 293 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:42:31.009639 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52d97f9-ed96-49ad-8642-f39a9895fa0f admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:31.012675 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9441ce-ee46-420d-8583-4d374bb8f9a8 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:31.024417 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9441ce-ee46-420d-8583-4d374bb8f9a8 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:31.029544 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5ce469-b33a-4234-bd99-5a891efdb8e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:31.030230 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5ce469-b33a-4234-bd99-5a891efdb8e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:31.030516 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5ce469-b33a-4234-bd99-5a891efdb8e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:31.030792 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5ce469-b33a-4234-bd99-5a891efdb8e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:31.031537 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5ce469-b33a-4234-bd99-5a891efdb8e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:31.032064 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1102/2201] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jul 11 14:42:30 2022] POST /identity/v3/users => generated 299 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:42:31.033204 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5ce469-b33a-4234-bd99-5a891efdb8e3 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:31.035883 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52d97f9-ed96-49ad-8642-f39a9895fa0f admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:31.044884 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1100/2202] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:42:31 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 14:42:31.047947 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52d97f9-ed96-49ad-8642-f39a9895fa0f admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:31.048833 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5ce469-b33a-4234-bd99-5a891efdb8e3 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:31.052827 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff2e3ee-0fce-4c87-a753-723e04e4e505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:31.054231 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff2e3ee-0fce-4c87-a753-723e04e4e505 admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:31.054630 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff2e3ee-0fce-4c87-a753-723e04e4e505 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:31.055134 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff2e3ee-0fce-4c87-a753-723e04e4e505 admin admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:31.056018 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff2e3ee-0fce-4c87-a753-723e04e4e505 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:31.057676 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff2e3ee-0fce-4c87-a753-723e04e4e505 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:31.060002 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5ce469-b33a-4234-bd99-5a891efdb8e3 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:31.065266 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f942ca9-b4a3-4cff-a82c-25fb4c8d1a43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:31.066037 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f942ca9-b4a3-4cff-a82c-25fb4c8d1a43 admin admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:31.066223 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f942ca9-b4a3-4cff-a82c-25fb4c8d1a43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:31.066501 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f942ca9-b4a3-4cff-a82c-25fb4c8d1a43 admin admin] PATH_INFO: `/v3/roles` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:31.067232 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f942ca9-b4a3-4cff-a82c-25fb4c8d1a43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:31.071605 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1103/2203] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:42:31 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 14:42:31.071770 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f942ca9-b4a3-4cff-a82c-25fb4c8d1a43 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:31.072740 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff2e3ee-0fce-4c87-a753-723e04e4e505 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:31.084985 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1101/2204] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:42:31 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 14:42:31.085182 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff2e3ee-0fce-4c87-a753-723e04e4e505 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:31.086710 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f942ca9-b4a3-4cff-a82c-25fb4c8d1a43 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:31.088574 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb784ead-32f7-4c28-a25a-d693ad7fce53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:31.089474 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb784ead-32f7-4c28-a25a-d693ad7fce53 admin admin] REQUEST_METHOD: `PUT` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:31.089759 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb784ead-32f7-4c28-a25a-d693ad7fce53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:31.090120 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb784ead-32f7-4c28-a25a-d693ad7fce53 admin admin] PATH_INFO: `/v3/projects/5231f1720deb423c99b19bca422a6124/users/3e8a30e9700b493abd6ea7fee7b57afc/roles/b46df176b0fe479da63c318db225bed4` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:31.097920 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f942ca9-b4a3-4cff-a82c-25fb4c8d1a43 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:31.103976 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d30f88-1248-418d-8ef9-50778670109a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:31.104997 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d30f88-1248-418d-8ef9-50778670109a admin admin] REQUEST_METHOD: `PUT` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:31.105316 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d30f88-1248-418d-8ef9-50778670109a admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:31.105602 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d30f88-1248-418d-8ef9-50778670109a admin admin] PATH_INFO: `/v3/projects/61ebdc131aa74be0b9a3ccc9b8cd0306/users/2afc5ae9937b4433ab771e890c2a5c64/roles/8eff41f243c843ed95505a488ca6eada` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:31.109187 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb784ead-32f7-4c28-a25a-d693ad7fce53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5231f1720deb423c99b19bca422a6124, user_id=3e8a30e9700b493abd6ea7fee7b57afc, role_id=b46df176b0fe479da63c318db225bed4)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:31.111973 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb784ead-32f7-4c28-a25a-d693ad7fce53 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:31.124425 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d30f88-1248-418d-8ef9-50778670109a admin admin] RBAC: Authorizing `identity:create_grant(project_id=61ebdc131aa74be0b9a3ccc9b8cd0306, user_id=2afc5ae9937b4433ab771e890c2a5c64, role_id=8eff41f243c843ed95505a488ca6eada)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:31.127770 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d30f88-1248-418d-8ef9-50778670109a admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:31.131791 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1104/2205] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jul 11 14:42:31 2022] PUT /identity/v3/projects/5231f1720deb423c99b19bca422a6124/users/3e8a30e9700b493abd6ea7fee7b57afc/roles/b46df176b0fe479da63c318db225bed4 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:42:31.136975 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb784ead-32f7-4c28-a25a-d693ad7fce53 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:31.145107 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1102/2206] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jul 11 14:42:31 2022] PUT /identity/v3/projects/61ebdc131aa74be0b9a3ccc9b8cd0306/users/2afc5ae9937b4433ab771e890c2a5c64/roles/8eff41f243c843ed95505a488ca6eada => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:42:31.151337 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:42:31.158812 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1399efc-bc34-46a5-a1b9-371eabafa585 None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:31.159130 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1399efc-bc34-46a5-a1b9-371eabafa585 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:31.159416 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1399efc-bc34-46a5-a1b9-371eabafa585 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:31.194025 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-d1399efc-bc34-46a5-a1b9-371eabafa585 None None] MFA Rules not processed for user `2afc5ae9937b4433ab771e890c2a5c64`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:42:31.196096 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-d1399efc-bc34-46a5-a1b9-371eabafa585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:42:31.218109 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb784ead-32f7-4c28-a25a-d693ad7fce53 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:31.274046 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1103/2207] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:42:31 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:42:31.285021 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30bf52f-e2a9-4c7e-b920-82cfd6f6227d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:31.285233 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1399efc-bc34-46a5-a1b9-371eabafa585 None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:31.285699 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30bf52f-e2a9-4c7e-b920-82cfd6f6227d admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:31.286014 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30bf52f-e2a9-4c7e-b920-82cfd6f6227d admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:31.286262 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30bf52f-e2a9-4c7e-b920-82cfd6f6227d admin admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:31.286942 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-d1399efc-bc34-46a5-a1b9-371eabafa585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:42:31.287074 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30bf52f-e2a9-4c7e-b920-82cfd6f6227d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:31.289704 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30bf52f-e2a9-4c7e-b920-82cfd6f6227d admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:31.303057 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1105/2208] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:42:31 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 14:42:31.304814 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30bf52f-e2a9-4c7e-b920-82cfd6f6227d admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:31.308775 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:42:31.315707 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30bf52f-e2a9-4c7e-b920-82cfd6f6227d admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:31.320983 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212202ed-9488-41af-bf62-8901ac507ea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:31.321876 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212202ed-9488-41af-bf62-8901ac507ea3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:31.322166 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212202ed-9488-41af-bf62-8901ac507ea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:31.322437 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212202ed-9488-41af-bf62-8901ac507ea3 admin admin] PATH_INFO: `/v3/projects/5231f1720deb423c99b19bca422a6124/users/3e8a30e9700b493abd6ea7fee7b57afc/roles/b46df176b0fe479da63c318db225bed4` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:31.324459 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212202ed-9488-41af-bf62-8901ac507ea3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5231f1720deb423c99b19bca422a6124, user_id=3e8a30e9700b493abd6ea7fee7b57afc, role_id=b46df176b0fe479da63c318db225bed4)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:31.327095 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212202ed-9488-41af-bf62-8901ac507ea3 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:31.339164 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1106/2209] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jul 11 14:42:31 2022] PUT /identity/v3/projects/5231f1720deb423c99b19bca422a6124/users/3e8a30e9700b493abd6ea7fee7b57afc/roles/b46df176b0fe479da63c318db225bed4 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:42:31.349579 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f03bbe7-6a4b-419f-b221-13321f8609cf None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:31.349873 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f03bbe7-6a4b-419f-b221-13321f8609cf None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:31.350154 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f03bbe7-6a4b-419f-b221-13321f8609cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:31.353519 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1399efc-bc34-46a5-a1b9-371eabafa585 None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:31.378565 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-9f03bbe7-6a4b-419f-b221-13321f8609cf None None] MFA Rules not processed for user `3e8a30e9700b493abd6ea7fee7b57afc`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:42:31.379738 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-9f03bbe7-6a4b-419f-b221-13321f8609cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:42:31.407441 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e93a4fd-9e81-43f0-b8af-ad2aa73d6667 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '868e7c2dec264512b972c8736d659c34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:31.408128 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e93a4fd-9e81-43f0-b8af-ad2aa73d6667 service cinder] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:31.408439 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e93a4fd-9e81-43f0-b8af-ad2aa73d6667 service cinder] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:31.408716 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e93a4fd-9e81-43f0-b8af-ad2aa73d6667 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:31.453747 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1107/2210] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:42:31 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:42:31.465767 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f03bbe7-6a4b-419f-b221-13321f8609cf None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:31.467175 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-9f03bbe7-6a4b-419f-b221-13321f8609cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:42:31.470010 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e93a4fd-9e81-43f0-b8af-ad2aa73d6667 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:31.471519 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e93a4fd-9e81-43f0-b8af-ad2aa73d6667 service cinder] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:31.479581 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f03bbe7-6a4b-419f-b221-13321f8609cf None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:31.482457 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1104/2211] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:42:31 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:42:31.483592 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5b4641-b0bb-4625-8bed-fb6e9e3e829e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '868e7c2dec264512b972c8736d659c34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:31.484261 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5b4641-b0bb-4625-8bed-fb6e9e3e829e service cinder] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:31.484578 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5b4641-b0bb-4625-8bed-fb6e9e3e829e service cinder] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:31.484857 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5b4641-b0bb-4625-8bed-fb6e9e3e829e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:31.486735 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-ce5b4641-b0bb-4625-8bed-fb6e9e3e829e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:42:31.509714 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:42:31.554510 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5b4641-b0bb-4625-8bed-fb6e9e3e829e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:31.555976 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5b4641-b0bb-4625-8bed-fb6e9e3e829e service cinder] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:31.565817 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1108/2212] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:42:31 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:42:33.167930 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e93a4fd-9e81-43f0-b8af-ad2aa73d6667 service cinder] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:33.191733 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e93a4fd-9e81-43f0-b8af-ad2aa73d6667 service cinder] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:33.202216 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996a78b8-ef72-49f5-9b1c-940a71f3e60b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '868e7c2dec264512b972c8736d659c34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:33.203514 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996a78b8-ef72-49f5-9b1c-940a71f3e60b service cinder] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:33.203656 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996a78b8-ef72-49f5-9b1c-940a71f3e60b service cinder] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:33.203843 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996a78b8-ef72-49f5-9b1c-940a71f3e60b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:33.302971 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996a78b8-ef72-49f5-9b1c-940a71f3e60b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:33.305280 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996a78b8-ef72-49f5-9b1c-940a71f3e60b service cinder] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:33.317889 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1105/2213] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:42:33 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:42:33.945979 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5b4641-b0bb-4625-8bed-fb6e9e3e829e service cinder] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:33.954625 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5b4641-b0bb-4625-8bed-fb6e9e3e829e service cinder] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:33.958204 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ec5e76-0861-41a9-8ecb-478a894f5e5d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '868e7c2dec264512b972c8736d659c34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:33.958844 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ec5e76-0861-41a9-8ecb-478a894f5e5d service cinder] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:33.959127 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ec5e76-0861-41a9-8ecb-478a894f5e5d service cinder] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:33.959412 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ec5e76-0861-41a9-8ecb-478a894f5e5d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:33.969640 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ec5e76-0861-41a9-8ecb-478a894f5e5d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:33.971225 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ec5e76-0861-41a9-8ecb-478a894f5e5d service cinder] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:33.981465 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1109/2214] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:42:33 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:42:34.106132 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996a78b8-ef72-49f5-9b1c-940a71f3e60b service cinder] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:34.136337 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:42:34.176819 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996a78b8-ef72-49f5-9b1c-940a71f3e60b service cinder] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:34.183198 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1a14d2-dbd9-4cee-af17-088d972a2a42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:34.184089 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1a14d2-dbd9-4cee-af17-088d972a2a42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:34.184406 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1a14d2-dbd9-4cee-af17-088d972a2a42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:34.184685 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1a14d2-dbd9-4cee-af17-088d972a2a42 admin admin] PATH_INFO: `/v3/users/2afc5ae9937b4433ab771e890c2a5c64` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:34.185928 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1a14d2-dbd9-4cee-af17-088d972a2a42 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2afc5ae9937b4433ab771e890c2a5c64)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:34.187852 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1a14d2-dbd9-4cee-af17-088d972a2a42 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:34.258145 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-9d1a14d2-dbd9-4cee-af17-088d972a2a42 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2afc5ae9937b4433ab771e890c2a5c64'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:34.266807 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-9d1a14d2-dbd9-4cee-af17-088d972a2a42 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2afc5ae9937b4433ab771e890c2a5c64'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:34.275394 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-9d1a14d2-dbd9-4cee-af17-088d972a2a42 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2afc5ae9937b4433ab771e890c2a5c64'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:34.276033 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-9d1a14d2-dbd9-4cee-af17-088d972a2a42 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2afc5ae9937b4433ab771e890c2a5c64'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:34.276658 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-9d1a14d2-dbd9-4cee-af17-088d972a2a42 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2afc5ae9937b4433ab771e890c2a5c64'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:34.296227 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1106/2215] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jul 11 14:42:34 2022] DELETE /identity/v3/users/2afc5ae9937b4433ab771e890c2a5c64 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:42:34.300595 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b1bbcc-ed19-4c2a-9dc6-8612a67a8783 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:34.300885 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b1bbcc-ed19-4c2a-9dc6-8612a67a8783 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:34.301162 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b1bbcc-ed19-4c2a-9dc6-8612a67a8783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:34.324569 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-b7b1bbcc-ed19-4c2a-9dc6-8612a67a8783 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:42:34.325800 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-b7b1bbcc-ed19-4c2a-9dc6-8612a67a8783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:42:34.392233 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1110/2216] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:42:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:42:34.402396 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1a14d2-dbd9-4cee-af17-088d972a2a42 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:34.403990 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-9d1a14d2-dbd9-4cee-af17-088d972a2a42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:42:34.469659 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1a14d2-dbd9-4cee-af17-088d972a2a42 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:34.473354 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2d77fc-6aba-4aa2-b182-c0a3e9b356dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20eede5ccd834862b00123310b5c3975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:34.474007 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2d77fc-6aba-4aa2-b182-c0a3e9b356dd service neutron] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:34.474424 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2d77fc-6aba-4aa2-b182-c0a3e9b356dd service neutron] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:34.474701 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2d77fc-6aba-4aa2-b182-c0a3e9b356dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:34.485303 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2d77fc-6aba-4aa2-b182-c0a3e9b356dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:34.486695 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2d77fc-6aba-4aa2-b182-c0a3e9b356dd service neutron] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:34.500418 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1107/2217] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:42:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:42:34.803458 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b1bbcc-ed19-4c2a-9dc6-8612a67a8783 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:34.808480 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-b7b1bbcc-ed19-4c2a-9dc6-8612a67a8783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:42:34.833963 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b1bbcc-ed19-4c2a-9dc6-8612a67a8783 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:34.840725 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79aebdf4-25a8-4b7b-82ff-8f3a8d73fcf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:34.841744 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aebdf4-25a8-4b7b-82ff-8f3a8d73fcf2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:34.842004 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aebdf4-25a8-4b7b-82ff-8f3a8d73fcf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:34.842197 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aebdf4-25a8-4b7b-82ff-8f3a8d73fcf2 admin admin] PATH_INFO: `/v3/projects/61ebdc131aa74be0b9a3ccc9b8cd0306` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:34.843432 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79aebdf4-25a8-4b7b-82ff-8f3a8d73fcf2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=61ebdc131aa74be0b9a3ccc9b8cd0306)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:34.845435 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79aebdf4-25a8-4b7b-82ff-8f3a8d73fcf2 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:34.899782 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-79aebdf4-25a8-4b7b-82ff-8f3a8d73fcf2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61ebdc131aa74be0b9a3ccc9b8cd0306', 'request_id': 'req-79aebdf4-25a8-4b7b-82ff-8f3a8d73fcf2'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:34.906052 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-79aebdf4-25a8-4b7b-82ff-8f3a8d73fcf2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61ebdc131aa74be0b9a3ccc9b8cd0306', 'request_id': 'req-79aebdf4-25a8-4b7b-82ff-8f3a8d73fcf2'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:34.913361 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-79aebdf4-25a8-4b7b-82ff-8f3a8d73fcf2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61ebdc131aa74be0b9a3ccc9b8cd0306', 'request_id': 'req-79aebdf4-25a8-4b7b-82ff-8f3a8d73fcf2'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:34.930489 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-79aebdf4-25a8-4b7b-82ff-8f3a8d73fcf2 admin admin] The token cache is being invalidate because project 61ebdc131aa74be0b9a3ccc9b8cd0306 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:42:34.930836 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-79aebdf4-25a8-4b7b-82ff-8f3a8d73fcf2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:34.931971 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-79aebdf4-25a8-4b7b-82ff-8f3a8d73fcf2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:34.933785 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1111/2218] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jul 11 14:42:34 2022] DELETE /identity/v3/projects/61ebdc131aa74be0b9a3ccc9b8cd0306 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:42:34.938829 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96442596-2428-432a-9c27-bf168137de1d None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:34.939497 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96442596-2428-432a-9c27-bf168137de1d None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:34.939782 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96442596-2428-432a-9c27-bf168137de1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:34.973212 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-96442596-2428-432a-9c27-bf168137de1d None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:42:34.975545 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-96442596-2428-432a-9c27-bf168137de1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:42:35.037632 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:42:35.068170 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1108/2219] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:42:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:42:35.076833 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c14ff2-6057-4001-b20a-6dfa17fc044f None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:35.077418 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c14ff2-6057-4001-b20a-6dfa17fc044f None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:35.077418 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c14ff2-6057-4001-b20a-6dfa17fc044f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:35.097003 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-e6c14ff2-6057-4001-b20a-6dfa17fc044f None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:42:35.098274 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-e6c14ff2-6057-4001-b20a-6dfa17fc044f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:42:35.107596 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1112/2220] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:42:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:42:35.113940 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96442596-2428-432a-9c27-bf168137de1d None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:35.123392 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96442596-2428-432a-9c27-bf168137de1d None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:35.128306 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6499ac-3d86-4778-946d-bb96d5a66572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:35.128897 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6499ac-3d86-4778-946d-bb96d5a66572 admin admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:35.129180 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6499ac-3d86-4778-946d-bb96d5a66572 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:35.129453 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6499ac-3d86-4778-946d-bb96d5a66572 admin admin] PATH_INFO: `/v3/domains` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:35.130183 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6499ac-3d86-4778-946d-bb96d5a66572 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:42:35.130513 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6499ac-3d86-4778-946d-bb96d5a66572 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:35.132728 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6499ac-3d86-4778-946d-bb96d5a66572 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:35.146395 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1109/2221] 10.222.0.70 () {58 vars in 1152 bytes} [Mon Jul 11 14:42:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:42:35.151042 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c14ff2-6057-4001-b20a-6dfa17fc044f None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:35.162516 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c14ff2-6057-4001-b20a-6dfa17fc044f None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:35.168657 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10355c76-90d1-45d3-aaef-fea92da4fec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:35.169279 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10355c76-90d1-45d3-aaef-fea92da4fec9 admin admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:35.169567 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10355c76-90d1-45d3-aaef-fea92da4fec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:35.169847 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10355c76-90d1-45d3-aaef-fea92da4fec9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:35.170611 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10355c76-90d1-45d3-aaef-fea92da4fec9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:35.172602 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10355c76-90d1-45d3-aaef-fea92da4fec9 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:35.202622 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1113/2222] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jul 11 14:42:35 2022] POST /identity/v3/projects => generated 367 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:42:35.207087 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6499ac-3d86-4778-946d-bb96d5a66572 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:35.217615 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6499ac-3d86-4778-946d-bb96d5a66572 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:35.292339 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cd6276-6ec0-4934-8d46-e26c587b15bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:35.293037 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cd6276-6ec0-4934-8d46-e26c587b15bf admin admin] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:35.293324 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cd6276-6ec0-4934-8d46-e26c587b15bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:35.293607 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cd6276-6ec0-4934-8d46-e26c587b15bf admin admin] PATH_INFO: `/v3/users` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:35.294367 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cd6276-6ec0-4934-8d46-e26c587b15bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:35.296325 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cd6276-6ec0-4934-8d46-e26c587b15bf admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:35.322102 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1110/2223] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jul 11 14:42:35 2022] POST /identity/v3/users => generated 284 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:42:35.328052 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10355c76-90d1-45d3-aaef-fea92da4fec9 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:35.338145 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:42:35.355418 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10355c76-90d1-45d3-aaef-fea92da4fec9 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:35.374316 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d9c683-e9b9-454f-9522-2b6c324d10ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:35.375040 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d9c683-e9b9-454f-9522-2b6c324d10ae admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:35.375330 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d9c683-e9b9-454f-9522-2b6c324d10ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:35.375608 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d9c683-e9b9-454f-9522-2b6c324d10ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:35.376392 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d9c683-e9b9-454f-9522-2b6c324d10ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:35.378191 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d9c683-e9b9-454f-9522-2b6c324d10ae admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:35.395553 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1114/2224] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:42:35 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:42:35.400024 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cd6276-6ec0-4934-8d46-e26c587b15bf admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:35.418030 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cd6276-6ec0-4934-8d46-e26c587b15bf admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:35.424134 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21678cdb-5071-4346-be13-6066801300dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:35.424867 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21678cdb-5071-4346-be13-6066801300dd admin admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:35.425152 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21678cdb-5071-4346-be13-6066801300dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:35.425486 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21678cdb-5071-4346-be13-6066801300dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:35.426239 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21678cdb-5071-4346-be13-6066801300dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:35.428053 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21678cdb-5071-4346-be13-6066801300dd admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:35.452618 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1111/2225] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:42:35 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:42:35.452747 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d9c683-e9b9-454f-9522-2b6c324d10ae admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:35.462662 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d9c683-e9b9-454f-9522-2b6c324d10ae admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:35.467511 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa693961-ad8d-4e81-8937-c797e68b95be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:35.468512 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa693961-ad8d-4e81-8937-c797e68b95be admin admin] REQUEST_METHOD: `PUT` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:35.468798 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa693961-ad8d-4e81-8937-c797e68b95be admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:35.469078 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa693961-ad8d-4e81-8937-c797e68b95be admin admin] PATH_INFO: `/v3/projects/a1e025b2e6494110b9dc96d74d3780b9/users/c57e185c54f14c97ba8ab53587149ea7/roles/8eff41f243c843ed95505a488ca6eada` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:35.490158 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa693961-ad8d-4e81-8937-c797e68b95be admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1e025b2e6494110b9dc96d74d3780b9, user_id=c57e185c54f14c97ba8ab53587149ea7, role_id=8eff41f243c843ed95505a488ca6eada)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:35.493787 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa693961-ad8d-4e81-8937-c797e68b95be admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:35.510657 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1115/2226] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jul 11 14:42:35 2022] PUT /identity/v3/projects/a1e025b2e6494110b9dc96d74d3780b9/users/c57e185c54f14c97ba8ab53587149ea7/roles/8eff41f243c843ed95505a488ca6eada => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:42:35.522313 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1eaf7b-08e1-4cac-bc59-482844968f8e None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:35.523008 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1eaf7b-08e1-4cac-bc59-482844968f8e None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:35.523354 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1eaf7b-08e1-4cac-bc59-482844968f8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:35.558969 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-6b1eaf7b-08e1-4cac-bc59-482844968f8e None None] MFA Rules not processed for user `c57e185c54f14c97ba8ab53587149ea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:42:35.560402 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-6b1eaf7b-08e1-4cac-bc59-482844968f8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:42:35.662930 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1112/2227] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:42:35 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:42:35.677662 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa693961-ad8d-4e81-8937-c797e68b95be admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:35.680000 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-aa693961-ad8d-4e81-8937-c797e68b95be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:42:35.768863 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa693961-ad8d-4e81-8937-c797e68b95be admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:35.773211 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2475e9f-e426-4d3e-9ec0-83d5bdcf199e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa21b44163d84534b9ca1ffe5b5a6071', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:35.774010 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2475e9f-e426-4d3e-9ec0-83d5bdcf199e service glance] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:35.774310 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2475e9f-e426-4d3e-9ec0-83d5bdcf199e service glance] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:35.774596 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2475e9f-e426-4d3e-9ec0-83d5bdcf199e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:35.784097 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2475e9f-e426-4d3e-9ec0-83d5bdcf199e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:35.785592 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2475e9f-e426-4d3e-9ec0-83d5bdcf199e service glance] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:35.795945 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1116/2228] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:42:35 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:42:38.038948 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1eaf7b-08e1-4cac-bc59-482844968f8e None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:38.040593 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-6b1eaf7b-08e1-4cac-bc59-482844968f8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:42:38.109774 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:42:38.128490 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1eaf7b-08e1-4cac-bc59-482844968f8e None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:38.133965 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0009ee64-7c81-47b5-8ccf-162fd0231aeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:38.134913 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0009ee64-7c81-47b5-8ccf-162fd0231aeb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:38.135194 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0009ee64-7c81-47b5-8ccf-162fd0231aeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:38.135469 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0009ee64-7c81-47b5-8ccf-162fd0231aeb admin admin] PATH_INFO: `/v3/users/6a0194cfc1de449b966332ad2bff1f1e` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:38.136780 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0009ee64-7c81-47b5-8ccf-162fd0231aeb admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a0194cfc1de449b966332ad2bff1f1e)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:38.138758 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0009ee64-7c81-47b5-8ccf-162fd0231aeb admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:38.197768 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-0009ee64-7c81-47b5-8ccf-162fd0231aeb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a0194cfc1de449b966332ad2bff1f1e'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:38.206564 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-0009ee64-7c81-47b5-8ccf-162fd0231aeb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a0194cfc1de449b966332ad2bff1f1e'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:38.217620 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-0009ee64-7c81-47b5-8ccf-162fd0231aeb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a0194cfc1de449b966332ad2bff1f1e'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:38.218262 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-0009ee64-7c81-47b5-8ccf-162fd0231aeb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a0194cfc1de449b966332ad2bff1f1e'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:38.218905 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-0009ee64-7c81-47b5-8ccf-162fd0231aeb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a0194cfc1de449b966332ad2bff1f1e'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:38.242208 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1113/2229] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jul 11 14:42:38 2022] DELETE /identity/v3/users/6a0194cfc1de449b966332ad2bff1f1e => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:42:38.247296 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57e78a2-b3db-4c40-a363-880ee531854e None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:38.247793 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57e78a2-b3db-4c40-a363-880ee531854e None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:38.247884 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57e78a2-b3db-4c40-a363-880ee531854e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:38.268984 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-a57e78a2-b3db-4c40-a363-880ee531854e None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:42:38.270427 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-a57e78a2-b3db-4c40-a363-880ee531854e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:42:38.332637 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1117/2230] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:42:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:42:38.342668 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0009ee64-7c81-47b5-8ccf-162fd0231aeb admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:38.344731 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-0009ee64-7c81-47b5-8ccf-162fd0231aeb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:42:38.407161 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0009ee64-7c81-47b5-8ccf-162fd0231aeb admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:38.410880 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f469a1d-e179-48d2-94b7-3beb36689607 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20eede5ccd834862b00123310b5c3975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:38.411544 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f469a1d-e179-48d2-94b7-3beb36689607 service neutron] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:38.411834 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f469a1d-e179-48d2-94b7-3beb36689607 service neutron] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:38.412114 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f469a1d-e179-48d2-94b7-3beb36689607 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:38.430856 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f469a1d-e179-48d2-94b7-3beb36689607 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:38.433062 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f469a1d-e179-48d2-94b7-3beb36689607 service neutron] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:38.446214 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1114/2231] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:42:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:42:38.729998 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57e78a2-b3db-4c40-a363-880ee531854e None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:38.732323 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-a57e78a2-b3db-4c40-a363-880ee531854e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:42:38.746286 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57e78a2-b3db-4c40-a363-880ee531854e None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:38.751050 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518782c5-fa80-4859-8761-b1ae4db20392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:38.751920 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518782c5-fa80-4859-8761-b1ae4db20392 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:38.752228 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518782c5-fa80-4859-8761-b1ae4db20392 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:38.752508 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518782c5-fa80-4859-8761-b1ae4db20392 admin admin] PATH_INFO: `/v3/projects/d51a355c87b74fef8e8f80549f513767` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:38.754205 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518782c5-fa80-4859-8761-b1ae4db20392 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d51a355c87b74fef8e8f80549f513767)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:38.756824 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518782c5-fa80-4859-8761-b1ae4db20392 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:38.813650 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:42:38.819093 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-518782c5-fa80-4859-8761-b1ae4db20392 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd51a355c87b74fef8e8f80549f513767', 'request_id': 'req-518782c5-fa80-4859-8761-b1ae4db20392'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:38.833653 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-518782c5-fa80-4859-8761-b1ae4db20392 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd51a355c87b74fef8e8f80549f513767', 'request_id': 'req-518782c5-fa80-4859-8761-b1ae4db20392'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:38.844536 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-518782c5-fa80-4859-8761-b1ae4db20392 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd51a355c87b74fef8e8f80549f513767', 'request_id': 'req-518782c5-fa80-4859-8761-b1ae4db20392'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:38.859000 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-518782c5-fa80-4859-8761-b1ae4db20392 admin admin] The token cache is being invalidate because project d51a355c87b74fef8e8f80549f513767 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:42:38.859294 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-518782c5-fa80-4859-8761-b1ae4db20392 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:38.860014 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-518782c5-fa80-4859-8761-b1ae4db20392 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:38.861524 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1118/2232] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jul 11 14:42:38 2022] DELETE /identity/v3/projects/d51a355c87b74fef8e8f80549f513767 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:42:38.865505 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f469a1d-e179-48d2-94b7-3beb36689607 service neutron] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:38.875982 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f469a1d-e179-48d2-94b7-3beb36689607 service neutron] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:38.946428 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a44a75d-224d-4ceb-957d-904e71293ad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:38.947331 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a44a75d-224d-4ceb-957d-904e71293ad3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:38.947612 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a44a75d-224d-4ceb-957d-904e71293ad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:38.947886 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a44a75d-224d-4ceb-957d-904e71293ad3 admin admin] PATH_INFO: `/v3/users/5c64f31983af441ab439089b529ce7c7` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:38.949176 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a44a75d-224d-4ceb-957d-904e71293ad3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c64f31983af441ab439089b529ce7c7)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:38.951141 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a44a75d-224d-4ceb-957d-904e71293ad3 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:38.956638 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:42:39.012991 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-7a44a75d-224d-4ceb-957d-904e71293ad3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c64f31983af441ab439089b529ce7c7'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:39.024326 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-7a44a75d-224d-4ceb-957d-904e71293ad3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c64f31983af441ab439089b529ce7c7'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:39.033611 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-7a44a75d-224d-4ceb-957d-904e71293ad3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c64f31983af441ab439089b529ce7c7'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:39.034606 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-7a44a75d-224d-4ceb-957d-904e71293ad3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c64f31983af441ab439089b529ce7c7'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:39.035386 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-7a44a75d-224d-4ceb-957d-904e71293ad3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c64f31983af441ab439089b529ce7c7'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:39.065853 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1115/2233] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jul 11 14:42:38 2022] DELETE /identity/v3/users/5c64f31983af441ab439089b529ce7c7 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:42:39.374206 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518782c5-fa80-4859-8761-b1ae4db20392 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:39.381437 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-518782c5-fa80-4859-8761-b1ae4db20392 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:42:39.418847 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518782c5-fa80-4859-8761-b1ae4db20392 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:39.488591 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edb4339-c05a-4a2d-8878-cbe08b48b6d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:39.489810 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edb4339-c05a-4a2d-8878-cbe08b48b6d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:39.490174 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edb4339-c05a-4a2d-8878-cbe08b48b6d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:39.490464 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edb4339-c05a-4a2d-8878-cbe08b48b6d8 admin admin] PATH_INFO: `/v3/projects/1a3c6d14bf004609ad68ac972aeffb38` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:39.493462 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edb4339-c05a-4a2d-8878-cbe08b48b6d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a3c6d14bf004609ad68ac972aeffb38)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:39.495395 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edb4339-c05a-4a2d-8878-cbe08b48b6d8 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:39.553465 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-6edb4339-c05a-4a2d-8878-cbe08b48b6d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a3c6d14bf004609ad68ac972aeffb38', 'request_id': 'req-6edb4339-c05a-4a2d-8878-cbe08b48b6d8'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:39.567320 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-6edb4339-c05a-4a2d-8878-cbe08b48b6d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a3c6d14bf004609ad68ac972aeffb38', 'request_id': 'req-6edb4339-c05a-4a2d-8878-cbe08b48b6d8'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:39.581153 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-6edb4339-c05a-4a2d-8878-cbe08b48b6d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a3c6d14bf004609ad68ac972aeffb38', 'request_id': 'req-6edb4339-c05a-4a2d-8878-cbe08b48b6d8'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:39.599816 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-6edb4339-c05a-4a2d-8878-cbe08b48b6d8 admin admin] The token cache is being invalidate because project 1a3c6d14bf004609ad68ac972aeffb38 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:42:39.600478 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-6edb4339-c05a-4a2d-8878-cbe08b48b6d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:39.601925 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-6edb4339-c05a-4a2d-8878-cbe08b48b6d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:39.606448 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1119/2234] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jul 11 14:42:39 2022] DELETE /identity/v3/projects/1a3c6d14bf004609ad68ac972aeffb38 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:42:39.608550 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a44a75d-224d-4ceb-957d-904e71293ad3 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:39.610945 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-7a44a75d-224d-4ceb-957d-904e71293ad3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:42:39.648616 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a44a75d-224d-4ceb-957d-904e71293ad3 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:39.720812 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8c0ef7-9ece-4171-8d54-c3a45001e738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:39.721965 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8c0ef7-9ece-4171-8d54-c3a45001e738 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:39.722187 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8c0ef7-9ece-4171-8d54-c3a45001e738 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:39.722302 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8c0ef7-9ece-4171-8d54-c3a45001e738 admin admin] PATH_INFO: `/v3/users/3e8a30e9700b493abd6ea7fee7b57afc` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:39.723569 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8c0ef7-9ece-4171-8d54-c3a45001e738 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e8a30e9700b493abd6ea7fee7b57afc)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:39.726821 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8c0ef7-9ece-4171-8d54-c3a45001e738 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:39.785072 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-8f8c0ef7-9ece-4171-8d54-c3a45001e738 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e8a30e9700b493abd6ea7fee7b57afc'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:39.793278 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-8f8c0ef7-9ece-4171-8d54-c3a45001e738 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e8a30e9700b493abd6ea7fee7b57afc'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:39.801852 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-8f8c0ef7-9ece-4171-8d54-c3a45001e738 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e8a30e9700b493abd6ea7fee7b57afc'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:39.802759 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-8f8c0ef7-9ece-4171-8d54-c3a45001e738 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e8a30e9700b493abd6ea7fee7b57afc'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:39.803410 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-8f8c0ef7-9ece-4171-8d54-c3a45001e738 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e8a30e9700b493abd6ea7fee7b57afc'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:39.824861 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1116/2235] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jul 11 14:42:39 2022] DELETE /identity/v3/users/3e8a30e9700b493abd6ea7fee7b57afc => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:42:40.330723 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edb4339-c05a-4a2d-8878-cbe08b48b6d8 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:40.341706 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-6edb4339-c05a-4a2d-8878-cbe08b48b6d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:42:40.380026 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edb4339-c05a-4a2d-8878-cbe08b48b6d8 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:40.446657 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f7caa2-69a7-4263-b974-9010b9fe3387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:40.447535 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f7caa2-69a7-4263-b974-9010b9fe3387 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:40.447820 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f7caa2-69a7-4263-b974-9010b9fe3387 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:40.448105 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f7caa2-69a7-4263-b974-9010b9fe3387 admin admin] PATH_INFO: `/v3/projects/5231f1720deb423c99b19bca422a6124` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:40.449378 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f7caa2-69a7-4263-b974-9010b9fe3387 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5231f1720deb423c99b19bca422a6124)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:40.451292 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f7caa2-69a7-4263-b974-9010b9fe3387 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:40.457878 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:42:40.504763 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-23f7caa2-69a7-4263-b974-9010b9fe3387 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5231f1720deb423c99b19bca422a6124', 'request_id': 'req-23f7caa2-69a7-4263-b974-9010b9fe3387'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:40.514831 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-23f7caa2-69a7-4263-b974-9010b9fe3387 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5231f1720deb423c99b19bca422a6124', 'request_id': 'req-23f7caa2-69a7-4263-b974-9010b9fe3387'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:40.524412 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-23f7caa2-69a7-4263-b974-9010b9fe3387 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5231f1720deb423c99b19bca422a6124', 'request_id': 'req-23f7caa2-69a7-4263-b974-9010b9fe3387'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:40.545351 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-23f7caa2-69a7-4263-b974-9010b9fe3387 admin admin] The token cache is being invalidate because project 5231f1720deb423c99b19bca422a6124 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:42:40.545655 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-23f7caa2-69a7-4263-b974-9010b9fe3387 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:40.547025 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-23f7caa2-69a7-4263-b974-9010b9fe3387 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:40.549543 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1120/2236] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jul 11 14:42:40 2022] DELETE /identity/v3/projects/5231f1720deb423c99b19bca422a6124 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:42:40.555464 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11202cb0-f4a9-44c4-a790-d9ec57b02091 None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:40.555935 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11202cb0-f4a9-44c4-a790-d9ec57b02091 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:40.557032 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11202cb0-f4a9-44c4-a790-d9ec57b02091 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:40.564364 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:42:40.579779 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-11202cb0-f4a9-44c4-a790-d9ec57b02091 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:42:40.581178 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-11202cb0-f4a9-44c4-a790-d9ec57b02091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:42:40.643643 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1117/2237] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:42:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:42:40.652589 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306dc150-7eca-4bac-bc8f-4f15ad827a4a None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:40.652902 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306dc150-7eca-4bac-bc8f-4f15ad827a4a None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:40.653197 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306dc150-7eca-4bac-bc8f-4f15ad827a4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:40.673785 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-306dc150-7eca-4bac-bc8f-4f15ad827a4a None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:42:40.675108 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-306dc150-7eca-4bac-bc8f-4f15ad827a4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:42:40.684516 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1121/2238] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:42:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:42:40.689118 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11202cb0-f4a9-44c4-a790-d9ec57b02091 None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:40.700053 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11202cb0-f4a9-44c4-a790-d9ec57b02091 None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:40.705702 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0ed6d0-6cbb-4122-9a70-8bab36116889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:40.706385 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0ed6d0-6cbb-4122-9a70-8bab36116889 admin admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:40.706694 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0ed6d0-6cbb-4122-9a70-8bab36116889 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:40.707030 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0ed6d0-6cbb-4122-9a70-8bab36116889 admin admin] PATH_INFO: `/v3/domains` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:40.707898 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0ed6d0-6cbb-4122-9a70-8bab36116889 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:42:40.708182 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0ed6d0-6cbb-4122-9a70-8bab36116889 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:40.710725 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0ed6d0-6cbb-4122-9a70-8bab36116889 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:40.736376 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1118/2239] 10.222.0.70 () {58 vars in 1152 bytes} [Mon Jul 11 14:42:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:42:40.740831 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306dc150-7eca-4bac-bc8f-4f15ad827a4a None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:40.750195 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306dc150-7eca-4bac-bc8f-4f15ad827a4a None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:40.754895 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29e5083-6e54-42ac-b83c-fea98f5713f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:40.755567 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29e5083-6e54-42ac-b83c-fea98f5713f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:40.755853 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29e5083-6e54-42ac-b83c-fea98f5713f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:40.756131 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29e5083-6e54-42ac-b83c-fea98f5713f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:40.757375 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29e5083-6e54-42ac-b83c-fea98f5713f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:40.759282 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29e5083-6e54-42ac-b83c-fea98f5713f3 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:40.793134 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1122/2240] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jul 11 14:42:40 2022] POST /identity/v3/projects => generated 371 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:42:40.797289 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0ed6d0-6cbb-4122-9a70-8bab36116889 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:40.808046 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0ed6d0-6cbb-4122-9a70-8bab36116889 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:40.875189 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ad01b9-aed4-483d-89c1-a708231aa68b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:40.876020 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ad01b9-aed4-483d-89c1-a708231aa68b admin admin] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:40.876249 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ad01b9-aed4-483d-89c1-a708231aa68b admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:40.876535 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ad01b9-aed4-483d-89c1-a708231aa68b admin admin] PATH_INFO: `/v3/users` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:40.877235 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ad01b9-aed4-483d-89c1-a708231aa68b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:40.879202 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ad01b9-aed4-483d-89c1-a708231aa68b admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:40.901411 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1119/2241] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jul 11 14:42:40 2022] POST /identity/v3/users => generated 286 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:42:40.905465 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29e5083-6e54-42ac-b83c-fea98f5713f3 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:40.916788 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29e5083-6e54-42ac-b83c-fea98f5713f3 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:40.922218 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0bdc0f-021c-42ea-a251-77c6e3c62a2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:40.922883 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0bdc0f-021c-42ea-a251-77c6e3c62a2e admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:40.923170 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0bdc0f-021c-42ea-a251-77c6e3c62a2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:40.923452 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0bdc0f-021c-42ea-a251-77c6e3c62a2e admin admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:40.924184 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0bdc0f-021c-42ea-a251-77c6e3c62a2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:40.925886 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0bdc0f-021c-42ea-a251-77c6e3c62a2e admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:40.938148 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1123/2242] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:42:40 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:42:40.942646 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ad01b9-aed4-483d-89c1-a708231aa68b admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:40.953207 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ad01b9-aed4-483d-89c1-a708231aa68b admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:40.957976 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19e1f6d-119e-4c17-9499-0cdab37e1316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:40.958644 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19e1f6d-119e-4c17-9499-0cdab37e1316 admin admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:40.959059 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19e1f6d-119e-4c17-9499-0cdab37e1316 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:40.959404 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19e1f6d-119e-4c17-9499-0cdab37e1316 admin admin] PATH_INFO: `/v3/roles` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:40.960709 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19e1f6d-119e-4c17-9499-0cdab37e1316 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:40.962660 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19e1f6d-119e-4c17-9499-0cdab37e1316 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:40.973375 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1120/2243] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:42:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:42:40.977766 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0bdc0f-021c-42ea-a251-77c6e3c62a2e admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:40.988957 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0bdc0f-021c-42ea-a251-77c6e3c62a2e admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:40.994370 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf045be-ee2d-4892-835c-f14c1df23a59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:40.995264 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf045be-ee2d-4892-835c-f14c1df23a59 admin admin] REQUEST_METHOD: `PUT` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:40.995549 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf045be-ee2d-4892-835c-f14c1df23a59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:40.995828 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf045be-ee2d-4892-835c-f14c1df23a59 admin admin] PATH_INFO: `/v3/projects/a7386ade7434410cb9a1f18ffcf2bb81/users/c6209a7303d1410587ae21e8a510da08/roles/8eff41f243c843ed95505a488ca6eada` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:41.011034 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf045be-ee2d-4892-835c-f14c1df23a59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7386ade7434410cb9a1f18ffcf2bb81, user_id=c6209a7303d1410587ae21e8a510da08, role_id=8eff41f243c843ed95505a488ca6eada)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:41.013719 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf045be-ee2d-4892-835c-f14c1df23a59 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:41.027252 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1124/2244] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jul 11 14:42:40 2022] PUT /identity/v3/projects/a7386ade7434410cb9a1f18ffcf2bb81/users/c6209a7303d1410587ae21e8a510da08/roles/8eff41f243c843ed95505a488ca6eada => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:42:41.032506 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082895d5-3f7d-44be-a0d1-b2aa81cc601f None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:41.032800 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082895d5-3f7d-44be-a0d1-b2aa81cc601f None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:41.033077 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082895d5-3f7d-44be-a0d1-b2aa81cc601f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:41.051754 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-082895d5-3f7d-44be-a0d1-b2aa81cc601f None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:42:41.053005 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-082895d5-3f7d-44be-a0d1-b2aa81cc601f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:42:41.114146 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1121/2245] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:42:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:42:41.124196 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf045be-ee2d-4892-835c-f14c1df23a59 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:41.126138 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-9cf045be-ee2d-4892-835c-f14c1df23a59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:42:41.186584 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf045be-ee2d-4892-835c-f14c1df23a59 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:41.190730 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9219beb-2fb3-41fb-9177-be017a31cbea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20eede5ccd834862b00123310b5c3975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:41.191378 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9219beb-2fb3-41fb-9177-be017a31cbea service neutron] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:41.191666 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9219beb-2fb3-41fb-9177-be017a31cbea service neutron] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:41.191945 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9219beb-2fb3-41fb-9177-be017a31cbea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:41.201459 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9219beb-2fb3-41fb-9177-be017a31cbea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:41.202898 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9219beb-2fb3-41fb-9177-be017a31cbea service neutron] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:41.213139 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1125/2246] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:42:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:42:41.863556 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47da709-d9d2-47ea-9589-5e60f696ff1a None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:41.864031 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47da709-d9d2-47ea-9589-5e60f696ff1a None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:41.864107 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47da709-d9d2-47ea-9589-5e60f696ff1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:41.906287 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:42:41.920755 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9219beb-2fb3-41fb-9177-be017a31cbea service neutron] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:41.922576 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-c9219beb-2fb3-41fb-9177-be017a31cbea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:42:41.923661 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-e47da709-d9d2-47ea-9589-5e60f696ff1a None None] MFA Rules not processed for user `c6209a7303d1410587ae21e8a510da08`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:42:41.925189 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-e47da709-d9d2-47ea-9589-5e60f696ff1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:42:41.941833 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9219beb-2fb3-41fb-9177-be017a31cbea service neutron] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:41.954740 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545ca48e-f1dd-4daf-8f1e-b356b77d4ac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:41.955650 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545ca48e-f1dd-4daf-8f1e-b356b77d4ac5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:41.955933 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545ca48e-f1dd-4daf-8f1e-b356b77d4ac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:41.956233 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545ca48e-f1dd-4daf-8f1e-b356b77d4ac5 admin admin] PATH_INFO: `/v3/users/f04f1d7fd00e4e34b1106cfaa9c9d149` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:41.961261 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545ca48e-f1dd-4daf-8f1e-b356b77d4ac5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f04f1d7fd00e4e34b1106cfaa9c9d149)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:41.963356 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545ca48e-f1dd-4daf-8f1e-b356b77d4ac5 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:42.002519 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:42:42.032387 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1122/2247] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:42:41 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:42:42.036818 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-545ca48e-f1dd-4daf-8f1e-b356b77d4ac5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f04f1d7fd00e4e34b1106cfaa9c9d149'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:42.041993 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47da709-d9d2-47ea-9589-5e60f696ff1a None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:42.043513 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-e47da709-d9d2-47ea-9589-5e60f696ff1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:42:42.051669 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-545ca48e-f1dd-4daf-8f1e-b356b77d4ac5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f04f1d7fd00e4e34b1106cfaa9c9d149'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:42.063576 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-545ca48e-f1dd-4daf-8f1e-b356b77d4ac5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f04f1d7fd00e4e34b1106cfaa9c9d149'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:42.065062 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-545ca48e-f1dd-4daf-8f1e-b356b77d4ac5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f04f1d7fd00e4e34b1106cfaa9c9d149'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:42.065943 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-545ca48e-f1dd-4daf-8f1e-b356b77d4ac5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f04f1d7fd00e4e34b1106cfaa9c9d149'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:42.094265 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1126/2248] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jul 11 14:42:41 2022] DELETE /identity/v3/users/f04f1d7fd00e4e34b1106cfaa9c9d149 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:42:42.104780 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d00ee3d-00af-498d-b4a9-e09c479c33a2 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:42.105215 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d00ee3d-00af-498d-b4a9-e09c479c33a2 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:42.105537 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d00ee3d-00af-498d-b4a9-e09c479c33a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:42.136261 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-7d00ee3d-00af-498d-b4a9-e09c479c33a2 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:42:42.137987 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-7d00ee3d-00af-498d-b4a9-e09c479c33a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:42:42.143624 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47da709-d9d2-47ea-9589-5e60f696ff1a None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:42.198448 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b569581-49d8-4750-85c5-497c03db6d4d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '868e7c2dec264512b972c8736d659c34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:42.199109 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b569581-49d8-4750-85c5-497c03db6d4d service cinder] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:42.199398 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b569581-49d8-4750-85c5-497c03db6d4d service cinder] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:42.199680 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b569581-49d8-4750-85c5-497c03db6d4d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:42.201667 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-9b569581-49d8-4750-85c5-497c03db6d4d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:42:42.202618 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1127/2249] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:42:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:42:42.212971 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d00ee3d-00af-498d-b4a9-e09c479c33a2 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:42.214460 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-7d00ee3d-00af-498d-b4a9-e09c479c33a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:42:42.265446 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b569581-49d8-4750-85c5-497c03db6d4d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:42.266993 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b569581-49d8-4750-85c5-497c03db6d4d service cinder] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:42.274549 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d00ee3d-00af-498d-b4a9-e09c479c33a2 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:42.277056 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1123/2250] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:42:42 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:42:42.278137 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb0ad91-38fd-4345-8461-d045163aa70a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20eede5ccd834862b00123310b5c3975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:42.278784 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb0ad91-38fd-4345-8461-d045163aa70a service neutron] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:42.279064 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb0ad91-38fd-4345-8461-d045163aa70a service neutron] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:42.279335 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb0ad91-38fd-4345-8461-d045163aa70a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:42.290302 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb0ad91-38fd-4345-8461-d045163aa70a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:42.291648 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb0ad91-38fd-4345-8461-d045163aa70a service neutron] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:42.302165 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1128/2251] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:42:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:42:42.691578 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b569581-49d8-4750-85c5-497c03db6d4d service cinder] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:42.693096 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-9b569581-49d8-4750-85c5-497c03db6d4d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:42:42.711780 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b569581-49d8-4750-85c5-497c03db6d4d service cinder] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:42.717226 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8f1148-e568-40ea-a846-6c9755371857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:42.718116 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8f1148-e568-40ea-a846-6c9755371857 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:42.718404 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8f1148-e568-40ea-a846-6c9755371857 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:42.718681 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8f1148-e568-40ea-a846-6c9755371857 admin admin] PATH_INFO: `/v3/projects/0cc5ffa3d8114c3b92c470e325aa6ca7` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:42.720341 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8f1148-e568-40ea-a846-6c9755371857 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0cc5ffa3d8114c3b92c470e325aa6ca7)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:42.723870 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8f1148-e568-40ea-a846-6c9755371857 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:42.728595 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:42:42.783277 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-ad8f1148-e568-40ea-a846-6c9755371857 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0cc5ffa3d8114c3b92c470e325aa6ca7', 'request_id': 'req-ad8f1148-e568-40ea-a846-6c9755371857'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:42.790687 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-ad8f1148-e568-40ea-a846-6c9755371857 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0cc5ffa3d8114c3b92c470e325aa6ca7', 'request_id': 'req-ad8f1148-e568-40ea-a846-6c9755371857'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:42.799896 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-ad8f1148-e568-40ea-a846-6c9755371857 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0cc5ffa3d8114c3b92c470e325aa6ca7', 'request_id': 'req-ad8f1148-e568-40ea-a846-6c9755371857'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:42.812329 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-ad8f1148-e568-40ea-a846-6c9755371857 admin admin] The token cache is being invalidate because project 0cc5ffa3d8114c3b92c470e325aa6ca7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80534) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:42:42.812623 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-ad8f1148-e568-40ea-a846-6c9755371857 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:42.813282 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-ad8f1148-e568-40ea-a846-6c9755371857 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:42.815146 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1124/2252] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jul 11 14:42:42 2022] DELETE /identity/v3/projects/0cc5ffa3d8114c3b92c470e325aa6ca7 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:42:42.819804 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb0ad91-38fd-4345-8461-d045163aa70a service neutron] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:42.830453 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb0ad91-38fd-4345-8461-d045163aa70a service neutron] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:42.883873 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:42:42.900036 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6870041-502e-49af-967e-360d7350bbd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:42.900951 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6870041-502e-49af-967e-360d7350bbd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:42.901233 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6870041-502e-49af-967e-360d7350bbd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:42.901504 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6870041-502e-49af-967e-360d7350bbd4 admin admin] PATH_INFO: `/v3/users/ea71acf979fa4272a09f325de6927421` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:42.902725 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6870041-502e-49af-967e-360d7350bbd4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea71acf979fa4272a09f325de6927421)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:42.904684 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6870041-502e-49af-967e-360d7350bbd4 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:42.953027 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-f6870041-502e-49af-967e-360d7350bbd4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea71acf979fa4272a09f325de6927421'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:42.960709 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-f6870041-502e-49af-967e-360d7350bbd4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea71acf979fa4272a09f325de6927421'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:42.968682 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-f6870041-502e-49af-967e-360d7350bbd4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea71acf979fa4272a09f325de6927421'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:42.969490 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-f6870041-502e-49af-967e-360d7350bbd4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea71acf979fa4272a09f325de6927421'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:42.970342 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-f6870041-502e-49af-967e-360d7350bbd4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea71acf979fa4272a09f325de6927421'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:42.994716 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1129/2253] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jul 11 14:42:42 2022] DELETE /identity/v3/users/ea71acf979fa4272a09f325de6927421 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:42:43.377458 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8f1148-e568-40ea-a846-6c9755371857 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:43.378881 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-ad8f1148-e568-40ea-a846-6c9755371857 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:42:43.398797 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8f1148-e568-40ea-a846-6c9755371857 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:43.465264 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b766c819-b2cf-43f3-a0f4-1dc1ede2b8d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:43.466369 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b766c819-b2cf-43f3-a0f4-1dc1ede2b8d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:43.466652 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b766c819-b2cf-43f3-a0f4-1dc1ede2b8d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:43.466928 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b766c819-b2cf-43f3-a0f4-1dc1ede2b8d4 admin admin] PATH_INFO: `/v3/projects/74ea4db692bd420a953a9759b2fc2030` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:43.468121 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b766c819-b2cf-43f3-a0f4-1dc1ede2b8d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=74ea4db692bd420a953a9759b2fc2030)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:43.470080 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b766c819-b2cf-43f3-a0f4-1dc1ede2b8d4 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:43.524165 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-b766c819-b2cf-43f3-a0f4-1dc1ede2b8d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74ea4db692bd420a953a9759b2fc2030', 'request_id': 'req-b766c819-b2cf-43f3-a0f4-1dc1ede2b8d4'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:43.532286 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-b766c819-b2cf-43f3-a0f4-1dc1ede2b8d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74ea4db692bd420a953a9759b2fc2030', 'request_id': 'req-b766c819-b2cf-43f3-a0f4-1dc1ede2b8d4'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:43.542631 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-b766c819-b2cf-43f3-a0f4-1dc1ede2b8d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74ea4db692bd420a953a9759b2fc2030', 'request_id': 'req-b766c819-b2cf-43f3-a0f4-1dc1ede2b8d4'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:43.559078 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-b766c819-b2cf-43f3-a0f4-1dc1ede2b8d4 admin admin] The token cache is being invalidate because project 74ea4db692bd420a953a9759b2fc2030 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80534) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:42:43.559369 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-b766c819-b2cf-43f3-a0f4-1dc1ede2b8d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:43.560032 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-b766c819-b2cf-43f3-a0f4-1dc1ede2b8d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:43.561607 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1125/2254] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jul 11 14:42:43 2022] DELETE /identity/v3/projects/74ea4db692bd420a953a9759b2fc2030 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:42:43.566784 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cc848d-ed33-4fa8-ae3a-11498be66e7e None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:43.567072 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cc848d-ed33-4fa8-ae3a-11498be66e7e None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:43.567348 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cc848d-ed33-4fa8-ae3a-11498be66e7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:43.587437 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-43cc848d-ed33-4fa8-ae3a-11498be66e7e None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:42:43.588680 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-43cc848d-ed33-4fa8-ae3a-11498be66e7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:42:43.650768 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1130/2255] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:42:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:42:43.658897 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4be9723-85fb-4cd1-a836-3d1fedae76c2 None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:43.659195 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4be9723-85fb-4cd1-a836-3d1fedae76c2 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:43.659478 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4be9723-85fb-4cd1-a836-3d1fedae76c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:43.682978 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-a4be9723-85fb-4cd1-a836-3d1fedae76c2 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:42:43.684294 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-a4be9723-85fb-4cd1-a836-3d1fedae76c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:42:43.694541 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1126/2256] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:42:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:42:43.699058 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cc848d-ed33-4fa8-ae3a-11498be66e7e None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:43.709512 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cc848d-ed33-4fa8-ae3a-11498be66e7e None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:43.715255 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ce4a48-813d-45c3-94af-4159bcbd7aa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:43.715955 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ce4a48-813d-45c3-94af-4159bcbd7aa9 admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:43.716307 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ce4a48-813d-45c3-94af-4159bcbd7aa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:43.716789 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ce4a48-813d-45c3-94af-4159bcbd7aa9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:43.717589 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ce4a48-813d-45c3-94af-4159bcbd7aa9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:42:43.717908 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ce4a48-813d-45c3-94af-4159bcbd7aa9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:43.719649 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ce4a48-813d-45c3-94af-4159bcbd7aa9 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:43.735628 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1131/2257] 10.222.0.70 () {58 vars in 1152 bytes} [Mon Jul 11 14:42:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:42:43.747927 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4be9723-85fb-4cd1-a836-3d1fedae76c2 None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:43.753395 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2408cce-7150-430c-b02e-a2f0a0e8137e None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:43.753690 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2408cce-7150-430c-b02e-a2f0a0e8137e None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:43.753978 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2408cce-7150-430c-b02e-a2f0a0e8137e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:43.758304 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4be9723-85fb-4cd1-a836-3d1fedae76c2 None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:43.763656 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada56886-c3d0-4f1c-abc7-8d40a9f63fd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:43.764830 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada56886-c3d0-4f1c-abc7-8d40a9f63fd4 admin admin] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:43.767584 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada56886-c3d0-4f1c-abc7-8d40a9f63fd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:43.767985 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada56886-c3d0-4f1c-abc7-8d40a9f63fd4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:43.770425 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada56886-c3d0-4f1c-abc7-8d40a9f63fd4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:43.770747 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada56886-c3d0-4f1c-abc7-8d40a9f63fd4 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:43.786261 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-a2408cce-7150-430c-b02e-a2f0a0e8137e None None] MFA Rules not processed for user `c6209a7303d1410587ae21e8a510da08`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:42:43.788243 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-a2408cce-7150-430c-b02e-a2f0a0e8137e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:42:43.793329 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:42:43.810616 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1127/2258] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jul 11 14:42:43 2022] POST /identity/v3/projects => generated 365 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:42:43.815578 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada56886-c3d0-4f1c-abc7-8d40a9f63fd4 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:43.844402 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:42:43.854668 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1132/2259] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:42:43 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:42:43.892810 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada56886-c3d0-4f1c-abc7-8d40a9f63fd4 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:43.897611 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c593e1c1-2aaf-4592-b0b8-1def7823c5f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:43.898134 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c593e1c1-2aaf-4592-b0b8-1def7823c5f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:43.898415 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c593e1c1-2aaf-4592-b0b8-1def7823c5f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:43.898687 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c593e1c1-2aaf-4592-b0b8-1def7823c5f0 admin admin] PATH_INFO: `/v3/users` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:43.899379 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c593e1c1-2aaf-4592-b0b8-1def7823c5f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:43.901667 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c593e1c1-2aaf-4592-b0b8-1def7823c5f0 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:43.925441 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1128/2260] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jul 11 14:42:43 2022] POST /identity/v3/users => generated 283 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:42:43.930960 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2408cce-7150-430c-b02e-a2f0a0e8137e None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:43.943481 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2408cce-7150-430c-b02e-a2f0a0e8137e None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:43.948622 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce95140-1b04-4c96-9b86-25b65a11d8a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:43.949373 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce95140-1b04-4c96-9b86-25b65a11d8a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:43.949825 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce95140-1b04-4c96-9b86-25b65a11d8a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:43.950117 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce95140-1b04-4c96-9b86-25b65a11d8a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:43.950860 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce95140-1b04-4c96-9b86-25b65a11d8a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:43.952502 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce95140-1b04-4c96-9b86-25b65a11d8a2 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:43.963940 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1133/2261] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:42:43 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:42:43.967941 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c593e1c1-2aaf-4592-b0b8-1def7823c5f0 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:43.978730 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c593e1c1-2aaf-4592-b0b8-1def7823c5f0 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:43.983607 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66eb9775-b758-4ec6-bdf1-1fc3d740dd80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:43.984334 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eb9775-b758-4ec6-bdf1-1fc3d740dd80 admin admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:43.984623 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eb9775-b758-4ec6-bdf1-1fc3d740dd80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:43.984901 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eb9775-b758-4ec6-bdf1-1fc3d740dd80 admin admin] PATH_INFO: `/v3/roles` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:43.985641 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66eb9775-b758-4ec6-bdf1-1fc3d740dd80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:43.987268 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66eb9775-b758-4ec6-bdf1-1fc3d740dd80 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:44.002079 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1129/2262] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:42:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:42:44.003782 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce95140-1b04-4c96-9b86-25b65a11d8a2 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:44.016130 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce95140-1b04-4c96-9b86-25b65a11d8a2 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:44.024985 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae86ffc3-d0b0-4a23-94a2-3c35e5fe5e76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:44.025951 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae86ffc3-d0b0-4a23-94a2-3c35e5fe5e76 admin admin] REQUEST_METHOD: `PUT` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:44.026239 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae86ffc3-d0b0-4a23-94a2-3c35e5fe5e76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:44.026521 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae86ffc3-d0b0-4a23-94a2-3c35e5fe5e76 admin admin] PATH_INFO: `/v3/projects/31e4c3b0351846918f7cb9ab75603daa/users/bc7d9367fd934ba9a537bb2d818f93fe/roles/8eff41f243c843ed95505a488ca6eada` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:44.043670 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae86ffc3-d0b0-4a23-94a2-3c35e5fe5e76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31e4c3b0351846918f7cb9ab75603daa, user_id=bc7d9367fd934ba9a537bb2d818f93fe, role_id=8eff41f243c843ed95505a488ca6eada)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:44.046308 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae86ffc3-d0b0-4a23-94a2-3c35e5fe5e76 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:44.061962 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1134/2263] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jul 11 14:42:44 2022] PUT /identity/v3/projects/31e4c3b0351846918f7cb9ab75603daa/users/bc7d9367fd934ba9a537bb2d818f93fe/roles/8eff41f243c843ed95505a488ca6eada => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:42:44.073046 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ed6271-0667-4e6c-a33c-1bbbab9cb303 None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:44.073479 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ed6271-0667-4e6c-a33c-1bbbab9cb303 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:44.073799 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ed6271-0667-4e6c-a33c-1bbbab9cb303 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:44.106299 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-20ed6271-0667-4e6c-a33c-1bbbab9cb303 None None] MFA Rules not processed for user `bc7d9367fd934ba9a537bb2d818f93fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:42:44.107602 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-20ed6271-0667-4e6c-a33c-1bbbab9cb303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:42:44.186073 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1130/2264] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:42:44 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:42:44.190858 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae86ffc3-d0b0-4a23-94a2-3c35e5fe5e76 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:44.274946 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae86ffc3-d0b0-4a23-94a2-3c35e5fe5e76 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:44.279966 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296d25e0-5a7d-4b93-a02b-59a7c3bb6d4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:44.280672 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296d25e0-5a7d-4b93-a02b-59a7c3bb6d4a admin admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:44.280956 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296d25e0-5a7d-4b93-a02b-59a7c3bb6d4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:44.281234 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296d25e0-5a7d-4b93-a02b-59a7c3bb6d4a admin admin] PATH_INFO: `/v3/projects` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:44.281931 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296d25e0-5a7d-4b93-a02b-59a7c3bb6d4a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:44.283852 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296d25e0-5a7d-4b93-a02b-59a7c3bb6d4a admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:44.315731 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1135/2265] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jul 11 14:42:44 2022] POST /identity/v3/projects => generated 365 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:42:44.316910 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ed6271-0667-4e6c-a33c-1bbbab9cb303 None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:44.328554 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ed6271-0667-4e6c-a33c-1bbbab9cb303 None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:44.392842 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b96dfe-379e-44b9-9cb5-123058125a62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:44.393544 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b96dfe-379e-44b9-9cb5-123058125a62 admin admin] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:44.393928 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b96dfe-379e-44b9-9cb5-123058125a62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:44.394356 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b96dfe-379e-44b9-9cb5-123058125a62 admin admin] PATH_INFO: `/v3/users` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:44.395055 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b96dfe-379e-44b9-9cb5-123058125a62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:44.396997 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b96dfe-379e-44b9-9cb5-123058125a62 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:44.405544 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:42:44.421744 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1131/2266] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jul 11 14:42:44 2022] POST /identity/v3/users => generated 289 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:42:44.423118 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296d25e0-5a7d-4b93-a02b-59a7c3bb6d4a admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:44.433632 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296d25e0-5a7d-4b93-a02b-59a7c3bb6d4a admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:44.442390 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f4932f-4510-4418-95a6-07567d375c08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:44.443097 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f4932f-4510-4418-95a6-07567d375c08 admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:44.443380 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f4932f-4510-4418-95a6-07567d375c08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:44.443799 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f4932f-4510-4418-95a6-07567d375c08 admin admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:44.446139 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f4932f-4510-4418-95a6-07567d375c08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:44.448104 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f4932f-4510-4418-95a6-07567d375c08 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:44.466455 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1136/2267] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:42:44 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:42:44.468043 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b96dfe-379e-44b9-9cb5-123058125a62 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:44.479133 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b96dfe-379e-44b9-9cb5-123058125a62 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:44.483960 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4787d46a-6e50-43a3-847b-c179a29f3043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:44.485024 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4787d46a-6e50-43a3-847b-c179a29f3043 admin admin] REQUEST_METHOD: `PUT` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:44.485316 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4787d46a-6e50-43a3-847b-c179a29f3043 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:44.485691 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4787d46a-6e50-43a3-847b-c179a29f3043 admin admin] PATH_INFO: `/v3/projects/d9ec6515dcb2473992801268b7f12947/users/0f5144a646fd497dbef3b18dac4d48c7/roles/b46df176b0fe479da63c318db225bed4` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:44.502094 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4787d46a-6e50-43a3-847b-c179a29f3043 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9ec6515dcb2473992801268b7f12947, user_id=0f5144a646fd497dbef3b18dac4d48c7, role_id=b46df176b0fe479da63c318db225bed4)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:44.504930 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4787d46a-6e50-43a3-847b-c179a29f3043 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:44.519574 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1132/2268] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jul 11 14:42:44 2022] PUT /identity/v3/projects/d9ec6515dcb2473992801268b7f12947/users/0f5144a646fd497dbef3b18dac4d48c7/roles/b46df176b0fe479da63c318db225bed4 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:42:44.524567 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f4932f-4510-4418-95a6-07567d375c08 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:44.535856 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f4932f-4510-4418-95a6-07567d375c08 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:44.598722 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2754e416-4acd-406c-9094-385826b6daa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:44.599401 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2754e416-4acd-406c-9094-385826b6daa2 admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:44.599689 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2754e416-4acd-406c-9094-385826b6daa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:44.599971 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2754e416-4acd-406c-9094-385826b6daa2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:44.601609 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2754e416-4acd-406c-9094-385826b6daa2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:44.603233 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2754e416-4acd-406c-9094-385826b6daa2 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:44.613805 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1137/2269] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:42:44 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:42:44.618660 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4787d46a-6e50-43a3-847b-c179a29f3043 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:44.633085 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4787d46a-6e50-43a3-847b-c179a29f3043 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:44.645470 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4788cb58-6add-4097-9e37-4c91123c220e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:44.646417 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4788cb58-6add-4097-9e37-4c91123c220e admin admin] REQUEST_METHOD: `PUT` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:44.646701 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4788cb58-6add-4097-9e37-4c91123c220e admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:44.646981 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4788cb58-6add-4097-9e37-4c91123c220e admin admin] PATH_INFO: `/v3/projects/d9ec6515dcb2473992801268b7f12947/users/0f5144a646fd497dbef3b18dac4d48c7/roles/b46df176b0fe479da63c318db225bed4` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:44.649245 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4788cb58-6add-4097-9e37-4c91123c220e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9ec6515dcb2473992801268b7f12947, user_id=0f5144a646fd497dbef3b18dac4d48c7, role_id=b46df176b0fe479da63c318db225bed4)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:44.652051 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4788cb58-6add-4097-9e37-4c91123c220e admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:44.667666 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1133/2270] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jul 11 14:42:44 2022] PUT /identity/v3/projects/d9ec6515dcb2473992801268b7f12947/users/0f5144a646fd497dbef3b18dac4d48c7/roles/b46df176b0fe479da63c318db225bed4 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:42:44.680751 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6f007a-e378-40aa-80a8-25283b739206 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:44.681172 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6f007a-e378-40aa-80a8-25283b739206 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:44.681550 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6f007a-e378-40aa-80a8-25283b739206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:44.716709 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-fd6f007a-e378-40aa-80a8-25283b739206 None None] MFA Rules not processed for user `0f5144a646fd497dbef3b18dac4d48c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:42:44.718048 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-fd6f007a-e378-40aa-80a8-25283b739206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:42:44.800651 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:42:44.894649 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1138/2271] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:42:44 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:42:44.911046 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4788cb58-6add-4097-9e37-4c91123c220e admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:44.913518 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-4788cb58-6add-4097-9e37-4c91123c220e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:42:45.036173 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4788cb58-6add-4097-9e37-4c91123c220e admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:45.040843 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d3334d-f903-4fc0-b066-19b901bf9ff9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '868e7c2dec264512b972c8736d659c34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:45.041535 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d3334d-f903-4fc0-b066-19b901bf9ff9 service cinder] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:45.041817 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d3334d-f903-4fc0-b066-19b901bf9ff9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:45.042780 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d3334d-f903-4fc0-b066-19b901bf9ff9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:45.054044 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d3334d-f903-4fc0-b066-19b901bf9ff9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:45.056269 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d3334d-f903-4fc0-b066-19b901bf9ff9 service cinder] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:45.067550 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1134/2272] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:42:44 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:42:45.181040 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6f007a-e378-40aa-80a8-25283b739206 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:45.197748 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6f007a-e378-40aa-80a8-25283b739206 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:45.202488 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acef4ab0-43a9-4a50-9a7a-3a727998225c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '868e7c2dec264512b972c8736d659c34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:45.203208 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acef4ab0-43a9-4a50-9a7a-3a727998225c service cinder] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:45.203570 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acef4ab0-43a9-4a50-9a7a-3a727998225c service cinder] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:45.203840 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acef4ab0-43a9-4a50-9a7a-3a727998225c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:45.268011 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acef4ab0-43a9-4a50-9a7a-3a727998225c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:45.269529 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acef4ab0-43a9-4a50-9a7a-3a727998225c service cinder] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:45.280867 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1139/2273] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:42:45 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:42:47.683969 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b7d73a-8050-4e2b-8c21-208d3509dc68 None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:47.684769 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b7d73a-8050-4e2b-8c21-208d3509dc68 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:47.684769 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b7d73a-8050-4e2b-8c21-208d3509dc68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:47.705023 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-21b7d73a-8050-4e2b-8c21-208d3509dc68 None None] MFA Rules not processed for user `fee6e5aa4b4947faa8b6f7937250986b`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:42:47.706290 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-21b7d73a-8050-4e2b-8c21-208d3509dc68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:42:47.775050 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1135/2274] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:42:47 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:42:48.181206 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acef4ab0-43a9-4a50-9a7a-3a727998225c service cinder] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:48.263142 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acef4ab0-43a9-4a50-9a7a-3a727998225c service cinder] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:48.268132 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db10728-b1eb-47ee-9252-8f466bd4ddbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:48.269390 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db10728-b1eb-47ee-9252-8f466bd4ddbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:48.269390 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db10728-b1eb-47ee-9252-8f466bd4ddbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:48.269644 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db10728-b1eb-47ee-9252-8f466bd4ddbd admin admin] PATH_INFO: `/v3/users/bc7d9367fd934ba9a537bb2d818f93fe` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:48.270864 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db10728-b1eb-47ee-9252-8f466bd4ddbd admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc7d9367fd934ba9a537bb2d818f93fe)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:48.274291 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db10728-b1eb-47ee-9252-8f466bd4ddbd admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:48.349246 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-8db10728-b1eb-47ee-9252-8f466bd4ddbd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc7d9367fd934ba9a537bb2d818f93fe'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:48.367037 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-8db10728-b1eb-47ee-9252-8f466bd4ddbd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc7d9367fd934ba9a537bb2d818f93fe'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:48.374892 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:42:48.382870 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-8db10728-b1eb-47ee-9252-8f466bd4ddbd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc7d9367fd934ba9a537bb2d818f93fe'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:48.383487 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-8db10728-b1eb-47ee-9252-8f466bd4ddbd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc7d9367fd934ba9a537bb2d818f93fe'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:48.384603 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-8db10728-b1eb-47ee-9252-8f466bd4ddbd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc7d9367fd934ba9a537bb2d818f93fe'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:48.408663 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1140/2275] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jul 11 14:42:48 2022] DELETE /identity/v3/users/bc7d9367fd934ba9a537bb2d818f93fe => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:42:48.414658 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a807a6e7-82b3-4437-b2cc-8d9633b1f59c None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:48.414948 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a807a6e7-82b3-4437-b2cc-8d9633b1f59c None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:48.415227 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a807a6e7-82b3-4437-b2cc-8d9633b1f59c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:48.434290 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-a807a6e7-82b3-4437-b2cc-8d9633b1f59c None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:42:48.435510 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-a807a6e7-82b3-4437-b2cc-8d9633b1f59c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:42:48.511491 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1136/2276] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:42:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:42:48.518200 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db10728-b1eb-47ee-9252-8f466bd4ddbd admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:48.519819 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-8db10728-b1eb-47ee-9252-8f466bd4ddbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:42:48.594315 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db10728-b1eb-47ee-9252-8f466bd4ddbd admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:48.598541 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2937e296-964a-43b3-a242-e1a385c6336a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20eede5ccd834862b00123310b5c3975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:48.599217 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2937e296-964a-43b3-a242-e1a385c6336a service neutron] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:48.599762 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2937e296-964a-43b3-a242-e1a385c6336a service neutron] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:48.599762 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2937e296-964a-43b3-a242-e1a385c6336a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:48.609960 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2937e296-964a-43b3-a242-e1a385c6336a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:48.611409 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2937e296-964a-43b3-a242-e1a385c6336a service neutron] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:48.625022 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1141/2277] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:42:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:42:49.003554 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a807a6e7-82b3-4437-b2cc-8d9633b1f59c None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:49.005400 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-a807a6e7-82b3-4437-b2cc-8d9633b1f59c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:42:49.013316 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:42:49.026939 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a807a6e7-82b3-4437-b2cc-8d9633b1f59c None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:49.037988 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8af40f8-d96c-4c75-be34-808a377c3057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:49.039249 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8af40f8-d96c-4c75-be34-808a377c3057 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:49.040388 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8af40f8-d96c-4c75-be34-808a377c3057 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:49.040723 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8af40f8-d96c-4c75-be34-808a377c3057 admin admin] PATH_INFO: `/v3/projects/31e4c3b0351846918f7cb9ab75603daa` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:49.042255 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8af40f8-d96c-4c75-be34-808a377c3057 admin admin] RBAC: Authorizing `identity:delete_project(project_id=31e4c3b0351846918f7cb9ab75603daa)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:49.045096 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8af40f8-d96c-4c75-be34-808a377c3057 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:49.121246 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-d8af40f8-d96c-4c75-be34-808a377c3057 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31e4c3b0351846918f7cb9ab75603daa', 'request_id': 'req-d8af40f8-d96c-4c75-be34-808a377c3057'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:49.128761 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-d8af40f8-d96c-4c75-be34-808a377c3057 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31e4c3b0351846918f7cb9ab75603daa', 'request_id': 'req-d8af40f8-d96c-4c75-be34-808a377c3057'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:49.138688 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-d8af40f8-d96c-4c75-be34-808a377c3057 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31e4c3b0351846918f7cb9ab75603daa', 'request_id': 'req-d8af40f8-d96c-4c75-be34-808a377c3057'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:49.152000 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-d8af40f8-d96c-4c75-be34-808a377c3057 admin admin] The token cache is being invalidate because project 31e4c3b0351846918f7cb9ab75603daa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80534) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:42:49.152397 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-d8af40f8-d96c-4c75-be34-808a377c3057 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:49.153006 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-d8af40f8-d96c-4c75-be34-808a377c3057 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:49.154691 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1137/2278] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jul 11 14:42:49 2022] DELETE /identity/v3/projects/31e4c3b0351846918f7cb9ab75603daa => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:42:49.158859 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2937e296-964a-43b3-a242-e1a385c6336a service neutron] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:49.169073 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2937e296-964a-43b3-a242-e1a385c6336a service neutron] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:49.234319 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f552204b-ea86-4772-b38c-1529038cc68a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:49.235198 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f552204b-ea86-4772-b38c-1529038cc68a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:49.235485 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f552204b-ea86-4772-b38c-1529038cc68a admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:49.235762 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f552204b-ea86-4772-b38c-1529038cc68a admin admin] PATH_INFO: `/v3/users/0f5144a646fd497dbef3b18dac4d48c7` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:49.237005 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f552204b-ea86-4772-b38c-1529038cc68a admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f5144a646fd497dbef3b18dac4d48c7)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:49.238947 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f552204b-ea86-4772-b38c-1529038cc68a admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:49.292880 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-f552204b-ea86-4772-b38c-1529038cc68a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f5144a646fd497dbef3b18dac4d48c7'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:49.299897 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-f552204b-ea86-4772-b38c-1529038cc68a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f5144a646fd497dbef3b18dac4d48c7'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:49.309655 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-f552204b-ea86-4772-b38c-1529038cc68a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f5144a646fd497dbef3b18dac4d48c7'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:49.310839 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-f552204b-ea86-4772-b38c-1529038cc68a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f5144a646fd497dbef3b18dac4d48c7'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:49.311849 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-f552204b-ea86-4772-b38c-1529038cc68a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f5144a646fd497dbef3b18dac4d48c7'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:49.335315 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:42:49.344664 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1142/2279] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jul 11 14:42:49 2022] DELETE /identity/v3/users/0f5144a646fd497dbef3b18dac4d48c7 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:42:49.642079 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8af40f8-d96c-4c75-be34-808a377c3057 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:49.644306 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-d8af40f8-d96c-4c75-be34-808a377c3057 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:42:49.666130 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8af40f8-d96c-4c75-be34-808a377c3057 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:49.742354 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d103175c-a31f-4433-a503-ec4d92855880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:49.743392 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d103175c-a31f-4433-a503-ec4d92855880 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:49.743530 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d103175c-a31f-4433-a503-ec4d92855880 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:49.743815 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d103175c-a31f-4433-a503-ec4d92855880 admin admin] PATH_INFO: `/v3/projects/d9ec6515dcb2473992801268b7f12947` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:49.745429 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d103175c-a31f-4433-a503-ec4d92855880 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9ec6515dcb2473992801268b7f12947)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:49.747432 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d103175c-a31f-4433-a503-ec4d92855880 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:49.824099 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-d103175c-a31f-4433-a503-ec4d92855880 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9ec6515dcb2473992801268b7f12947', 'request_id': 'req-d103175c-a31f-4433-a503-ec4d92855880'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:49.832773 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-d103175c-a31f-4433-a503-ec4d92855880 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9ec6515dcb2473992801268b7f12947', 'request_id': 'req-d103175c-a31f-4433-a503-ec4d92855880'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:49.843023 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-d103175c-a31f-4433-a503-ec4d92855880 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9ec6515dcb2473992801268b7f12947', 'request_id': 'req-d103175c-a31f-4433-a503-ec4d92855880'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:49.868309 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-d103175c-a31f-4433-a503-ec4d92855880 admin admin] The token cache is being invalidate because project d9ec6515dcb2473992801268b7f12947 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80534) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:42:49.868614 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-d103175c-a31f-4433-a503-ec4d92855880 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:49.869521 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-d103175c-a31f-4433-a503-ec4d92855880 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:42:49.871196 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1138/2280] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jul 11 14:42:49 2022] DELETE /identity/v3/projects/d9ec6515dcb2473992801268b7f12947 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:42:49.876683 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13108a76-300f-458d-bfa2-76c34ffee098 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:49.876997 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13108a76-300f-458d-bfa2-76c34ffee098 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:49.877286 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13108a76-300f-458d-bfa2-76c34ffee098 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:49.902770 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-13108a76-300f-458d-bfa2-76c34ffee098 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:42:49.904068 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-13108a76-300f-458d-bfa2-76c34ffee098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:42:50.001475 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1143/2281] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:42:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:42:50.010822 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c79826-d3c4-4606-9ffd-9a7d0033533c None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:50.011355 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c79826-d3c4-4606-9ffd-9a7d0033533c None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:50.011355 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c79826-d3c4-4606-9ffd-9a7d0033533c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:50.031525 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-f7c79826-d3c4-4606-9ffd-9a7d0033533c None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:42:50.032824 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-f7c79826-d3c4-4606-9ffd-9a7d0033533c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:42:50.042032 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1139/2282] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:42:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:42:50.046585 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13108a76-300f-458d-bfa2-76c34ffee098 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:50.057844 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13108a76-300f-458d-bfa2-76c34ffee098 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:50.062795 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01739a71-532a-45da-8d9a-827265f8a4e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:50.063484 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01739a71-532a-45da-8d9a-827265f8a4e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:50.064070 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01739a71-532a-45da-8d9a-827265f8a4e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:50.064377 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01739a71-532a-45da-8d9a-827265f8a4e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:50.065120 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01739a71-532a-45da-8d9a-827265f8a4e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:42:50.065429 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01739a71-532a-45da-8d9a-827265f8a4e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:50.067251 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01739a71-532a-45da-8d9a-827265f8a4e2 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:50.081236 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1144/2283] 10.222.0.70 () {58 vars in 1152 bytes} [Mon Jul 11 14:42:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:42:50.086214 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c79826-d3c4-4606-9ffd-9a7d0033533c None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:50.096415 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c79826-d3c4-4606-9ffd-9a7d0033533c None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:50.102517 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a791f08-dda4-4716-939c-b5055ddca95c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:50.103214 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a791f08-dda4-4716-939c-b5055ddca95c admin admin] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:50.103503 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a791f08-dda4-4716-939c-b5055ddca95c admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:50.103779 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a791f08-dda4-4716-939c-b5055ddca95c admin admin] PATH_INFO: `/v3/projects` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:50.104535 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a791f08-dda4-4716-939c-b5055ddca95c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:50.106498 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a791f08-dda4-4716-939c-b5055ddca95c admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:50.111414 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:42:50.157692 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1140/2284] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jul 11 14:42:50 2022] POST /identity/v3/projects => generated 387 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:42:50.158997 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01739a71-532a-45da-8d9a-827265f8a4e2 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:50.170817 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01739a71-532a-45da-8d9a-827265f8a4e2 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:50.241175 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a5d997-3f4c-4635-be31-ea0e5ec6de8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:50.242247 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a5d997-3f4c-4635-be31-ea0e5ec6de8b admin admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:50.242614 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a5d997-3f4c-4635-be31-ea0e5ec6de8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:50.242942 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a5d997-3f4c-4635-be31-ea0e5ec6de8b admin admin] PATH_INFO: `/v3/users` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:50.243735 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a5d997-3f4c-4635-be31-ea0e5ec6de8b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:50.245699 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a5d997-3f4c-4635-be31-ea0e5ec6de8b admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:50.268855 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1145/2285] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jul 11 14:42:50 2022] POST /identity/v3/users => generated 294 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:42:50.273823 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a791f08-dda4-4716-939c-b5055ddca95c admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:50.285211 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a791f08-dda4-4716-939c-b5055ddca95c admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:50.290671 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ce70a6-af4a-4b66-b3e7-2cde116225cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:50.291366 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ce70a6-af4a-4b66-b3e7-2cde116225cd admin admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:50.291652 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ce70a6-af4a-4b66-b3e7-2cde116225cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:50.291926 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ce70a6-af4a-4b66-b3e7-2cde116225cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:50.292716 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ce70a6-af4a-4b66-b3e7-2cde116225cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:50.294382 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ce70a6-af4a-4b66-b3e7-2cde116225cd admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:50.311913 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1141/2286] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:42:50 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:42:50.316883 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a5d997-3f4c-4635-be31-ea0e5ec6de8b admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:50.328609 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a5d997-3f4c-4635-be31-ea0e5ec6de8b admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:50.336516 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f99c3e-836a-4697-910b-a79ec765fd47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:50.337261 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f99c3e-836a-4697-910b-a79ec765fd47 admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:50.337648 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f99c3e-836a-4697-910b-a79ec765fd47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:50.337974 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f99c3e-836a-4697-910b-a79ec765fd47 admin admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:50.338876 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f99c3e-836a-4697-910b-a79ec765fd47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:50.340924 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f99c3e-836a-4697-910b-a79ec765fd47 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:50.355253 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1146/2287] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:42:50 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:42:50.359868 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ce70a6-af4a-4b66-b3e7-2cde116225cd admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:50.372324 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ce70a6-af4a-4b66-b3e7-2cde116225cd admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:50.377746 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a12b39-4409-45f3-a8dd-6aeb94e284ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:50.378663 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a12b39-4409-45f3-a8dd-6aeb94e284ec admin admin] REQUEST_METHOD: `PUT` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:50.378975 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a12b39-4409-45f3-a8dd-6aeb94e284ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:50.379297 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a12b39-4409-45f3-a8dd-6aeb94e284ec admin admin] PATH_INFO: `/v3/projects/8983f0550c3c43519cfb5276d68ee5ad/users/7c349832b46942b0b16b76304c32a658/roles/8eff41f243c843ed95505a488ca6eada` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:50.406909 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a12b39-4409-45f3-a8dd-6aeb94e284ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=8983f0550c3c43519cfb5276d68ee5ad, user_id=7c349832b46942b0b16b76304c32a658, role_id=8eff41f243c843ed95505a488ca6eada)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:50.409606 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a12b39-4409-45f3-a8dd-6aeb94e284ec admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:50.426668 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1142/2288] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jul 11 14:42:50 2022] PUT /identity/v3/projects/8983f0550c3c43519cfb5276d68ee5ad/users/7c349832b46942b0b16b76304c32a658/roles/8eff41f243c843ed95505a488ca6eada => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:42:50.437536 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b5c624-ca9c-4534-9ca7-66226f345da0 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:50.438187 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b5c624-ca9c-4534-9ca7-66226f345da0 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:50.439175 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b5c624-ca9c-4534-9ca7-66226f345da0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:50.472605 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-a9b5c624-ca9c-4534-9ca7-66226f345da0 None None] MFA Rules not processed for user `7c349832b46942b0b16b76304c32a658`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:42:50.473997 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-a9b5c624-ca9c-4534-9ca7-66226f345da0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:42:50.545673 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:42:50.558469 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1147/2289] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:42:50 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:42:50.563516 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a12b39-4409-45f3-a8dd-6aeb94e284ec admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:50.638372 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a12b39-4409-45f3-a8dd-6aeb94e284ec admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:50.643738 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaff436b-5f1f-45a1-bbab-c0d26474a0c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:50.644445 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaff436b-5f1f-45a1-bbab-c0d26474a0c5 admin admin] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:50.644738 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaff436b-5f1f-45a1-bbab-c0d26474a0c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:50.645021 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaff436b-5f1f-45a1-bbab-c0d26474a0c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:50.645729 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaff436b-5f1f-45a1-bbab-c0d26474a0c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:50.648390 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaff436b-5f1f-45a1-bbab-c0d26474a0c5 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:50.676155 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1143/2290] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jul 11 14:42:50 2022] POST /identity/v3/projects => generated 385 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:42:50.680553 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b5c624-ca9c-4534-9ca7-66226f345da0 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:50.692587 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b5c624-ca9c-4534-9ca7-66226f345da0 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:50.759925 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e902fc2-a699-4806-9fac-0496329c12eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:50.760655 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e902fc2-a699-4806-9fac-0496329c12eb admin admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:50.760944 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e902fc2-a699-4806-9fac-0496329c12eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:50.761221 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e902fc2-a699-4806-9fac-0496329c12eb admin admin] PATH_INFO: `/v3/users` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:50.761944 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e902fc2-a699-4806-9fac-0496329c12eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:50.763972 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e902fc2-a699-4806-9fac-0496329c12eb admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:50.791435 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1148/2291] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jul 11 14:42:50 2022] POST /identity/v3/users => generated 293 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:42:50.795527 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaff436b-5f1f-45a1-bbab-c0d26474a0c5 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:50.808002 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaff436b-5f1f-45a1-bbab-c0d26474a0c5 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:50.813226 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b0b736-7433-418d-bcad-b637b338c915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:50.814165 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b0b736-7433-418d-bcad-b637b338c915 admin admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:50.814451 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b0b736-7433-418d-bcad-b637b338c915 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:50.814731 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b0b736-7433-418d-bcad-b637b338c915 admin admin] PATH_INFO: `/v3/roles` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:50.815472 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b0b736-7433-418d-bcad-b637b338c915 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:50.817132 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b0b736-7433-418d-bcad-b637b338c915 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:50.830903 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1144/2292] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:42:50 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:42:50.835949 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e902fc2-a699-4806-9fac-0496329c12eb admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:50.846232 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e902fc2-a699-4806-9fac-0496329c12eb admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:50.851851 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6216b495-0350-4624-b003-29106f269846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:50.852583 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6216b495-0350-4624-b003-29106f269846 admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:50.852866 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6216b495-0350-4624-b003-29106f269846 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:50.853143 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6216b495-0350-4624-b003-29106f269846 admin admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:50.853878 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6216b495-0350-4624-b003-29106f269846 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:50.855722 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6216b495-0350-4624-b003-29106f269846 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:50.868640 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1149/2293] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:42:50 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:42:50.873310 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b0b736-7433-418d-bcad-b637b338c915 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:50.887441 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b0b736-7433-418d-bcad-b637b338c915 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:50.892651 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da17475-7090-4b44-a067-106e173c10b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:50.893477 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da17475-7090-4b44-a067-106e173c10b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:50.893755 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da17475-7090-4b44-a067-106e173c10b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:50.894030 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da17475-7090-4b44-a067-106e173c10b5 admin admin] PATH_INFO: `/v3/projects/dd3efa20ca4948c68ddd85d4a46d0650/users/481f83e706f04285ab8b7cdeb12d1080/roles/8eff41f243c843ed95505a488ca6eada` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:50.911700 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da17475-7090-4b44-a067-106e173c10b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd3efa20ca4948c68ddd85d4a46d0650, user_id=481f83e706f04285ab8b7cdeb12d1080, role_id=8eff41f243c843ed95505a488ca6eada)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:50.914646 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da17475-7090-4b44-a067-106e173c10b5 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:50.931973 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1145/2294] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jul 11 14:42:50 2022] PUT /identity/v3/projects/dd3efa20ca4948c68ddd85d4a46d0650/users/481f83e706f04285ab8b7cdeb12d1080/roles/8eff41f243c843ed95505a488ca6eada => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:42:50.946149 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562c670b-3a93-4434-8e07-82684c9557b4 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:50.946694 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562c670b-3a93-4434-8e07-82684c9557b4 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:50.946843 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562c670b-3a93-4434-8e07-82684c9557b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:50.980719 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-562c670b-3a93-4434-8e07-82684c9557b4 None None] MFA Rules not processed for user `481f83e706f04285ab8b7cdeb12d1080`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:42:50.982245 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-562c670b-3a93-4434-8e07-82684c9557b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:42:51.058277 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1150/2295] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:42:50 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:42:51.062332 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da17475-7090-4b44-a067-106e173c10b5 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:51.137071 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da17475-7090-4b44-a067-106e173c10b5 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:51.141859 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da8a047-e1e5-485c-9c81-40a6efa1cedf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:51.142526 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da8a047-e1e5-485c-9c81-40a6efa1cedf admin admin] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:51.142864 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da8a047-e1e5-485c-9c81-40a6efa1cedf admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:51.143085 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da8a047-e1e5-485c-9c81-40a6efa1cedf admin admin] PATH_INFO: `/v3/projects` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:51.143801 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da8a047-e1e5-485c-9c81-40a6efa1cedf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:51.145785 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da8a047-e1e5-485c-9c81-40a6efa1cedf admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:51.153126 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:42:51.177434 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1146/2296] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jul 11 14:42:51 2022] POST /identity/v3/projects => generated 383 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:42:51.182250 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562c670b-3a93-4434-8e07-82684c9557b4 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:51.194005 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562c670b-3a93-4434-8e07-82684c9557b4 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:51.260673 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7466e8f-c0f9-4629-b424-70df5acfe64d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:51.261406 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7466e8f-c0f9-4629-b424-70df5acfe64d admin admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:51.261612 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7466e8f-c0f9-4629-b424-70df5acfe64d admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:51.261884 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7466e8f-c0f9-4629-b424-70df5acfe64d admin admin] PATH_INFO: `/v3/users` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:51.262579 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7466e8f-c0f9-4629-b424-70df5acfe64d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:51.264544 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7466e8f-c0f9-4629-b424-70df5acfe64d admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:51.274080 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:42:51.289002 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1151/2297] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jul 11 14:42:51 2022] POST /identity/v3/users => generated 298 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:42:51.293112 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da8a047-e1e5-485c-9c81-40a6efa1cedf admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:51.304751 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da8a047-e1e5-485c-9c81-40a6efa1cedf admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:51.309673 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8c27ee-c4cb-4ac2-9c0c-a2447160a3cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:51.310386 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8c27ee-c4cb-4ac2-9c0c-a2447160a3cb admin admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:51.310780 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8c27ee-c4cb-4ac2-9c0c-a2447160a3cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:51.311100 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8c27ee-c4cb-4ac2-9c0c-a2447160a3cb admin admin] PATH_INFO: `/v3/roles` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:51.312003 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8c27ee-c4cb-4ac2-9c0c-a2447160a3cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:51.313950 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8c27ee-c4cb-4ac2-9c0c-a2447160a3cb admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:51.325812 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1147/2298] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:42:51 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:42:51.330160 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7466e8f-c0f9-4629-b424-70df5acfe64d admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:51.341143 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7466e8f-c0f9-4629-b424-70df5acfe64d admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:51.346678 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5458454-52d1-4ab7-8bbb-a5b068f46297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:51.347585 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5458454-52d1-4ab7-8bbb-a5b068f46297 admin admin] REQUEST_METHOD: `PUT` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:51.347865 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5458454-52d1-4ab7-8bbb-a5b068f46297 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:51.348145 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5458454-52d1-4ab7-8bbb-a5b068f46297 admin admin] PATH_INFO: `/v3/projects/2f8385abe7714bad997d42f6d1a0a8ad/users/2e8b1e8923784035bbd878f03bd4ca5c/roles/b46df176b0fe479da63c318db225bed4` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:51.364501 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5458454-52d1-4ab7-8bbb-a5b068f46297 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f8385abe7714bad997d42f6d1a0a8ad, user_id=2e8b1e8923784035bbd878f03bd4ca5c, role_id=b46df176b0fe479da63c318db225bed4)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:51.367895 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5458454-52d1-4ab7-8bbb-a5b068f46297 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:51.382832 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1152/2299] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jul 11 14:42:51 2022] PUT /identity/v3/projects/2f8385abe7714bad997d42f6d1a0a8ad/users/2e8b1e8923784035bbd878f03bd4ca5c/roles/b46df176b0fe479da63c318db225bed4 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:42:51.387058 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8c27ee-c4cb-4ac2-9c0c-a2447160a3cb admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:51.398315 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8c27ee-c4cb-4ac2-9c0c-a2447160a3cb admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:51.460645 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52544f8-bd47-410e-8078-bf54aa7bd126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:51.461318 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52544f8-bd47-410e-8078-bf54aa7bd126 admin admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:51.461606 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52544f8-bd47-410e-8078-bf54aa7bd126 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:51.461882 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52544f8-bd47-410e-8078-bf54aa7bd126 admin admin] PATH_INFO: `/v3/roles` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:51.462629 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52544f8-bd47-410e-8078-bf54aa7bd126 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:51.464530 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52544f8-bd47-410e-8078-bf54aa7bd126 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:51.474653 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1148/2300] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:42:51 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:42:51.479550 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5458454-52d1-4ab7-8bbb-a5b068f46297 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:51.489834 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5458454-52d1-4ab7-8bbb-a5b068f46297 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:51.494711 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07515acd-a7f3-4d98-adfa-8d29cf474423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:51.495800 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07515acd-a7f3-4d98-adfa-8d29cf474423 admin admin] REQUEST_METHOD: `PUT` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:51.495905 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07515acd-a7f3-4d98-adfa-8d29cf474423 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:51.496164 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07515acd-a7f3-4d98-adfa-8d29cf474423 admin admin] PATH_INFO: `/v3/projects/2f8385abe7714bad997d42f6d1a0a8ad/users/2e8b1e8923784035bbd878f03bd4ca5c/roles/b46df176b0fe479da63c318db225bed4` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:51.499609 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07515acd-a7f3-4d98-adfa-8d29cf474423 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f8385abe7714bad997d42f6d1a0a8ad, user_id=2e8b1e8923784035bbd878f03bd4ca5c, role_id=b46df176b0fe479da63c318db225bed4)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:51.502300 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07515acd-a7f3-4d98-adfa-8d29cf474423 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:51.513986 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1153/2301] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jul 11 14:42:51 2022] PUT /identity/v3/projects/2f8385abe7714bad997d42f6d1a0a8ad/users/2e8b1e8923784035bbd878f03bd4ca5c/roles/b46df176b0fe479da63c318db225bed4 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:42:51.525019 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec4fd7b-2b36-4d5f-bd04-9aab4132c281 None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:51.525307 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec4fd7b-2b36-4d5f-bd04-9aab4132c281 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:51.525585 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec4fd7b-2b36-4d5f-bd04-9aab4132c281 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:51.552288 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-1ec4fd7b-2b36-4d5f-bd04-9aab4132c281 None None] MFA Rules not processed for user `2e8b1e8923784035bbd878f03bd4ca5c`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:42:51.553558 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-1ec4fd7b-2b36-4d5f-bd04-9aab4132c281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:42:51.624232 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1149/2302] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:42:51 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:42:51.635292 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07515acd-a7f3-4d98-adfa-8d29cf474423 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:51.637029 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-07515acd-a7f3-4d98-adfa-8d29cf474423 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:42:51.695497 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07515acd-a7f3-4d98-adfa-8d29cf474423 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:51.699187 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cedd0f-a206-41f1-acab-880ce3d36ebe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '868e7c2dec264512b972c8736d659c34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:51.699830 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cedd0f-a206-41f1-acab-880ce3d36ebe service cinder] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:51.700112 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cedd0f-a206-41f1-acab-880ce3d36ebe service cinder] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:51.700418 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cedd0f-a206-41f1-acab-880ce3d36ebe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:51.710713 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cedd0f-a206-41f1-acab-880ce3d36ebe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:51.712145 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cedd0f-a206-41f1-acab-880ce3d36ebe service cinder] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:51.721624 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1154/2303] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:42:51 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:42:52.348968 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec4fd7b-2b36-4d5f-bd04-9aab4132c281 None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:52.361881 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec4fd7b-2b36-4d5f-bd04-9aab4132c281 None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:52.366532 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b75376-3988-486c-b216-a9fc1ed53dd4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '868e7c2dec264512b972c8736d659c34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:52.367243 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b75376-3988-486c-b216-a9fc1ed53dd4 service cinder] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:52.367527 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b75376-3988-486c-b216-a9fc1ed53dd4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:52.367797 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b75376-3988-486c-b216-a9fc1ed53dd4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:52.430505 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:42:52.434008 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b75376-3988-486c-b216-a9fc1ed53dd4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:52.435581 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b75376-3988-486c-b216-a9fc1ed53dd4 service cinder] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:52.447746 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1150/2304] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:42:52 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:42:57.615968 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cedd0f-a206-41f1-acab-880ce3d36ebe service cinder] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:57.617472 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-b8cedd0f-a206-41f1-acab-880ce3d36ebe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:42:57.628649 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cedd0f-a206-41f1-acab-880ce3d36ebe service cinder] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:57.632773 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390c9326-cc5f-4582-b048-2de501c6143d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '868e7c2dec264512b972c8736d659c34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:57.633420 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390c9326-cc5f-4582-b048-2de501c6143d service cinder] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:57.633786 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390c9326-cc5f-4582-b048-2de501c6143d service cinder] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:57.633976 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390c9326-cc5f-4582-b048-2de501c6143d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:57.699837 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390c9326-cc5f-4582-b048-2de501c6143d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:57.701389 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390c9326-cc5f-4582-b048-2de501c6143d service cinder] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:57.713545 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1155/2305] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:42:57 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:42:59.934655 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b75376-3988-486c-b216-a9fc1ed53dd4 service cinder] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:59.998495 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b75376-3988-486c-b216-a9fc1ed53dd4 service cinder] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:43:00.002948 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081a9fb9-50cb-4ce2-9f88-b4ffa56ad285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:43:00.003816 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081a9fb9-50cb-4ce2-9f88-b4ffa56ad285 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:43:00.004097 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081a9fb9-50cb-4ce2-9f88-b4ffa56ad285 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:43:00.004394 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081a9fb9-50cb-4ce2-9f88-b4ffa56ad285 admin admin] PATH_INFO: `/v3/users/7c349832b46942b0b16b76304c32a658` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:43:00.005585 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081a9fb9-50cb-4ce2-9f88-b4ffa56ad285 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c349832b46942b0b16b76304c32a658)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:43:00.008296 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081a9fb9-50cb-4ce2-9f88-b4ffa56ad285 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:43:00.059733 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-081a9fb9-50cb-4ce2-9f88-b4ffa56ad285 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c349832b46942b0b16b76304c32a658'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:43:00.069446 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-081a9fb9-50cb-4ce2-9f88-b4ffa56ad285 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c349832b46942b0b16b76304c32a658'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:43:00.077506 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-081a9fb9-50cb-4ce2-9f88-b4ffa56ad285 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c349832b46942b0b16b76304c32a658'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:43:00.078171 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-081a9fb9-50cb-4ce2-9f88-b4ffa56ad285 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c349832b46942b0b16b76304c32a658'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:43:00.080433 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-081a9fb9-50cb-4ce2-9f88-b4ffa56ad285 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c349832b46942b0b16b76304c32a658'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:43:00.103911 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1151/2306] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jul 11 14:42:59 2022] DELETE /identity/v3/users/7c349832b46942b0b16b76304c32a658 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:43:00.108197 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9765520-fbf7-40ce-8dfc-50b9fa59c101 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:43:00.108706 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9765520-fbf7-40ce-8dfc-50b9fa59c101 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:43:00.108835 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9765520-fbf7-40ce-8dfc-50b9fa59c101 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:43:00.127581 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-f9765520-fbf7-40ce-8dfc-50b9fa59c101 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:43:00.128817 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-f9765520-fbf7-40ce-8dfc-50b9fa59c101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:43:00.183603 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:43:00.196991 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1156/2307] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:43:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:43:00.207332 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081a9fb9-50cb-4ce2-9f88-b4ffa56ad285 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:43:00.208888 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-081a9fb9-50cb-4ce2-9f88-b4ffa56ad285 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:43:00.270198 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081a9fb9-50cb-4ce2-9f88-b4ffa56ad285 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:43:00.274954 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73d7e1d-b386-4ff7-83c9-daffa0f4426e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20eede5ccd834862b00123310b5c3975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:43:00.275662 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73d7e1d-b386-4ff7-83c9-daffa0f4426e service neutron] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:43:00.275899 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73d7e1d-b386-4ff7-83c9-daffa0f4426e service neutron] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:43:00.276175 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73d7e1d-b386-4ff7-83c9-daffa0f4426e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:43:00.285459 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73d7e1d-b386-4ff7-83c9-daffa0f4426e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:43:00.286950 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73d7e1d-b386-4ff7-83c9-daffa0f4426e service neutron] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:43:00.296658 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1152/2308] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:43:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:43:00.584729 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9765520-fbf7-40ce-8dfc-50b9fa59c101 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:43:00.586252 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-f9765520-fbf7-40ce-8dfc-50b9fa59c101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:43:00.598710 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9765520-fbf7-40ce-8dfc-50b9fa59c101 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:43:00.604261 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55858201-e199-4e14-ae42-3ea4f760ed25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:43:00.605118 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55858201-e199-4e14-ae42-3ea4f760ed25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:43:00.605399 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55858201-e199-4e14-ae42-3ea4f760ed25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:43:00.605671 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55858201-e199-4e14-ae42-3ea4f760ed25 admin admin] PATH_INFO: `/v3/projects/8983f0550c3c43519cfb5276d68ee5ad` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:43:00.606856 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55858201-e199-4e14-ae42-3ea4f760ed25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8983f0550c3c43519cfb5276d68ee5ad)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:43:00.608802 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55858201-e199-4e14-ae42-3ea4f760ed25 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:43:00.657388 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-55858201-e199-4e14-ae42-3ea4f760ed25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8983f0550c3c43519cfb5276d68ee5ad', 'request_id': 'req-55858201-e199-4e14-ae42-3ea4f760ed25'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:43:00.663925 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-55858201-e199-4e14-ae42-3ea4f760ed25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8983f0550c3c43519cfb5276d68ee5ad', 'request_id': 'req-55858201-e199-4e14-ae42-3ea4f760ed25'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:43:00.670185 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-55858201-e199-4e14-ae42-3ea4f760ed25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8983f0550c3c43519cfb5276d68ee5ad', 'request_id': 'req-55858201-e199-4e14-ae42-3ea4f760ed25'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:43:00.683863 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-55858201-e199-4e14-ae42-3ea4f760ed25 admin admin] The token cache is being invalidate because project 8983f0550c3c43519cfb5276d68ee5ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:43:00.684150 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-55858201-e199-4e14-ae42-3ea4f760ed25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:43:00.684896 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-55858201-e199-4e14-ae42-3ea4f760ed25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:43:00.686346 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1157/2309] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jul 11 14:43:00 2022] DELETE /identity/v3/projects/8983f0550c3c43519cfb5276d68ee5ad => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:43:00.690563 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73d7e1d-b386-4ff7-83c9-daffa0f4426e service neutron] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:43:00.701584 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73d7e1d-b386-4ff7-83c9-daffa0f4426e service neutron] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:43:00.715250 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:43:00.775529 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976ff2fc-cdd4-455a-a466-4f5d1e042084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:43:00.776100 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976ff2fc-cdd4-455a-a466-4f5d1e042084 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:43:00.776476 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976ff2fc-cdd4-455a-a466-4f5d1e042084 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:43:00.776851 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976ff2fc-cdd4-455a-a466-4f5d1e042084 admin admin] PATH_INFO: `/v3/users/481f83e706f04285ab8b7cdeb12d1080` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:43:00.779028 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976ff2fc-cdd4-455a-a466-4f5d1e042084 admin admin] RBAC: Authorizing `identity:delete_user(user_id=481f83e706f04285ab8b7cdeb12d1080)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:43:00.781301 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976ff2fc-cdd4-455a-a466-4f5d1e042084 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:43:00.833609 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-976ff2fc-cdd4-455a-a466-4f5d1e042084 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '481f83e706f04285ab8b7cdeb12d1080'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:43:00.842864 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-976ff2fc-cdd4-455a-a466-4f5d1e042084 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '481f83e706f04285ab8b7cdeb12d1080'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:43:00.851554 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-976ff2fc-cdd4-455a-a466-4f5d1e042084 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '481f83e706f04285ab8b7cdeb12d1080'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:43:00.852219 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-976ff2fc-cdd4-455a-a466-4f5d1e042084 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '481f83e706f04285ab8b7cdeb12d1080'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:43:00.852830 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-976ff2fc-cdd4-455a-a466-4f5d1e042084 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '481f83e706f04285ab8b7cdeb12d1080'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:43:00.874643 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1153/2310] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jul 11 14:43:00 2022] DELETE /identity/v3/users/481f83e706f04285ab8b7cdeb12d1080 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:43:01.209665 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55858201-e199-4e14-ae42-3ea4f760ed25 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:43:01.212598 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-55858201-e199-4e14-ae42-3ea4f760ed25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:43:01.228500 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55858201-e199-4e14-ae42-3ea4f760ed25 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:43:01.316734 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dfa563-0cc0-434b-82e4-bc2996b9f881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:43:01.317609 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dfa563-0cc0-434b-82e4-bc2996b9f881 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:43:01.317891 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dfa563-0cc0-434b-82e4-bc2996b9f881 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:43:01.318385 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dfa563-0cc0-434b-82e4-bc2996b9f881 admin admin] PATH_INFO: `/v3/projects/dd3efa20ca4948c68ddd85d4a46d0650` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:43:01.319571 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dfa563-0cc0-434b-82e4-bc2996b9f881 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd3efa20ca4948c68ddd85d4a46d0650)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:43:01.321517 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dfa563-0cc0-434b-82e4-bc2996b9f881 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:43:01.373570 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-a6dfa563-0cc0-434b-82e4-bc2996b9f881 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd3efa20ca4948c68ddd85d4a46d0650', 'request_id': 'req-a6dfa563-0cc0-434b-82e4-bc2996b9f881'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:43:01.379900 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-a6dfa563-0cc0-434b-82e4-bc2996b9f881 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd3efa20ca4948c68ddd85d4a46d0650', 'request_id': 'req-a6dfa563-0cc0-434b-82e4-bc2996b9f881'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:43:01.388587 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-a6dfa563-0cc0-434b-82e4-bc2996b9f881 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd3efa20ca4948c68ddd85d4a46d0650', 'request_id': 'req-a6dfa563-0cc0-434b-82e4-bc2996b9f881'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:43:01.403199 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-a6dfa563-0cc0-434b-82e4-bc2996b9f881 admin admin] The token cache is being invalidate because project dd3efa20ca4948c68ddd85d4a46d0650 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:43:01.403505 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-a6dfa563-0cc0-434b-82e4-bc2996b9f881 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:43:01.404158 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-a6dfa563-0cc0-434b-82e4-bc2996b9f881 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:43:01.405792 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1158/2311] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jul 11 14:43:01 2022] DELETE /identity/v3/projects/dd3efa20ca4948c68ddd85d4a46d0650 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:43:01.409997 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976ff2fc-cdd4-455a-a466-4f5d1e042084 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:43:01.411415 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-976ff2fc-cdd4-455a-a466-4f5d1e042084 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:43:01.424756 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976ff2fc-cdd4-455a-a466-4f5d1e042084 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:43:01.502483 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf5973e-a137-44cb-be9a-148d1081c0c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:43:01.503962 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf5973e-a137-44cb-be9a-148d1081c0c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:43:01.504437 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf5973e-a137-44cb-be9a-148d1081c0c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:43:01.504920 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf5973e-a137-44cb-be9a-148d1081c0c6 admin admin] PATH_INFO: `/v3/users/2e8b1e8923784035bbd878f03bd4ca5c` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:43:01.507219 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf5973e-a137-44cb-be9a-148d1081c0c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e8b1e8923784035bbd878f03bd4ca5c)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:43:01.510080 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf5973e-a137-44cb-be9a-148d1081c0c6 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:43:01.570943 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:43:01.577384 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-adf5973e-a137-44cb-be9a-148d1081c0c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e8b1e8923784035bbd878f03bd4ca5c'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:43:01.586490 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-adf5973e-a137-44cb-be9a-148d1081c0c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e8b1e8923784035bbd878f03bd4ca5c'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:43:01.593858 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-adf5973e-a137-44cb-be9a-148d1081c0c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e8b1e8923784035bbd878f03bd4ca5c'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:43:01.594502 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-adf5973e-a137-44cb-be9a-148d1081c0c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e8b1e8923784035bbd878f03bd4ca5c'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:43:01.595080 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-adf5973e-a137-44cb-be9a-148d1081c0c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e8b1e8923784035bbd878f03bd4ca5c'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:43:01.613718 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1154/2312] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jul 11 14:43:01 2022] DELETE /identity/v3/users/2e8b1e8923784035bbd878f03bd4ca5c => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:43:01.899417 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dfa563-0cc0-434b-82e4-bc2996b9f881 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:43:01.900955 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-a6dfa563-0cc0-434b-82e4-bc2996b9f881 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:43:01.918120 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dfa563-0cc0-434b-82e4-bc2996b9f881 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:43:01.931788 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:43:01.996663 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e614d3-1206-4da6-a94e-9f6487ac0e37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:43:01.997686 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e614d3-1206-4da6-a94e-9f6487ac0e37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:43:01.998064 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e614d3-1206-4da6-a94e-9f6487ac0e37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:43:01.998438 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e614d3-1206-4da6-a94e-9f6487ac0e37 admin admin] PATH_INFO: `/v3/projects/2f8385abe7714bad997d42f6d1a0a8ad` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:43:01.999852 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e614d3-1206-4da6-a94e-9f6487ac0e37 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f8385abe7714bad997d42f6d1a0a8ad)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:43:02.001903 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e614d3-1206-4da6-a94e-9f6487ac0e37 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:43:02.059225 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-d7e614d3-1206-4da6-a94e-9f6487ac0e37 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f8385abe7714bad997d42f6d1a0a8ad', 'request_id': 'req-d7e614d3-1206-4da6-a94e-9f6487ac0e37'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:43:02.065799 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-d7e614d3-1206-4da6-a94e-9f6487ac0e37 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f8385abe7714bad997d42f6d1a0a8ad', 'request_id': 'req-d7e614d3-1206-4da6-a94e-9f6487ac0e37'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:43:02.073496 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-d7e614d3-1206-4da6-a94e-9f6487ac0e37 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f8385abe7714bad997d42f6d1a0a8ad', 'request_id': 'req-d7e614d3-1206-4da6-a94e-9f6487ac0e37'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:43:02.087952 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-d7e614d3-1206-4da6-a94e-9f6487ac0e37 admin admin] The token cache is being invalidate because project 2f8385abe7714bad997d42f6d1a0a8ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:43:02.088275 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-d7e614d3-1206-4da6-a94e-9f6487ac0e37 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:43:02.088962 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-d7e614d3-1206-4da6-a94e-9f6487ac0e37 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:43:02.090523 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1159/2313] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jul 11 14:43:01 2022] DELETE /identity/v3/projects/2f8385abe7714bad997d42f6d1a0a8ad => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:43:02.096457 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ddc841-c1ca-4d35-91c4-6a8a32145e8d None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:43:02.096743 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ddc841-c1ca-4d35-91c4-6a8a32145e8d None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:43:02.097068 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ddc841-c1ca-4d35-91c4-6a8a32145e8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:43:02.116088 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-f8ddc841-c1ca-4d35-91c4-6a8a32145e8d None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:43:02.117314 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-f8ddc841-c1ca-4d35-91c4-6a8a32145e8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:43:02.191691 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1155/2314] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:43:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:43:02.201373 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75409383-b349-4905-b57e-19f5ca44fcdb None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:43:02.201666 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75409383-b349-4905-b57e-19f5ca44fcdb None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:43:02.201948 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75409383-b349-4905-b57e-19f5ca44fcdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:43:02.221461 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-75409383-b349-4905-b57e-19f5ca44fcdb None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:43:02.222782 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-75409383-b349-4905-b57e-19f5ca44fcdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:43:02.231972 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1160/2315] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:43:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:43:02.237767 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ddc841-c1ca-4d35-91c4-6a8a32145e8d None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:43:02.251812 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ddc841-c1ca-4d35-91c4-6a8a32145e8d None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:43:02.262340 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff880601-3a4c-4975-89e5-6a4802224762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:43:02.263037 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff880601-3a4c-4975-89e5-6a4802224762 admin admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:43:02.263327 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff880601-3a4c-4975-89e5-6a4802224762 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:43:02.263640 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff880601-3a4c-4975-89e5-6a4802224762 admin admin] PATH_INFO: `/v3/domains` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:43:02.264481 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff880601-3a4c-4975-89e5-6a4802224762 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:43:02.264808 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff880601-3a4c-4975-89e5-6a4802224762 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:43:02.266673 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff880601-3a4c-4975-89e5-6a4802224762 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:43:02.281664 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1156/2316] 10.222.0.70 () {58 vars in 1152 bytes} [Mon Jul 11 14:43:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:43:02.286215 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75409383-b349-4905-b57e-19f5ca44fcdb None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:43:02.296069 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75409383-b349-4905-b57e-19f5ca44fcdb None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:43:02.301712 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea69b51f-6729-429d-87ea-032efb2e9216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:43:02.301884 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea69b51f-6729-429d-87ea-032efb2e9216 admin admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:43:02.302172 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea69b51f-6729-429d-87ea-032efb2e9216 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:43:02.303095 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea69b51f-6729-429d-87ea-032efb2e9216 admin admin] PATH_INFO: `/v3/projects` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:43:02.303834 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea69b51f-6729-429d-87ea-032efb2e9216 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:43:02.306121 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea69b51f-6729-429d-87ea-032efb2e9216 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:43:02.340784 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1161/2317] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jul 11 14:43:02 2022] POST /identity/v3/projects => generated 383 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:43:02.341957 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff880601-3a4c-4975-89e5-6a4802224762 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:43:02.353874 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff880601-3a4c-4975-89e5-6a4802224762 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:43:02.422080 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd29fab-8c6d-4393-a531-1f98564eb41c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:43:02.423134 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd29fab-8c6d-4393-a531-1f98564eb41c admin admin] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:43:02.423634 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd29fab-8c6d-4393-a531-1f98564eb41c admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:43:02.423957 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd29fab-8c6d-4393-a531-1f98564eb41c admin admin] PATH_INFO: `/v3/users` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:43:02.424829 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd29fab-8c6d-4393-a531-1f98564eb41c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:43:02.426930 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd29fab-8c6d-4393-a531-1f98564eb41c admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:43:02.452772 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1157/2318] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jul 11 14:43:02 2022] POST /identity/v3/users => generated 292 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:43:02.456916 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea69b51f-6729-429d-87ea-032efb2e9216 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:43:02.468289 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea69b51f-6729-429d-87ea-032efb2e9216 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:43:02.474236 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4522a22b-7a43-468c-8241-919e20ff267d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:43:02.474842 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4522a22b-7a43-468c-8241-919e20ff267d admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:43:02.475294 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4522a22b-7a43-468c-8241-919e20ff267d admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:43:02.475580 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4522a22b-7a43-468c-8241-919e20ff267d admin admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:43:02.476352 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4522a22b-7a43-468c-8241-919e20ff267d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:43:02.477975 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4522a22b-7a43-468c-8241-919e20ff267d admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:43:02.492248 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1162/2319] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:43:02 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:43:02.494092 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd29fab-8c6d-4393-a531-1f98564eb41c admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:43:02.505291 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd29fab-8c6d-4393-a531-1f98564eb41c admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:43:02.511494 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed2c773-4591-4acb-a70c-5c6effe36ee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:43:02.512280 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed2c773-4591-4acb-a70c-5c6effe36ee1 admin admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:43:02.512569 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed2c773-4591-4acb-a70c-5c6effe36ee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:43:02.513224 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed2c773-4591-4acb-a70c-5c6effe36ee1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:43:02.513974 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed2c773-4591-4acb-a70c-5c6effe36ee1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:43:02.515835 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed2c773-4591-4acb-a70c-5c6effe36ee1 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:43:02.527702 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1158/2320] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:43:02 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:43:02.532544 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4522a22b-7a43-468c-8241-919e20ff267d admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:43:02.561167 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4522a22b-7a43-468c-8241-919e20ff267d admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:43:02.566833 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191eaaff-d1d4-4abc-8ca1-0cd8c1d09df4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:43:02.567752 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191eaaff-d1d4-4abc-8ca1-0cd8c1d09df4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:43:02.568038 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191eaaff-d1d4-4abc-8ca1-0cd8c1d09df4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:43:02.568862 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191eaaff-d1d4-4abc-8ca1-0cd8c1d09df4 admin admin] PATH_INFO: `/v3/projects/e9a37368ba6c4fe09006873a0ff2911b/users/5a298a3e8de740889670c25ca475c91d/roles/8eff41f243c843ed95505a488ca6eada` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:43:02.593038 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191eaaff-d1d4-4abc-8ca1-0cd8c1d09df4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9a37368ba6c4fe09006873a0ff2911b, user_id=5a298a3e8de740889670c25ca475c91d, role_id=8eff41f243c843ed95505a488ca6eada)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:43:02.595947 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191eaaff-d1d4-4abc-8ca1-0cd8c1d09df4 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:43:02.613441 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1163/2321] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jul 11 14:43:02 2022] PUT /identity/v3/projects/e9a37368ba6c4fe09006873a0ff2911b/users/5a298a3e8de740889670c25ca475c91d/roles/8eff41f243c843ed95505a488ca6eada => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:43:02.626393 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455f2966-8be6-4850-9e47-1deeb9714e30 None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:43:02.627004 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455f2966-8be6-4850-9e47-1deeb9714e30 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:43:02.627211 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455f2966-8be6-4850-9e47-1deeb9714e30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:43:02.656628 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-455f2966-8be6-4850-9e47-1deeb9714e30 None None] MFA Rules not processed for user `5a298a3e8de740889670c25ca475c91d`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:43:02.657848 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-455f2966-8be6-4850-9e47-1deeb9714e30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:43:02.669341 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:43:02.739418 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1159/2322] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:43:02 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:43:02.752476 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191eaaff-d1d4-4abc-8ca1-0cd8c1d09df4 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:43:02.754340 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-191eaaff-d1d4-4abc-8ca1-0cd8c1d09df4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:43:02.800388 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:43:02.819650 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191eaaff-d1d4-4abc-8ca1-0cd8c1d09df4 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:43:02.823493 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43efa084-75e6-48b0-be32-b6031c12dc8d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '868e7c2dec264512b972c8736d659c34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:43:02.824159 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43efa084-75e6-48b0-be32-b6031c12dc8d service cinder] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:43:02.824478 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43efa084-75e6-48b0-be32-b6031c12dc8d service cinder] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:43:02.824761 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43efa084-75e6-48b0-be32-b6031c12dc8d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:43:02.842773 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43efa084-75e6-48b0-be32-b6031c12dc8d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:43:02.844417 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43efa084-75e6-48b0-be32-b6031c12dc8d service cinder] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:43:02.854670 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1164/2323] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:43:02 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:43:02.876054 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455f2966-8be6-4850-9e47-1deeb9714e30 None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:43:02.950786 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455f2966-8be6-4850-9e47-1deeb9714e30 None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:43:02.955351 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eac9ad6-1da2-4ca6-b7e3-bb3ccd1821b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:43:02.956243 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eac9ad6-1da2-4ca6-b7e3-bb3ccd1821b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:43:02.956529 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eac9ad6-1da2-4ca6-b7e3-bb3ccd1821b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:43:02.956805 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eac9ad6-1da2-4ca6-b7e3-bb3ccd1821b6 admin admin] PATH_INFO: `/v3/users/5a298a3e8de740889670c25ca475c91d` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:43:02.958005 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eac9ad6-1da2-4ca6-b7e3-bb3ccd1821b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a298a3e8de740889670c25ca475c91d)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:43:02.960006 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eac9ad6-1da2-4ca6-b7e3-bb3ccd1821b6 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:43:03.014262 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-8eac9ad6-1da2-4ca6-b7e3-bb3ccd1821b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a298a3e8de740889670c25ca475c91d'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:43:03.022713 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-8eac9ad6-1da2-4ca6-b7e3-bb3ccd1821b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a298a3e8de740889670c25ca475c91d'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:43:03.032159 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-8eac9ad6-1da2-4ca6-b7e3-bb3ccd1821b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a298a3e8de740889670c25ca475c91d'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:43:03.033235 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-8eac9ad6-1da2-4ca6-b7e3-bb3ccd1821b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a298a3e8de740889670c25ca475c91d'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:43:03.034010 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-8eac9ad6-1da2-4ca6-b7e3-bb3ccd1821b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a298a3e8de740889670c25ca475c91d'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:43:03.060223 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1160/2324] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jul 11 14:43:02 2022] DELETE /identity/v3/users/5a298a3e8de740889670c25ca475c91d => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:43:03.065740 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868e6461-8067-4658-86ae-e4d849e8d1cf None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:43:03.066158 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868e6461-8067-4658-86ae-e4d849e8d1cf None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:43:03.066436 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868e6461-8067-4658-86ae-e4d849e8d1cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:43:03.088170 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-868e6461-8067-4658-86ae-e4d849e8d1cf None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:43:03.090268 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-868e6461-8067-4658-86ae-e4d849e8d1cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:43:03.158740 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1165/2325] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:43:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:43:03.168498 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eac9ad6-1da2-4ca6-b7e3-bb3ccd1821b6 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:43:03.170005 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-8eac9ad6-1da2-4ca6-b7e3-bb3ccd1821b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:43:03.207526 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:43:03.237714 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eac9ad6-1da2-4ca6-b7e3-bb3ccd1821b6 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:43:03.241551 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d463bd-d8f2-440f-96be-b2477a489b3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20eede5ccd834862b00123310b5c3975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:43:03.242248 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d463bd-d8f2-440f-96be-b2477a489b3c service neutron] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:43:03.242586 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d463bd-d8f2-440f-96be-b2477a489b3c service neutron] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:43:03.242879 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d463bd-d8f2-440f-96be-b2477a489b3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:43:03.253350 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d463bd-d8f2-440f-96be-b2477a489b3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:43:03.254816 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d463bd-d8f2-440f-96be-b2477a489b3c service neutron] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:43:03.265853 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1161/2326] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:43:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:43:03.541712 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868e6461-8067-4658-86ae-e4d849e8d1cf None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:43:03.543916 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-868e6461-8067-4658-86ae-e4d849e8d1cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:43:03.561990 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868e6461-8067-4658-86ae-e4d849e8d1cf None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:43:03.569615 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4edb1e-2d8e-4531-8a5d-9eac3b2be77b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:43:03.570815 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4edb1e-2d8e-4531-8a5d-9eac3b2be77b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:43:03.571264 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4edb1e-2d8e-4531-8a5d-9eac3b2be77b admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:43:03.571704 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4edb1e-2d8e-4531-8a5d-9eac3b2be77b admin admin] PATH_INFO: `/v3/projects/e9a37368ba6c4fe09006873a0ff2911b` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:43:03.573460 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4edb1e-2d8e-4531-8a5d-9eac3b2be77b admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9a37368ba6c4fe09006873a0ff2911b)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:43:03.575721 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4edb1e-2d8e-4531-8a5d-9eac3b2be77b admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:43:03.639577 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-2d4edb1e-2d8e-4531-8a5d-9eac3b2be77b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9a37368ba6c4fe09006873a0ff2911b', 'request_id': 'req-2d4edb1e-2d8e-4531-8a5d-9eac3b2be77b'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:43:03.645489 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-2d4edb1e-2d8e-4531-8a5d-9eac3b2be77b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9a37368ba6c4fe09006873a0ff2911b', 'request_id': 'req-2d4edb1e-2d8e-4531-8a5d-9eac3b2be77b'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:43:03.652265 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-2d4edb1e-2d8e-4531-8a5d-9eac3b2be77b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9a37368ba6c4fe09006873a0ff2911b', 'request_id': 'req-2d4edb1e-2d8e-4531-8a5d-9eac3b2be77b'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:43:03.665879 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-2d4edb1e-2d8e-4531-8a5d-9eac3b2be77b admin admin] The token cache is being invalidate because project e9a37368ba6c4fe09006873a0ff2911b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:43:03.666168 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-2d4edb1e-2d8e-4531-8a5d-9eac3b2be77b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:43:03.666936 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-2d4edb1e-2d8e-4531-8a5d-9eac3b2be77b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:43:03.668717 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1166/2327] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jul 11 14:43:03 2022] DELETE /identity/v3/projects/e9a37368ba6c4fe09006873a0ff2911b => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:43:03.674559 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ad5931-4c3a-449b-927c-40221ca21479 None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:43:03.675085 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ad5931-4c3a-449b-927c-40221ca21479 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:43:03.675449 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ad5931-4c3a-449b-927c-40221ca21479 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:43:03.698261 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-f0ad5931-4c3a-449b-927c-40221ca21479 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:43:03.699595 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-f0ad5931-4c3a-449b-927c-40221ca21479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:43:03.775136 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1162/2328] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:43:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:43:03.782801 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7ae2d7-e373-477f-9367-4f30024bedaa None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:43:03.783089 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7ae2d7-e373-477f-9367-4f30024bedaa None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:43:03.783370 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7ae2d7-e373-477f-9367-4f30024bedaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:43:03.803117 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-ab7ae2d7-e373-477f-9367-4f30024bedaa None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:43:03.804393 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-ab7ae2d7-e373-477f-9367-4f30024bedaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:43:03.812550 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1167/2329] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:43:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:43:03.817078 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ad5931-4c3a-449b-927c-40221ca21479 None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:43:03.827741 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ad5931-4c3a-449b-927c-40221ca21479 None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:43:03.832479 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951b4aa2-af80-406a-9c42-6114c693377b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:43:03.833147 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951b4aa2-af80-406a-9c42-6114c693377b admin admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:43:03.833429 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951b4aa2-af80-406a-9c42-6114c693377b admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:43:03.833741 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951b4aa2-af80-406a-9c42-6114c693377b admin admin] PATH_INFO: `/v3/domains` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:43:03.834425 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951b4aa2-af80-406a-9c42-6114c693377b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:43:03.834733 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951b4aa2-af80-406a-9c42-6114c693377b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:43:03.836382 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951b4aa2-af80-406a-9c42-6114c693377b admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:43:03.847804 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1163/2330] 10.222.0.70 () {58 vars in 1152 bytes} [Mon Jul 11 14:43:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:43:03.852944 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7ae2d7-e373-477f-9367-4f30024bedaa None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:43:03.862591 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7ae2d7-e373-477f-9367-4f30024bedaa None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:43:03.868577 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4417e98a-bd83-413c-abf6-b651cea99024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:43:03.869245 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4417e98a-bd83-413c-abf6-b651cea99024 admin admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:43:03.869527 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4417e98a-bd83-413c-abf6-b651cea99024 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:43:03.869802 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4417e98a-bd83-413c-abf6-b651cea99024 admin admin] PATH_INFO: `/v3/projects` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:43:03.870502 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4417e98a-bd83-413c-abf6-b651cea99024 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:43:03.872424 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4417e98a-bd83-413c-abf6-b651cea99024 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:43:03.900436 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1168/2331] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jul 11 14:43:03 2022] POST /identity/v3/projects => generated 369 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:43:03.904549 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951b4aa2-af80-406a-9c42-6114c693377b admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:43:03.915464 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951b4aa2-af80-406a-9c42-6114c693377b admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:43:03.981866 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90097860-cb0e-45a2-893c-aecbb6de6090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:43:03.982546 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90097860-cb0e-45a2-893c-aecbb6de6090 admin admin] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:43:03.982829 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90097860-cb0e-45a2-893c-aecbb6de6090 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:43:03.983113 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90097860-cb0e-45a2-893c-aecbb6de6090 admin admin] PATH_INFO: `/v3/users` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:43:03.983806 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90097860-cb0e-45a2-893c-aecbb6de6090 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:43:03.985794 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90097860-cb0e-45a2-893c-aecbb6de6090 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:43:04.009327 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1164/2332] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jul 11 14:43:03 2022] POST /identity/v3/users => generated 285 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:43:04.013475 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4417e98a-bd83-413c-abf6-b651cea99024 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:43:04.025681 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4417e98a-bd83-413c-abf6-b651cea99024 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:43:04.030391 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef8b63c-ccc3-4a61-b0bc-0ac4542ed37a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:43:04.031065 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef8b63c-ccc3-4a61-b0bc-0ac4542ed37a admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:43:04.031383 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef8b63c-ccc3-4a61-b0bc-0ac4542ed37a admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:43:04.031664 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef8b63c-ccc3-4a61-b0bc-0ac4542ed37a admin admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:43:04.032430 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef8b63c-ccc3-4a61-b0bc-0ac4542ed37a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:43:04.034042 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef8b63c-ccc3-4a61-b0bc-0ac4542ed37a admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:43:04.045115 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1169/2333] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:43:04 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:43:04.049187 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90097860-cb0e-45a2-893c-aecbb6de6090 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:43:04.059375 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90097860-cb0e-45a2-893c-aecbb6de6090 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:43:04.065010 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9a66f7-fb5b-4933-9527-1a310f667aab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:43:04.065708 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9a66f7-fb5b-4933-9527-1a310f667aab admin admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:43:04.066000 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9a66f7-fb5b-4933-9527-1a310f667aab admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:43:04.066299 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9a66f7-fb5b-4933-9527-1a310f667aab admin admin] PATH_INFO: `/v3/roles` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:43:04.067039 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9a66f7-fb5b-4933-9527-1a310f667aab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:43:04.069271 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9a66f7-fb5b-4933-9527-1a310f667aab admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:43:04.083184 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1165/2334] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:43:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:43:04.084609 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef8b63c-ccc3-4a61-b0bc-0ac4542ed37a admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:43:04.094541 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef8b63c-ccc3-4a61-b0bc-0ac4542ed37a admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:43:04.099595 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6aa37a-961f-4c74-970d-5cc587816474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:43:04.100793 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6aa37a-961f-4c74-970d-5cc587816474 admin admin] REQUEST_METHOD: `PUT` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:43:04.101078 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6aa37a-961f-4c74-970d-5cc587816474 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:43:04.101351 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6aa37a-961f-4c74-970d-5cc587816474 admin admin] PATH_INFO: `/v3/projects/e591e27260b14e6d8b31ccdc671f1c4c/users/368f9c5ba9224252b1054f4afa763a82/roles/8eff41f243c843ed95505a488ca6eada` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:43:04.117874 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6aa37a-961f-4c74-970d-5cc587816474 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e591e27260b14e6d8b31ccdc671f1c4c, user_id=368f9c5ba9224252b1054f4afa763a82, role_id=8eff41f243c843ed95505a488ca6eada)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:43:04.120555 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6aa37a-961f-4c74-970d-5cc587816474 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:43:04.128888 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:43:04.134225 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1170/2335] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jul 11 14:43:04 2022] PUT /identity/v3/projects/e591e27260b14e6d8b31ccdc671f1c4c/users/368f9c5ba9224252b1054f4afa763a82/roles/8eff41f243c843ed95505a488ca6eada => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:43:04.145698 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62cfa2c-87b7-40f6-b157-8accd35a5334 None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:43:04.146006 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62cfa2c-87b7-40f6-b157-8accd35a5334 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:43:04.146287 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62cfa2c-87b7-40f6-b157-8accd35a5334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:43:04.173482 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-c62cfa2c-87b7-40f6-b157-8accd35a5334 None None] MFA Rules not processed for user `368f9c5ba9224252b1054f4afa763a82`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:43:04.174683 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-c62cfa2c-87b7-40f6-b157-8accd35a5334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:43:04.204838 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:43:04.246310 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1166/2336] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:43:04 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:43:04.258895 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6aa37a-961f-4c74-970d-5cc587816474 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:43:04.260462 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-6b6aa37a-961f-4c74-970d-5cc587816474 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:43:04.320440 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6aa37a-961f-4c74-970d-5cc587816474 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:43:04.324002 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26380c53-0993-40f2-91c0-f21a7e317fd1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa21b44163d84534b9ca1ffe5b5a6071', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:43:04.324700 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26380c53-0993-40f2-91c0-f21a7e317fd1 service glance] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:43:04.325014 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26380c53-0993-40f2-91c0-f21a7e317fd1 service glance] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:43:04.325290 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26380c53-0993-40f2-91c0-f21a7e317fd1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:43:04.334878 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26380c53-0993-40f2-91c0-f21a7e317fd1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:43:04.336354 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26380c53-0993-40f2-91c0-f21a7e317fd1 service glance] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:43:04.345160 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1171/2337] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:43:04 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:43:07.384955 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3599fe27-a171-4f40-acfd-92428487792e None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:43:07.385504 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3599fe27-a171-4f40-acfd-92428487792e None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:43:07.385626 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3599fe27-a171-4f40-acfd-92428487792e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:43:07.405208 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-3599fe27-a171-4f40-acfd-92428487792e None None] MFA Rules not processed for user `c6209a7303d1410587ae21e8a510da08`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:43:07.406438 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-3599fe27-a171-4f40-acfd-92428487792e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:43:07.470957 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1167/2338] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:43:07 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:43:09.404596 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26380c53-0993-40f2-91c0-f21a7e317fd1 service glance] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:43:09.405976 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-26380c53-0993-40f2-91c0-f21a7e317fd1 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:43:09.512912 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26380c53-0993-40f2-91c0-f21a7e317fd1 service glance] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:43:09.520868 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb172b55-0045-4066-9f33-b4018c25ac06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:43:09.522352 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb172b55-0045-4066-9f33-b4018c25ac06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:43:09.522658 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb172b55-0045-4066-9f33-b4018c25ac06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:43:09.523063 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb172b55-0045-4066-9f33-b4018c25ac06 admin admin] PATH_INFO: `/v3/users/c57e185c54f14c97ba8ab53587149ea7` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:43:09.524538 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb172b55-0045-4066-9f33-b4018c25ac06 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c57e185c54f14c97ba8ab53587149ea7)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:43:09.527049 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb172b55-0045-4066-9f33-b4018c25ac06 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:43:09.609843 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-fb172b55-0045-4066-9f33-b4018c25ac06 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c57e185c54f14c97ba8ab53587149ea7'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:43:09.619041 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-fb172b55-0045-4066-9f33-b4018c25ac06 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c57e185c54f14c97ba8ab53587149ea7'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:43:09.627628 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-fb172b55-0045-4066-9f33-b4018c25ac06 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c57e185c54f14c97ba8ab53587149ea7'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:43:09.628317 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-fb172b55-0045-4066-9f33-b4018c25ac06 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c57e185c54f14c97ba8ab53587149ea7'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:43:09.628959 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-fb172b55-0045-4066-9f33-b4018c25ac06 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c57e185c54f14c97ba8ab53587149ea7'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:43:09.655448 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1172/2339] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jul 11 14:43:09 2022] DELETE /identity/v3/users/c57e185c54f14c97ba8ab53587149ea7 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:43:09.661077 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8614283f-0b6e-492a-b3ce-eed49d47a791 None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:43:09.661659 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8614283f-0b6e-492a-b3ce-eed49d47a791 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:43:09.662312 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8614283f-0b6e-492a-b3ce-eed49d47a791 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:43:09.688994 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-8614283f-0b6e-492a-b3ce-eed49d47a791 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:43:09.690362 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-8614283f-0b6e-492a-b3ce-eed49d47a791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:43:09.794167 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1168/2340] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:43:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:43:09.804579 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb172b55-0045-4066-9f33-b4018c25ac06 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:43:09.807361 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-fb172b55-0045-4066-9f33-b4018c25ac06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:43:09.846089 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:43:09.899342 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb172b55-0045-4066-9f33-b4018c25ac06 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:43:09.906411 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d9b2a3-7dc2-4622-aed3-d4fb7e8e742a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20eede5ccd834862b00123310b5c3975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:43:09.907106 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d9b2a3-7dc2-4622-aed3-d4fb7e8e742a service neutron] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:43:09.907399 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d9b2a3-7dc2-4622-aed3-d4fb7e8e742a service neutron] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:43:09.907680 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d9b2a3-7dc2-4622-aed3-d4fb7e8e742a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:43:09.921171 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d9b2a3-7dc2-4622-aed3-d4fb7e8e742a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:43:09.923010 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d9b2a3-7dc2-4622-aed3-d4fb7e8e742a service neutron] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:43:09.939990 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1173/2341] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:43:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:43:10.386527 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8614283f-0b6e-492a-b3ce-eed49d47a791 None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:43:10.388439 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-8614283f-0b6e-492a-b3ce-eed49d47a791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:43:10.421832 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8614283f-0b6e-492a-b3ce-eed49d47a791 None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:43:10.434456 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1397d613-1894-4e9e-899d-e0b3ab3cf268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:43:10.436169 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1397d613-1894-4e9e-899d-e0b3ab3cf268 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:43:10.436651 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1397d613-1894-4e9e-899d-e0b3ab3cf268 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:43:10.437315 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1397d613-1894-4e9e-899d-e0b3ab3cf268 admin admin] PATH_INFO: `/v3/projects/a1e025b2e6494110b9dc96d74d3780b9` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:43:10.441447 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1397d613-1894-4e9e-899d-e0b3ab3cf268 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1e025b2e6494110b9dc96d74d3780b9)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:43:10.443905 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1397d613-1894-4e9e-899d-e0b3ab3cf268 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:43:10.529181 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-1397d613-1894-4e9e-899d-e0b3ab3cf268 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1e025b2e6494110b9dc96d74d3780b9', 'request_id': 'req-1397d613-1894-4e9e-899d-e0b3ab3cf268'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:43:10.535701 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-1397d613-1894-4e9e-899d-e0b3ab3cf268 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1e025b2e6494110b9dc96d74d3780b9', 'request_id': 'req-1397d613-1894-4e9e-899d-e0b3ab3cf268'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:43:10.545719 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-1397d613-1894-4e9e-899d-e0b3ab3cf268 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1e025b2e6494110b9dc96d74d3780b9', 'request_id': 'req-1397d613-1894-4e9e-899d-e0b3ab3cf268'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:43:10.563881 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:43:10.572109 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-1397d613-1894-4e9e-899d-e0b3ab3cf268 admin admin] The token cache is being invalidate because project a1e025b2e6494110b9dc96d74d3780b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80534) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:43:10.572109 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-1397d613-1894-4e9e-899d-e0b3ab3cf268 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:43:10.573800 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-1397d613-1894-4e9e-899d-e0b3ab3cf268 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:43:10.587979 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1169/2342] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jul 11 14:43:10 2022] DELETE /identity/v3/projects/a1e025b2e6494110b9dc96d74d3780b9 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:43:10.592754 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdfd0bf-621e-48a9-9190-5793ce3c31d4 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:43:10.595469 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdfd0bf-621e-48a9-9190-5793ce3c31d4 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:43:10.595469 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdfd0bf-621e-48a9-9190-5793ce3c31d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:43:10.623506 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-3bdfd0bf-621e-48a9-9190-5793ce3c31d4 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:43:10.624791 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-3bdfd0bf-621e-48a9-9190-5793ce3c31d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:43:10.697500 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1174/2343] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:43:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:43:10.704880 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84acbbdc-bd65-460d-931b-f8ff09239103 None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:43:10.706162 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84acbbdc-bd65-460d-931b-f8ff09239103 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:43:10.706598 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84acbbdc-bd65-460d-931b-f8ff09239103 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:43:10.734965 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-84acbbdc-bd65-460d-931b-f8ff09239103 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:43:10.736456 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-84acbbdc-bd65-460d-931b-f8ff09239103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:43:10.748308 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1170/2344] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:43:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:43:10.752674 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdfd0bf-621e-48a9-9190-5793ce3c31d4 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:43:10.768612 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdfd0bf-621e-48a9-9190-5793ce3c31d4 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:43:10.775374 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4935ad06-999a-4d42-a430-81f05dfe30f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:43:10.776102 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4935ad06-999a-4d42-a430-81f05dfe30f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:43:10.776570 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4935ad06-999a-4d42-a430-81f05dfe30f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:43:10.776929 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4935ad06-999a-4d42-a430-81f05dfe30f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:43:10.778042 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4935ad06-999a-4d42-a430-81f05dfe30f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:43:10.778385 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4935ad06-999a-4d42-a430-81f05dfe30f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:43:10.780049 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4935ad06-999a-4d42-a430-81f05dfe30f4 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:43:10.798684 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1175/2345] 10.222.0.70 () {58 vars in 1152 bytes} [Mon Jul 11 14:43:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:43:10.800313 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84acbbdc-bd65-460d-931b-f8ff09239103 None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:43:10.811622 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84acbbdc-bd65-460d-931b-f8ff09239103 None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:43:10.823140 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121b5312-9243-446f-9d30-aec7b85aa510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:43:10.823140 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121b5312-9243-446f-9d30-aec7b85aa510 admin admin] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:43:10.823140 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121b5312-9243-446f-9d30-aec7b85aa510 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:43:10.823140 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121b5312-9243-446f-9d30-aec7b85aa510 admin admin] PATH_INFO: `/v3/projects` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:43:10.825877 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121b5312-9243-446f-9d30-aec7b85aa510 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:43:10.830960 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121b5312-9243-446f-9d30-aec7b85aa510 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:43:10.862402 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1171/2346] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jul 11 14:43:10 2022] POST /identity/v3/projects => generated 383 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:43:10.867019 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4935ad06-999a-4d42-a430-81f05dfe30f4 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:43:10.877911 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4935ad06-999a-4d42-a430-81f05dfe30f4 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:43:10.960329 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a29d29-1f59-407d-a81d-add5a7459d5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:43:10.961150 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a29d29-1f59-407d-a81d-add5a7459d5e admin admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:43:10.961504 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a29d29-1f59-407d-a81d-add5a7459d5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:43:10.961853 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a29d29-1f59-407d-a81d-add5a7459d5e admin admin] PATH_INFO: `/v3/users` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:43:10.962628 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a29d29-1f59-407d-a81d-add5a7459d5e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:43:10.964694 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a29d29-1f59-407d-a81d-add5a7459d5e admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:43:10.996312 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1176/2347] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jul 11 14:43:10 2022] POST /identity/v3/users => generated 292 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:43:11.000610 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121b5312-9243-446f-9d30-aec7b85aa510 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:43:11.012305 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121b5312-9243-446f-9d30-aec7b85aa510 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:43:11.017880 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e587472d-9ad3-4401-a98f-8a5f076e5230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:43:11.018694 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e587472d-9ad3-4401-a98f-8a5f076e5230 admin admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:43:11.019016 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e587472d-9ad3-4401-a98f-8a5f076e5230 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:43:11.019306 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e587472d-9ad3-4401-a98f-8a5f076e5230 admin admin] PATH_INFO: `/v3/roles` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:43:11.020081 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e587472d-9ad3-4401-a98f-8a5f076e5230 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:43:11.022097 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e587472d-9ad3-4401-a98f-8a5f076e5230 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:43:11.036029 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1172/2348] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:43:10 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:43:11.040130 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a29d29-1f59-407d-a81d-add5a7459d5e admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:43:11.050533 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a29d29-1f59-407d-a81d-add5a7459d5e admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:43:11.061164 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e6c0c2-e5ba-4802-aaff-54e066ed24b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:43:11.062159 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e6c0c2-e5ba-4802-aaff-54e066ed24b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:43:11.062573 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e6c0c2-e5ba-4802-aaff-54e066ed24b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:43:11.063253 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e6c0c2-e5ba-4802-aaff-54e066ed24b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:43:11.064410 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e6c0c2-e5ba-4802-aaff-54e066ed24b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:43:11.066121 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e6c0c2-e5ba-4802-aaff-54e066ed24b3 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:43:11.080153 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1177/2349] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:43:11 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:43:11.084999 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e587472d-9ad3-4401-a98f-8a5f076e5230 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:43:11.097390 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e587472d-9ad3-4401-a98f-8a5f076e5230 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:43:11.109382 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be671929-a6e5-4815-b6c9-b7bce318f404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:43:11.110635 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be671929-a6e5-4815-b6c9-b7bce318f404 admin admin] REQUEST_METHOD: `PUT` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:43:11.110947 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be671929-a6e5-4815-b6c9-b7bce318f404 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:43:11.111627 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be671929-a6e5-4815-b6c9-b7bce318f404 admin admin] PATH_INFO: `/v3/projects/b3c0900bc4a043d49fa17051ce3529b1/users/a05157265eef48ee9816f55bfff09a92/roles/8eff41f243c843ed95505a488ca6eada` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:43:11.132734 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be671929-a6e5-4815-b6c9-b7bce318f404 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3c0900bc4a043d49fa17051ce3529b1, user_id=a05157265eef48ee9816f55bfff09a92, role_id=8eff41f243c843ed95505a488ca6eada)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:43:11.135451 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be671929-a6e5-4815-b6c9-b7bce318f404 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:43:11.155126 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1173/2350] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jul 11 14:43:11 2022] PUT /identity/v3/projects/b3c0900bc4a043d49fa17051ce3529b1/users/a05157265eef48ee9816f55bfff09a92/roles/8eff41f243c843ed95505a488ca6eada => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:43:11.160610 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1662cc66-ca76-4974-b753-90258645d163 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:43:11.161009 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1662cc66-ca76-4974-b753-90258645d163 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:43:11.161622 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1662cc66-ca76-4974-b753-90258645d163 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:43:11.203102 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-1662cc66-ca76-4974-b753-90258645d163 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:43:11.204425 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-1662cc66-ca76-4974-b753-90258645d163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:43:11.233008 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:43:11.276919 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1178/2351] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:43:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:43:11.287288 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be671929-a6e5-4815-b6c9-b7bce318f404 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:43:11.289528 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-be671929-a6e5-4815-b6c9-b7bce318f404 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:43:11.361445 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be671929-a6e5-4815-b6c9-b7bce318f404 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:43:11.367274 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb21e04f-5078-4edb-8695-d8e546c4eae4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20eede5ccd834862b00123310b5c3975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:43:11.367941 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb21e04f-5078-4edb-8695-d8e546c4eae4 service neutron] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:43:11.368253 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb21e04f-5078-4edb-8695-d8e546c4eae4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:43:11.368540 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb21e04f-5078-4edb-8695-d8e546c4eae4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:43:11.379640 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb21e04f-5078-4edb-8695-d8e546c4eae4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:43:11.382482 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb21e04f-5078-4edb-8695-d8e546c4eae4 service neutron] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:43:11.393433 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1174/2352] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:43:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:43:12.268601 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f8f312-0e95-4e62-8f0e-58146b8e8257 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:43:12.269234 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f8f312-0e95-4e62-8f0e-58146b8e8257 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:43:12.269234 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f8f312-0e95-4e62-8f0e-58146b8e8257 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:43:12.304690 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-f3f8f312-0e95-4e62-8f0e-58146b8e8257 None None] MFA Rules not processed for user `a05157265eef48ee9816f55bfff09a92`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:43:12.305945 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-f3f8f312-0e95-4e62-8f0e-58146b8e8257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:43:12.397056 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1179/2353] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:43:12 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:43:12.408387 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb21e04f-5078-4edb-8695-d8e546c4eae4 service neutron] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:43:12.409888 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-bb21e04f-5078-4edb-8695-d8e546c4eae4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:43:12.488902 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb21e04f-5078-4edb-8695-d8e546c4eae4 service neutron] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:43:12.493908 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4b621a-71af-45af-bd69-5794db123f08 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '868e7c2dec264512b972c8736d659c34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:43:12.494641 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4b621a-71af-45af-bd69-5794db123f08 service cinder] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:43:12.494930 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4b621a-71af-45af-bd69-5794db123f08 service cinder] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:43:12.495212 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4b621a-71af-45af-bd69-5794db123f08 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:43:12.506365 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4b621a-71af-45af-bd69-5794db123f08 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:43:12.507903 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4b621a-71af-45af-bd69-5794db123f08 service cinder] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:43:12.518091 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1175/2354] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:43:12 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:43:13.952317 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2de38e-566a-44c6-b17c-84b557f57000 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:43:13.952974 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2de38e-566a-44c6-b17c-84b557f57000 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:43:13.953073 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2de38e-566a-44c6-b17c-84b557f57000 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:43:13.974045 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-af2de38e-566a-44c6-b17c-84b557f57000 None None] MFA Rules not processed for user `a05157265eef48ee9816f55bfff09a92`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:43:13.975284 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-af2de38e-566a-44c6-b17c-84b557f57000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:43:13.982300 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1180/2355] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:43:13 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:43:22.513415 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=80,keystone:INSERT=2 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:43:23.968195 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=48 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:43:33.132682 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b1f61e-ac2a-4d24-ae30-c712cd0c4e34 None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:43:33.133152 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b1f61e-ac2a-4d24-ae30-c712cd0c4e34 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:43:33.133152 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b1f61e-ac2a-4d24-ae30-c712cd0c4e34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:43:33.151748 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-a7b1f61e-ac2a-4d24-ae30-c712cd0c4e34 None None] MFA Rules not processed for user `2ef7b195b623456aa0b12dac0a4bf4d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:43:33.153030 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-a7b1f61e-ac2a-4d24-ae30-c712cd0c4e34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:43:33.212968 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1176/2356] 10.222.0.70 () {58 vars in 1009 bytes} [Mon Jul 11 14:43:33 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:43:33.282845 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2de38e-566a-44c6-b17c-84b557f57000 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:43:33.284405 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-af2de38e-566a-44c6-b17c-84b557f57000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:43:33.364173 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2de38e-566a-44c6-b17c-84b557f57000 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:43:33.369896 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb5a832-c950-4cd4-ac4e-b8ec007a07c8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0217add2f5e74a80a1a33b160cc57a2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:43:33.370545 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb5a832-c950-4cd4-ac4e-b8ec007a07c8 service swift] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:43:33.370829 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb5a832-c950-4cd4-ac4e-b8ec007a07c8 service swift] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:43:33.371108 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb5a832-c950-4cd4-ac4e-b8ec007a07c8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:43:33.379413 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb5a832-c950-4cd4-ac4e-b8ec007a07c8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:43:33.381988 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb5a832-c950-4cd4-ac4e-b8ec007a07c8 service swift] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:43:33.390324 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1181/2357] 10.222.0.70 () {60 vars in 1384 bytes} [Mon Jul 11 14:43:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 14:43:39.070828 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b1f61e-ac2a-4d24-ae30-c712cd0c4e34 None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:43:39.072450 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-a7b1f61e-ac2a-4d24-ae30-c712cd0c4e34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:43:39.090451 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b1f61e-ac2a-4d24-ae30-c712cd0c4e34 None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:43:39.095620 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c415405-a003-4cd3-a509-3a5c0f31bc95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:43:39.097186 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c415405-a003-4cd3-a509-3a5c0f31bc95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:43:39.097916 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c415405-a003-4cd3-a509-3a5c0f31bc95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:43:39.098200 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c415405-a003-4cd3-a509-3a5c0f31bc95 admin admin] PATH_INFO: `/v3/users/368f9c5ba9224252b1054f4afa763a82` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:43:39.100228 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c415405-a003-4cd3-a509-3a5c0f31bc95 admin admin] RBAC: Authorizing `identity:delete_user(user_id=368f9c5ba9224252b1054f4afa763a82)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:43:39.102803 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c415405-a003-4cd3-a509-3a5c0f31bc95 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:43:39.163992 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-5c415405-a003-4cd3-a509-3a5c0f31bc95 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '368f9c5ba9224252b1054f4afa763a82'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:43:39.171501 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-5c415405-a003-4cd3-a509-3a5c0f31bc95 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '368f9c5ba9224252b1054f4afa763a82'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:43:39.180668 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-5c415405-a003-4cd3-a509-3a5c0f31bc95 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '368f9c5ba9224252b1054f4afa763a82'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:43:39.181316 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-5c415405-a003-4cd3-a509-3a5c0f31bc95 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '368f9c5ba9224252b1054f4afa763a82'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:43:39.181937 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-5c415405-a003-4cd3-a509-3a5c0f31bc95 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '368f9c5ba9224252b1054f4afa763a82'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:43:39.208949 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1177/2358] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jul 11 14:43:39 2022] DELETE /identity/v3/users/368f9c5ba9224252b1054f4afa763a82 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:43:39.214964 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58211c64-e01b-448a-91c9-329614cc45f9 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:43:39.215499 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58211c64-e01b-448a-91c9-329614cc45f9 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:43:39.216040 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58211c64-e01b-448a-91c9-329614cc45f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:43:39.234647 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-58211c64-e01b-448a-91c9-329614cc45f9 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:43:39.235893 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-58211c64-e01b-448a-91c9-329614cc45f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:43:39.305248 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1182/2359] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:43:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:43:39.315436 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c415405-a003-4cd3-a509-3a5c0f31bc95 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:43:39.316912 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-5c415405-a003-4cd3-a509-3a5c0f31bc95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:43:39.387023 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c415405-a003-4cd3-a509-3a5c0f31bc95 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:43:39.390966 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc975560-b742-42c5-8722-465290db1d1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20eede5ccd834862b00123310b5c3975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:43:39.392877 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc975560-b742-42c5-8722-465290db1d1a service neutron] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:43:39.393184 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc975560-b742-42c5-8722-465290db1d1a service neutron] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:43:39.393472 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc975560-b742-42c5-8722-465290db1d1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:43:39.407349 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc975560-b742-42c5-8722-465290db1d1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:43:39.409139 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc975560-b742-42c5-8722-465290db1d1a service neutron] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:43:39.421434 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1178/2360] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:43:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:43:39.760376 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58211c64-e01b-448a-91c9-329614cc45f9 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:43:39.762490 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-58211c64-e01b-448a-91c9-329614cc45f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:43:39.777448 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58211c64-e01b-448a-91c9-329614cc45f9 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:43:39.783688 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69efbbf0-2337-4383-af14-94beee549670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:43:39.785216 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69efbbf0-2337-4383-af14-94beee549670 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:43:39.785514 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69efbbf0-2337-4383-af14-94beee549670 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:43:39.785923 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69efbbf0-2337-4383-af14-94beee549670 admin admin] PATH_INFO: `/v3/projects/e591e27260b14e6d8b31ccdc671f1c4c` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:43:39.788260 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69efbbf0-2337-4383-af14-94beee549670 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e591e27260b14e6d8b31ccdc671f1c4c)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:43:39.791281 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69efbbf0-2337-4383-af14-94beee549670 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:43:39.861164 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-69efbbf0-2337-4383-af14-94beee549670 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e591e27260b14e6d8b31ccdc671f1c4c', 'request_id': 'req-69efbbf0-2337-4383-af14-94beee549670'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:43:39.869310 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-69efbbf0-2337-4383-af14-94beee549670 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e591e27260b14e6d8b31ccdc671f1c4c', 'request_id': 'req-69efbbf0-2337-4383-af14-94beee549670'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:43:39.877111 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-69efbbf0-2337-4383-af14-94beee549670 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e591e27260b14e6d8b31ccdc671f1c4c', 'request_id': 'req-69efbbf0-2337-4383-af14-94beee549670'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:43:39.891417 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-69efbbf0-2337-4383-af14-94beee549670 admin admin] The token cache is being invalidate because project e591e27260b14e6d8b31ccdc671f1c4c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:43:39.891828 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-69efbbf0-2337-4383-af14-94beee549670 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:43:39.892670 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-69efbbf0-2337-4383-af14-94beee549670 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:43:39.894342 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1183/2361] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jul 11 14:43:39 2022] DELETE /identity/v3/projects/e591e27260b14e6d8b31ccdc671f1c4c => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:43:39.899774 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4c1770-c309-43e4-972a-42d460c2b0a8 None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:43:39.900283 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4c1770-c309-43e4-972a-42d460c2b0a8 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:43:39.900629 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4c1770-c309-43e4-972a-42d460c2b0a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:43:39.923048 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-cd4c1770-c309-43e4-972a-42d460c2b0a8 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:43:39.924418 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-cd4c1770-c309-43e4-972a-42d460c2b0a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:43:39.940480 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:43:39.998439 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1179/2362] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:43:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:43:40.006043 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fde8e0-9eb4-4f6f-ab0b-0ef1fc018028 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:43:40.006328 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fde8e0-9eb4-4f6f-ab0b-0ef1fc018028 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:43:40.006610 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fde8e0-9eb4-4f6f-ab0b-0ef1fc018028 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:43:40.027796 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-30fde8e0-9eb4-4f6f-ab0b-0ef1fc018028 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:43:40.029326 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-30fde8e0-9eb4-4f6f-ab0b-0ef1fc018028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:43:40.042129 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1184/2363] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:43:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:43:40.046373 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4c1770-c309-43e4-972a-42d460c2b0a8 None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:43:40.057793 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4c1770-c309-43e4-972a-42d460c2b0a8 None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:43:40.062522 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a96719-00ca-4171-9d3a-5b8d3d53c0c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:43:40.063457 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a96719-00ca-4171-9d3a-5b8d3d53c0c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:43:40.063741 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a96719-00ca-4171-9d3a-5b8d3d53c0c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:43:40.064016 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a96719-00ca-4171-9d3a-5b8d3d53c0c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:43:40.064785 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a96719-00ca-4171-9d3a-5b8d3d53c0c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:43:40.065092 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a96719-00ca-4171-9d3a-5b8d3d53c0c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:43:40.066708 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a96719-00ca-4171-9d3a-5b8d3d53c0c8 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:43:40.081003 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1180/2364] 10.222.0.70 () {58 vars in 1152 bytes} [Mon Jul 11 14:43:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:43:40.085553 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fde8e0-9eb4-4f6f-ab0b-0ef1fc018028 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:43:40.095524 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fde8e0-9eb4-4f6f-ab0b-0ef1fc018028 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:43:40.101844 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7259dc7-6252-4bc8-ae07-dfe7d101b2ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:43:40.102646 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7259dc7-6252-4bc8-ae07-dfe7d101b2ca admin admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:43:40.103114 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7259dc7-6252-4bc8-ae07-dfe7d101b2ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:43:40.103248 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7259dc7-6252-4bc8-ae07-dfe7d101b2ca admin admin] PATH_INFO: `/v3/projects` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:43:40.103894 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7259dc7-6252-4bc8-ae07-dfe7d101b2ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:43:40.106003 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7259dc7-6252-4bc8-ae07-dfe7d101b2ca admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:43:40.110955 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:43:40.153008 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1185/2365] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jul 11 14:43:40 2022] POST /identity/v3/projects => generated 363 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:43:40.157542 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a96719-00ca-4171-9d3a-5b8d3d53c0c8 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:43:40.175287 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a96719-00ca-4171-9d3a-5b8d3d53c0c8 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:43:40.262207 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0a1ff7-d4f9-4a81-b156-7ed53e072fed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:43:40.263648 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0a1ff7-d4f9-4a81-b156-7ed53e072fed admin admin] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:43:40.263940 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0a1ff7-d4f9-4a81-b156-7ed53e072fed admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:43:40.264248 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0a1ff7-d4f9-4a81-b156-7ed53e072fed admin admin] PATH_INFO: `/v3/users` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:43:40.265403 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0a1ff7-d4f9-4a81-b156-7ed53e072fed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:43:40.268665 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0a1ff7-d4f9-4a81-b156-7ed53e072fed admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:43:40.294727 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1181/2366] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jul 11 14:43:40 2022] POST /identity/v3/users => generated 282 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:43:40.299022 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7259dc7-6252-4bc8-ae07-dfe7d101b2ca admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:43:40.315872 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7259dc7-6252-4bc8-ae07-dfe7d101b2ca admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:43:40.322503 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b178575-da9f-47e3-8da3-e0248210e760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:43:40.323191 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b178575-da9f-47e3-8da3-e0248210e760 admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:43:40.323529 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b178575-da9f-47e3-8da3-e0248210e760 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:43:40.323814 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b178575-da9f-47e3-8da3-e0248210e760 admin admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:43:40.324624 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b178575-da9f-47e3-8da3-e0248210e760 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:43:40.326193 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b178575-da9f-47e3-8da3-e0248210e760 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:43:40.338068 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1186/2367] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:43:40 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:43:40.342170 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0a1ff7-d4f9-4a81-b156-7ed53e072fed admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:43:40.352898 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0a1ff7-d4f9-4a81-b156-7ed53e072fed admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:43:40.357938 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9486d2b7-216c-43ca-8794-0ab829b200f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:43:40.358460 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9486d2b7-216c-43ca-8794-0ab829b200f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:43:40.358849 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9486d2b7-216c-43ca-8794-0ab829b200f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:43:40.359406 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9486d2b7-216c-43ca-8794-0ab829b200f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:43:40.359981 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9486d2b7-216c-43ca-8794-0ab829b200f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:43:40.361667 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9486d2b7-216c-43ca-8794-0ab829b200f8 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:43:40.374122 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1182/2368] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:43:40 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:43:40.378157 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b178575-da9f-47e3-8da3-e0248210e760 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:43:40.391012 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b178575-da9f-47e3-8da3-e0248210e760 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:43:40.398375 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce761644-1111-41c2-b403-2e72391ef828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:43:40.399537 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce761644-1111-41c2-b403-2e72391ef828 admin admin] REQUEST_METHOD: `PUT` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:43:40.399824 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce761644-1111-41c2-b403-2e72391ef828 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:43:40.400328 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce761644-1111-41c2-b403-2e72391ef828 admin admin] PATH_INFO: `/v3/projects/e11740f3d60d4e398ebdbbe34e75bf5f/users/16e1d9ca2fa347dda30cad751451aabf/roles/8eff41f243c843ed95505a488ca6eada` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:43:40.417460 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce761644-1111-41c2-b403-2e72391ef828 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e11740f3d60d4e398ebdbbe34e75bf5f, user_id=16e1d9ca2fa347dda30cad751451aabf, role_id=8eff41f243c843ed95505a488ca6eada)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:43:40.420335 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce761644-1111-41c2-b403-2e72391ef828 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:43:40.440638 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1187/2369] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jul 11 14:43:40 2022] PUT /identity/v3/projects/e11740f3d60d4e398ebdbbe34e75bf5f/users/16e1d9ca2fa347dda30cad751451aabf/roles/8eff41f243c843ed95505a488ca6eada => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:43:40.453647 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c80bd2-278d-48d1-823a-9ba4d267ab7d None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:43:40.454520 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c80bd2-278d-48d1-823a-9ba4d267ab7d None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:43:40.454813 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c80bd2-278d-48d1-823a-9ba4d267ab7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:43:40.486255 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-12c80bd2-278d-48d1-823a-9ba4d267ab7d None None] MFA Rules not processed for user `16e1d9ca2fa347dda30cad751451aabf`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:43:40.487471 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-12c80bd2-278d-48d1-823a-9ba4d267ab7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:43:40.564018 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1183/2370] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:43:40 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:43:40.577106 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce761644-1111-41c2-b403-2e72391ef828 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:43:40.578819 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-ce761644-1111-41c2-b403-2e72391ef828 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:43:40.643309 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce761644-1111-41c2-b403-2e72391ef828 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:43:40.647540 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da859139-bf5f-4db0-8d84-2d66ad9154d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '868e7c2dec264512b972c8736d659c34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:43:40.648229 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da859139-bf5f-4db0-8d84-2d66ad9154d2 service cinder] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:43:40.648504 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da859139-bf5f-4db0-8d84-2d66ad9154d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:43:40.648781 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da859139-bf5f-4db0-8d84-2d66ad9154d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:43:40.658023 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da859139-bf5f-4db0-8d84-2d66ad9154d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:43:40.659443 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da859139-bf5f-4db0-8d84-2d66ad9154d2 service cinder] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:43:40.670907 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1188/2371] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:43:40 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:43:50.560450 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=90,keystone:INSERT=3 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:43:50.665567 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=47,keystone:INSERT=2 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:43:54.491271 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c80bd2-278d-48d1-823a-9ba4d267ab7d None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:43:54.492881 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-12c80bd2-278d-48d1-823a-9ba4d267ab7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:43:54.574454 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c80bd2-278d-48d1-823a-9ba4d267ab7d None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:43:54.580487 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9002cf4c-194b-495e-9b3e-9f8fd0aa36dd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bf25c7951dc4182996335ca1f0e56ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:43:54.581182 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9002cf4c-194b-495e-9b3e-9f8fd0aa36dd service placement] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:43:54.581466 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9002cf4c-194b-495e-9b3e-9f8fd0aa36dd service placement] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:43:54.581746 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9002cf4c-194b-495e-9b3e-9f8fd0aa36dd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:43:54.583632 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-9002cf4c-194b-495e-9b3e-9f8fd0aa36dd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:43:54.595807 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9002cf4c-194b-495e-9b3e-9f8fd0aa36dd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:43:54.597428 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9002cf4c-194b-495e-9b3e-9f8fd0aa36dd service placement] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:43:54.608074 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1184/2372] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:43:54 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:43:55.585726 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952d02d8-caab-434a-aed7-481c4daa5523 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:43:55.586241 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952d02d8-caab-434a-aed7-481c4daa5523 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:43:55.586350 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952d02d8-caab-434a-aed7-481c4daa5523 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:43:55.608526 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-952d02d8-caab-434a-aed7-481c4daa5523 None None] MFA Rules not processed for user `2ef7b195b623456aa0b12dac0a4bf4d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:43:55.609990 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-952d02d8-caab-434a-aed7-481c4daa5523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:43:55.699987 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1189/2373] 10.222.0.70 () {58 vars in 967 bytes} [Mon Jul 11 14:43:55 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:43:55.717158 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9002cf4c-194b-495e-9b3e-9f8fd0aa36dd service placement] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:43:55.719749 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-9002cf4c-194b-495e-9b3e-9f8fd0aa36dd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:43:55.807141 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9002cf4c-194b-495e-9b3e-9f8fd0aa36dd service placement] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:43:55.812415 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a4d142-2c5f-4620-a54c-1db50615af49 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0217add2f5e74a80a1a33b160cc57a2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:43:55.813320 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a4d142-2c5f-4620-a54c-1db50615af49 service swift] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:43:55.813604 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a4d142-2c5f-4620-a54c-1db50615af49 service swift] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:43:55.813879 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a4d142-2c5f-4620-a54c-1db50615af49 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:43:55.823737 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a4d142-2c5f-4620-a54c-1db50615af49 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:43:55.825386 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a4d142-2c5f-4620-a54c-1db50615af49 service swift] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:43:55.834871 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1185/2374] 10.222.0.70 () {60 vars in 1384 bytes} [Mon Jul 11 14:43:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 14:43:57.912172 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952d02d8-caab-434a-aed7-481c4daa5523 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:43:57.914460 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-952d02d8-caab-434a-aed7-481c4daa5523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:43:57.991032 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952d02d8-caab-434a-aed7-481c4daa5523 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:43:57.995561 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cce6c9-f5b5-47fd-809a-ca84b0b31d59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:43:57.996455 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cce6c9-f5b5-47fd-809a-ca84b0b31d59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:43:57.996733 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cce6c9-f5b5-47fd-809a-ca84b0b31d59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:43:57.997002 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cce6c9-f5b5-47fd-809a-ca84b0b31d59 admin admin] PATH_INFO: `/v3/users/c6209a7303d1410587ae21e8a510da08` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:43:57.998309 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cce6c9-f5b5-47fd-809a-ca84b0b31d59 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6209a7303d1410587ae21e8a510da08)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:43:58.000307 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cce6c9-f5b5-47fd-809a-ca84b0b31d59 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:43:58.046913 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-b6cce6c9-f5b5-47fd-809a-ca84b0b31d59 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6209a7303d1410587ae21e8a510da08'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:43:58.054876 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-b6cce6c9-f5b5-47fd-809a-ca84b0b31d59 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6209a7303d1410587ae21e8a510da08'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:43:58.064528 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-b6cce6c9-f5b5-47fd-809a-ca84b0b31d59 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6209a7303d1410587ae21e8a510da08'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:43:58.065140 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-b6cce6c9-f5b5-47fd-809a-ca84b0b31d59 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6209a7303d1410587ae21e8a510da08'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:43:58.065750 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-b6cce6c9-f5b5-47fd-809a-ca84b0b31d59 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6209a7303d1410587ae21e8a510da08'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:43:58.086120 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1190/2375] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jul 11 14:43:57 2022] DELETE /identity/v3/users/c6209a7303d1410587ae21e8a510da08 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:43:58.272738 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a4d142-2c5f-4620-a54c-1db50615af49 service swift] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:43:58.285786 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a4d142-2c5f-4620-a54c-1db50615af49 service swift] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:43:58.367539 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bee474-2526-41ce-ab8e-cf1c37d9f729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:43:58.368451 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bee474-2526-41ce-ab8e-cf1c37d9f729 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:43:58.368740 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bee474-2526-41ce-ab8e-cf1c37d9f729 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:43:58.369017 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bee474-2526-41ce-ab8e-cf1c37d9f729 admin admin] PATH_INFO: `/v3/projects/a7386ade7434410cb9a1f18ffcf2bb81` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:43:58.370364 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bee474-2526-41ce-ab8e-cf1c37d9f729 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7386ade7434410cb9a1f18ffcf2bb81)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:43:58.372322 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bee474-2526-41ce-ab8e-cf1c37d9f729 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:43:58.398132 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:43:58.427947 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-70bee474-2526-41ce-ab8e-cf1c37d9f729 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7386ade7434410cb9a1f18ffcf2bb81', 'request_id': 'req-70bee474-2526-41ce-ab8e-cf1c37d9f729'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:43:58.435125 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-70bee474-2526-41ce-ab8e-cf1c37d9f729 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7386ade7434410cb9a1f18ffcf2bb81', 'request_id': 'req-70bee474-2526-41ce-ab8e-cf1c37d9f729'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:43:58.446817 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-70bee474-2526-41ce-ab8e-cf1c37d9f729 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7386ade7434410cb9a1f18ffcf2bb81', 'request_id': 'req-70bee474-2526-41ce-ab8e-cf1c37d9f729'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:43:58.459332 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-70bee474-2526-41ce-ab8e-cf1c37d9f729 admin admin] The token cache is being invalidate because project a7386ade7434410cb9a1f18ffcf2bb81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80534) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:43:58.459718 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-70bee474-2526-41ce-ab8e-cf1c37d9f729 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:43:58.460572 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-70bee474-2526-41ce-ab8e-cf1c37d9f729 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:43:58.462452 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1186/2376] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jul 11 14:43:58 2022] DELETE /identity/v3/projects/a7386ade7434410cb9a1f18ffcf2bb81 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:43:58.911797 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e7a3a7-d006-4a0c-a694-cc610ee3f8d4 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:43:58.912164 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e7a3a7-d006-4a0c-a694-cc610ee3f8d4 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:43:58.912541 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e7a3a7-d006-4a0c-a694-cc610ee3f8d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:43:58.931049 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-44e7a3a7-d006-4a0c-a694-cc610ee3f8d4 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:43:58.932293 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-44e7a3a7-d006-4a0c-a694-cc610ee3f8d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:43:58.952118 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:43:58.994621 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1191/2377] 10.222.0.62 () {58 vars in 1016 bytes} [Mon Jul 11 14:43:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:43:59.012696 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bee474-2526-41ce-ab8e-cf1c37d9f729 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:43:59.014289 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-70bee474-2526-41ce-ab8e-cf1c37d9f729 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:43:59.096024 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bee474-2526-41ce-ab8e-cf1c37d9f729 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:43:59.102664 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa433431-4a31-460f-9bc9-f57b09787fa0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4f8c0d696af4bd5a205ca8e9110b8cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:43:59.103309 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa433431-4a31-460f-9bc9-f57b09787fa0 service nova] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:43:59.103592 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa433431-4a31-460f-9bc9-f57b09787fa0 service nova] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:43:59.103864 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa433431-4a31-460f-9bc9-f57b09787fa0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:43:59.112145 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa433431-4a31-460f-9bc9-f57b09787fa0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:43:59.113773 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa433431-4a31-460f-9bc9-f57b09787fa0 service nova] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:43:59.123964 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1187/2378] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:43:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:44:02.915618 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7185fc1-8532-48f5-939e-e62144113844 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:44:02.916360 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7185fc1-8532-48f5-939e-e62144113844 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:44:02.916360 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7185fc1-8532-48f5-939e-e62144113844 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:44:02.936229 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-f7185fc1-8532-48f5-939e-e62144113844 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:44:02.937972 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-f7185fc1-8532-48f5-939e-e62144113844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:44:02.947416 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1192/2379] 10.222.0.62 () {58 vars in 1016 bytes} [Mon Jul 11 14:44:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:44:02.965123 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa433431-4a31-460f-9bc9-f57b09787fa0 service nova] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:44:02.966555 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-aa433431-4a31-460f-9bc9-f57b09787fa0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:44:02.984958 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa433431-4a31-460f-9bc9-f57b09787fa0 service nova] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:44:02.992256 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4210d76a-a71f-445f-b443-b11585619959 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4f8c0d696af4bd5a205ca8e9110b8cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:44:02.992931 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4210d76a-a71f-445f-b443-b11585619959 service nova] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:44:02.993216 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4210d76a-a71f-445f-b443-b11585619959 service nova] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:44:02.993493 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4210d76a-a71f-445f-b443-b11585619959 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:44:03.002697 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4210d76a-a71f-445f-b443-b11585619959 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:44:03.004320 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4210d76a-a71f-445f-b443-b11585619959 service nova] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:44:03.014628 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1188/2380] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:44:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:44:07.260693 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417318ab-340a-45b6-983f-08f05e197130 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:44:07.261262 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417318ab-340a-45b6-983f-08f05e197130 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:44:07.261262 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417318ab-340a-45b6-983f-08f05e197130 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:44:07.280953 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-417318ab-340a-45b6-983f-08f05e197130 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:44:07.282185 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-417318ab-340a-45b6-983f-08f05e197130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:44:07.291162 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1193/2381] 10.222.0.62 () {58 vars in 1016 bytes} [Mon Jul 11 14:44:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:44:07.326760 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4210d76a-a71f-445f-b443-b11585619959 service nova] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:44:07.338970 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4210d76a-a71f-445f-b443-b11585619959 service nova] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:44:07.344866 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28fd962-f2a1-446c-a91e-77268fdeaab9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4f8c0d696af4bd5a205ca8e9110b8cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:44:07.345508 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28fd962-f2a1-446c-a91e-77268fdeaab9 service nova] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:44:07.345789 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28fd962-f2a1-446c-a91e-77268fdeaab9 service nova] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:44:07.346060 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28fd962-f2a1-446c-a91e-77268fdeaab9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:44:07.355491 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28fd962-f2a1-446c-a91e-77268fdeaab9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:44:07.357084 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28fd962-f2a1-446c-a91e-77268fdeaab9 service nova] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:44:07.366663 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1189/2382] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:44:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:44:12.397164 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b722bc9d-29d0-4668-a46c-97c3ea8be462 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:44:12.398111 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b722bc9d-29d0-4668-a46c-97c3ea8be462 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:44:12.398392 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b722bc9d-29d0-4668-a46c-97c3ea8be462 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:44:12.422303 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-b722bc9d-29d0-4668-a46c-97c3ea8be462 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:44:12.423651 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-b722bc9d-29d0-4668-a46c-97c3ea8be462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:44:12.435826 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1194/2383] 10.222.0.62 () {58 vars in 1016 bytes} [Mon Jul 11 14:44:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:44:12.454032 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28fd962-f2a1-446c-a91e-77268fdeaab9 service nova] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:44:12.466616 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28fd962-f2a1-446c-a91e-77268fdeaab9 service nova] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:44:12.474770 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b1a4e1-2008-46ec-8486-24d645602d24 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4f8c0d696af4bd5a205ca8e9110b8cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:44:12.475674 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b1a4e1-2008-46ec-8486-24d645602d24 service nova] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:44:12.476100 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b1a4e1-2008-46ec-8486-24d645602d24 service nova] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:44:12.476476 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b1a4e1-2008-46ec-8486-24d645602d24 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:44:12.487092 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b1a4e1-2008-46ec-8486-24d645602d24 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:44:12.489633 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b1a4e1-2008-46ec-8486-24d645602d24 service nova] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:44:12.504426 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1190/2384] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:44:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:44:13.552842 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4721729-a0de-4a59-b8dd-f341ab6d04b0 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:44:13.553402 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4721729-a0de-4a59-b8dd-f341ab6d04b0 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:44:13.553402 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4721729-a0de-4a59-b8dd-f341ab6d04b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:44:13.575091 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-b4721729-a0de-4a59-b8dd-f341ab6d04b0 None None] MFA Rules not processed for user `caa770e36e624905b2e23610e901e22d`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:44:13.576332 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-b4721729-a0de-4a59-b8dd-f341ab6d04b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:44:13.635355 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1195/2385] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:44:13 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:44:18.848637 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dddf38-d873-41d5-8197-d83dd4d9a146 None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:44:18.849214 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dddf38-d873-41d5-8197-d83dd4d9a146 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:44:18.849214 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dddf38-d873-41d5-8197-d83dd4d9a146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:44:18.869673 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-86dddf38-d873-41d5-8197-d83dd4d9a146 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:44:18.871190 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-86dddf38-d873-41d5-8197-d83dd4d9a146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:44:18.881535 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1191/2386] 10.222.0.62 () {58 vars in 1016 bytes} [Mon Jul 11 14:44:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:44:18.900679 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4721729-a0de-4a59-b8dd-f341ab6d04b0 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:44:18.914451 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4721729-a0de-4a59-b8dd-f341ab6d04b0 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:44:18.920225 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eea334f-6f52-4ee8-a982-37f971252962 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4f8c0d696af4bd5a205ca8e9110b8cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:44:18.920991 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eea334f-6f52-4ee8-a982-37f971252962 service nova] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:44:18.921364 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eea334f-6f52-4ee8-a982-37f971252962 service nova] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:44:18.921700 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eea334f-6f52-4ee8-a982-37f971252962 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:44:18.931391 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eea334f-6f52-4ee8-a982-37f971252962 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:44:18.933298 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eea334f-6f52-4ee8-a982-37f971252962 service nova] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:44:18.945307 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1196/2387] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:44:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:44:24.134565 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dddf38-d873-41d5-8197-d83dd4d9a146 None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:44:24.136849 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-86dddf38-d873-41d5-8197-d83dd4d9a146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:44:24.151942 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dddf38-d873-41d5-8197-d83dd4d9a146 None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:44:24.159763 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2b40fb-c24f-4e51-9ea5-5e2c20464afe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:44:24.166211 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2b40fb-c24f-4e51-9ea5-5e2c20464afe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:44:24.166211 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2b40fb-c24f-4e51-9ea5-5e2c20464afe admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:44:24.166211 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2b40fb-c24f-4e51-9ea5-5e2c20464afe admin admin] PATH_INFO: `/v3/users/16e1d9ca2fa347dda30cad751451aabf` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:44:24.167738 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2b40fb-c24f-4e51-9ea5-5e2c20464afe admin admin] RBAC: Authorizing `identity:delete_user(user_id=16e1d9ca2fa347dda30cad751451aabf)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:44:24.169909 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2b40fb-c24f-4e51-9ea5-5e2c20464afe admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:44:24.230143 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:44:24.233007 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-8c2b40fb-c24f-4e51-9ea5-5e2c20464afe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16e1d9ca2fa347dda30cad751451aabf'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:44:24.247807 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-8c2b40fb-c24f-4e51-9ea5-5e2c20464afe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16e1d9ca2fa347dda30cad751451aabf'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:44:24.260390 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-8c2b40fb-c24f-4e51-9ea5-5e2c20464afe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16e1d9ca2fa347dda30cad751451aabf'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:44:24.261410 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-8c2b40fb-c24f-4e51-9ea5-5e2c20464afe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16e1d9ca2fa347dda30cad751451aabf'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:44:24.262425 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-8c2b40fb-c24f-4e51-9ea5-5e2c20464afe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16e1d9ca2fa347dda30cad751451aabf'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:44:24.294123 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1192/2388] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jul 11 14:44:24 2022] DELETE /identity/v3/users/16e1d9ca2fa347dda30cad751451aabf => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:44:24.303160 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d138d71-5b52-443b-ad34-0beb834ccdc1 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:44:24.303735 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d138d71-5b52-443b-ad34-0beb834ccdc1 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:44:24.304084 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d138d71-5b52-443b-ad34-0beb834ccdc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:44:24.333865 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-3d138d71-5b52-443b-ad34-0beb834ccdc1 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:44:24.335950 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-3d138d71-5b52-443b-ad34-0beb834ccdc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:44:24.444677 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1197/2389] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:44:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:44:24.458295 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2b40fb-c24f-4e51-9ea5-5e2c20464afe admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:44:24.460841 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-8c2b40fb-c24f-4e51-9ea5-5e2c20464afe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:44:24.675082 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2b40fb-c24f-4e51-9ea5-5e2c20464afe admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:44:24.679204 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3224f464-c516-4b32-a694-93164b201cd5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20eede5ccd834862b00123310b5c3975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:44:24.680000 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3224f464-c516-4b32-a694-93164b201cd5 service neutron] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:44:24.680386 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3224f464-c516-4b32-a694-93164b201cd5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:44:24.680734 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3224f464-c516-4b32-a694-93164b201cd5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:44:24.693719 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3224f464-c516-4b32-a694-93164b201cd5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:44:24.695411 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3224f464-c516-4b32-a694-93164b201cd5 service neutron] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:44:24.713718 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1193/2390] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:44:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:44:25.037583 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d138d71-5b52-443b-ad34-0beb834ccdc1 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:44:25.039554 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-3d138d71-5b52-443b-ad34-0beb834ccdc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:44:25.068188 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d138d71-5b52-443b-ad34-0beb834ccdc1 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:44:25.073063 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dde273-ee6b-4ec3-92cd-b97b67203e2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:44:25.073946 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dde273-ee6b-4ec3-92cd-b97b67203e2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:44:25.074246 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dde273-ee6b-4ec3-92cd-b97b67203e2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:44:25.074545 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dde273-ee6b-4ec3-92cd-b97b67203e2a admin admin] PATH_INFO: `/v3/projects/e11740f3d60d4e398ebdbbe34e75bf5f` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:44:25.075993 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dde273-ee6b-4ec3-92cd-b97b67203e2a admin admin] RBAC: Authorizing `identity:delete_project(project_id=e11740f3d60d4e398ebdbbe34e75bf5f)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:44:25.078010 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dde273-ee6b-4ec3-92cd-b97b67203e2a admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:44:25.122090 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:44:25.141104 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-a6dde273-ee6b-4ec3-92cd-b97b67203e2a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e11740f3d60d4e398ebdbbe34e75bf5f', 'request_id': 'req-a6dde273-ee6b-4ec3-92cd-b97b67203e2a'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:44:25.147942 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-a6dde273-ee6b-4ec3-92cd-b97b67203e2a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e11740f3d60d4e398ebdbbe34e75bf5f', 'request_id': 'req-a6dde273-ee6b-4ec3-92cd-b97b67203e2a'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:44:25.155302 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-a6dde273-ee6b-4ec3-92cd-b97b67203e2a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e11740f3d60d4e398ebdbbe34e75bf5f', 'request_id': 'req-a6dde273-ee6b-4ec3-92cd-b97b67203e2a'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:44:25.172224 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-a6dde273-ee6b-4ec3-92cd-b97b67203e2a admin admin] The token cache is being invalidate because project e11740f3d60d4e398ebdbbe34e75bf5f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:44:25.172633 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-a6dde273-ee6b-4ec3-92cd-b97b67203e2a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:44:25.173405 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-a6dde273-ee6b-4ec3-92cd-b97b67203e2a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:44:25.176716 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1198/2391] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jul 11 14:44:25 2022] DELETE /identity/v3/projects/e11740f3d60d4e398ebdbbe34e75bf5f => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:44:25.185742 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb52280-1293-44ec-996e-57cc332813bb None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:44:25.186657 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb52280-1293-44ec-996e-57cc332813bb None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:44:25.186657 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb52280-1293-44ec-996e-57cc332813bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:44:25.214770 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-fbb52280-1293-44ec-996e-57cc332813bb None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:44:25.216231 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-fbb52280-1293-44ec-996e-57cc332813bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:44:25.287129 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1194/2392] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:44:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:44:25.294659 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547e773e-aff8-478b-befd-1f7367b028f7 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:44:25.294950 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547e773e-aff8-478b-befd-1f7367b028f7 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:44:25.295202 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547e773e-aff8-478b-befd-1f7367b028f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:44:25.318321 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-547e773e-aff8-478b-befd-1f7367b028f7 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:44:25.320374 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-547e773e-aff8-478b-befd-1f7367b028f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:44:25.330054 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1199/2393] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:44:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:44:25.335668 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb52280-1293-44ec-996e-57cc332813bb None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:44:25.346043 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb52280-1293-44ec-996e-57cc332813bb None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:44:25.350890 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3254dff5-1226-4373-8ddc-70a0c7b26d93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:44:25.351559 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3254dff5-1226-4373-8ddc-70a0c7b26d93 admin admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:44:25.351841 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3254dff5-1226-4373-8ddc-70a0c7b26d93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:44:25.352112 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3254dff5-1226-4373-8ddc-70a0c7b26d93 admin admin] PATH_INFO: `/v3/domains` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:44:25.352876 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3254dff5-1226-4373-8ddc-70a0c7b26d93 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:44:25.353182 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3254dff5-1226-4373-8ddc-70a0c7b26d93 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:44:25.354770 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3254dff5-1226-4373-8ddc-70a0c7b26d93 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:44:25.368004 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1195/2394] 10.222.0.70 () {58 vars in 1152 bytes} [Mon Jul 11 14:44:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:44:25.374663 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547e773e-aff8-478b-befd-1f7367b028f7 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:44:25.386296 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547e773e-aff8-478b-befd-1f7367b028f7 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:44:25.391086 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60308ae-7176-4b96-8864-e91eaa89ac0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:44:25.391753 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60308ae-7176-4b96-8864-e91eaa89ac0a admin admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:44:25.392036 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60308ae-7176-4b96-8864-e91eaa89ac0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:44:25.392349 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60308ae-7176-4b96-8864-e91eaa89ac0a admin admin] PATH_INFO: `/v3/projects` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:44:25.393048 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60308ae-7176-4b96-8864-e91eaa89ac0a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:44:25.396345 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60308ae-7176-4b96-8864-e91eaa89ac0a admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:44:25.425534 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1200/2395] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jul 11 14:44:25 2022] POST /identity/v3/projects => generated 371 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:44:25.429590 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3254dff5-1226-4373-8ddc-70a0c7b26d93 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:44:25.440414 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3254dff5-1226-4373-8ddc-70a0c7b26d93 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:44:25.499760 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:44:25.515211 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e75651e-09ff-4520-b5f9-367262f2be5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:44:25.516384 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e75651e-09ff-4520-b5f9-367262f2be5f admin admin] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:44:25.516856 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e75651e-09ff-4520-b5f9-367262f2be5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:44:25.517249 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e75651e-09ff-4520-b5f9-367262f2be5f admin admin] PATH_INFO: `/v3/users` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:44:25.518452 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e75651e-09ff-4520-b5f9-367262f2be5f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:44:25.522160 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e75651e-09ff-4520-b5f9-367262f2be5f admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:44:25.553199 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1196/2396] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jul 11 14:44:25 2022] POST /identity/v3/users => generated 286 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:44:25.554671 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60308ae-7176-4b96-8864-e91eaa89ac0a admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:44:25.570313 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60308ae-7176-4b96-8864-e91eaa89ac0a admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:44:25.588427 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f20e9b-f5fa-41dc-a166-47a83de3aa0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:44:25.589226 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f20e9b-f5fa-41dc-a166-47a83de3aa0b admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:44:25.589510 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f20e9b-f5fa-41dc-a166-47a83de3aa0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:44:25.589895 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f20e9b-f5fa-41dc-a166-47a83de3aa0b admin admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:44:25.590714 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f20e9b-f5fa-41dc-a166-47a83de3aa0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:44:25.592427 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f20e9b-f5fa-41dc-a166-47a83de3aa0b admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:44:25.606884 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1201/2397] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:44:25 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:44:25.611417 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e75651e-09ff-4520-b5f9-367262f2be5f admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:44:25.629274 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e75651e-09ff-4520-b5f9-367262f2be5f admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:44:25.634010 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04369458-119e-4027-b4f8-8dbe56df6446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:44:25.634692 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04369458-119e-4027-b4f8-8dbe56df6446 admin admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:44:25.634971 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04369458-119e-4027-b4f8-8dbe56df6446 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:44:25.635326 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04369458-119e-4027-b4f8-8dbe56df6446 admin admin] PATH_INFO: `/v3/roles` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:44:25.636092 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04369458-119e-4027-b4f8-8dbe56df6446 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:44:25.638423 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04369458-119e-4027-b4f8-8dbe56df6446 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:44:25.654877 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1197/2398] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:44:25 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 14:44:25.657413 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f20e9b-f5fa-41dc-a166-47a83de3aa0b admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:44:25.677550 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f20e9b-f5fa-41dc-a166-47a83de3aa0b admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:44:25.684568 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1391929e-b102-4e1d-acd9-97129a1a6535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:44:25.685477 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1391929e-b102-4e1d-acd9-97129a1a6535 admin admin] REQUEST_METHOD: `PUT` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:44:25.685758 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1391929e-b102-4e1d-acd9-97129a1a6535 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:44:25.686034 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1391929e-b102-4e1d-acd9-97129a1a6535 admin admin] PATH_INFO: `/v3/projects/87db6e2922d8452cb5048997f04f7f3c/users/5790f617b4964f1095d121255aa4e1c0/roles/8eff41f243c843ed95505a488ca6eada` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:44:25.716781 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1391929e-b102-4e1d-acd9-97129a1a6535 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87db6e2922d8452cb5048997f04f7f3c, user_id=5790f617b4964f1095d121255aa4e1c0, role_id=8eff41f243c843ed95505a488ca6eada)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:44:25.720104 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1391929e-b102-4e1d-acd9-97129a1a6535 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:44:25.741436 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1202/2399] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jul 11 14:44:25 2022] PUT /identity/v3/projects/87db6e2922d8452cb5048997f04f7f3c/users/5790f617b4964f1095d121255aa4e1c0/roles/8eff41f243c843ed95505a488ca6eada => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:44:25.758311 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cb5d60-fa25-44f2-8e51-3e3a8ba38b9e None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:44:25.758752 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cb5d60-fa25-44f2-8e51-3e3a8ba38b9e None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:44:25.759233 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cb5d60-fa25-44f2-8e51-3e3a8ba38b9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:44:25.802314 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-f7cb5d60-fa25-44f2-8e51-3e3a8ba38b9e None None] MFA Rules not processed for user `5790f617b4964f1095d121255aa4e1c0`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:44:25.803709 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-f7cb5d60-fa25-44f2-8e51-3e3a8ba38b9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:44:25.901502 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1198/2400] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:44:25 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:44:25.914964 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1391929e-b102-4e1d-acd9-97129a1a6535 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:44:25.916817 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-1391929e-b102-4e1d-acd9-97129a1a6535 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:44:26.020072 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1391929e-b102-4e1d-acd9-97129a1a6535 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:44:26.023216 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b16ec4-68cd-422d-a48d-051be0e92a10 None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:44:26.023763 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b16ec4-68cd-422d-a48d-051be0e92a10 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:44:26.023763 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b16ec4-68cd-422d-a48d-051be0e92a10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:44:26.031902 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b55526a-bcea-4135-b735-341419ee1cd6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '868e7c2dec264512b972c8736d659c34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:44:26.032461 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b55526a-bcea-4135-b735-341419ee1cd6 service cinder] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:44:26.032937 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b55526a-bcea-4135-b735-341419ee1cd6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:44:26.033405 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b55526a-bcea-4135-b735-341419ee1cd6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:44:26.048644 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b55526a-bcea-4135-b735-341419ee1cd6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:44:26.049530 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-c9b16ec4-68cd-422d-a48d-051be0e92a10 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:44:26.050126 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b55526a-bcea-4135-b735-341419ee1cd6 service cinder] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:44:26.051540 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-c9b16ec4-68cd-422d-a48d-051be0e92a10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:44:26.062965 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1203/2401] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:44:25 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:44:26.126534 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1199/2402] 10.222.0.62 () {58 vars in 1016 bytes} [Mon Jul 11 14:44:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:44:26.143186 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b55526a-bcea-4135-b735-341419ee1cd6 service cinder] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:44:26.146247 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-0b55526a-bcea-4135-b735-341419ee1cd6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:44:26.232935 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:44:26.265621 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b55526a-bcea-4135-b735-341419ee1cd6 service cinder] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:44:26.276197 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3988086-cbbb-4756-b67b-1a82700c3fa6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4f8c0d696af4bd5a205ca8e9110b8cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:44:26.277340 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3988086-cbbb-4756-b67b-1a82700c3fa6 service nova] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:44:26.277811 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3988086-cbbb-4756-b67b-1a82700c3fa6 service nova] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:44:26.278264 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3988086-cbbb-4756-b67b-1a82700c3fa6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:44:26.305793 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3988086-cbbb-4756-b67b-1a82700c3fa6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:44:26.308938 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3988086-cbbb-4756-b67b-1a82700c3fa6 service nova] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:44:26.329187 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1204/2403] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:44:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:44:36.117325 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=70,keystone:INSERT=3 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:44:36.320465 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=7 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:44:37.472457 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b16ec4-68cd-422d-a48d-051be0e92a10 None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:44:37.482695 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b16ec4-68cd-422d-a48d-051be0e92a10 None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:44:37.487908 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da72611-cc52-47de-a343-e058355fb218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:44:37.489265 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da72611-cc52-47de-a343-e058355fb218 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:44:37.489542 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da72611-cc52-47de-a343-e058355fb218 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:44:37.489812 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da72611-cc52-47de-a343-e058355fb218 admin admin] PATH_INFO: `/v3/users/5790f617b4964f1095d121255aa4e1c0` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:44:37.491085 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da72611-cc52-47de-a343-e058355fb218 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5790f617b4964f1095d121255aa4e1c0)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:44:37.493059 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da72611-cc52-47de-a343-e058355fb218 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:44:37.538963 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-9da72611-cc52-47de-a343-e058355fb218 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5790f617b4964f1095d121255aa4e1c0'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:44:37.546105 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-9da72611-cc52-47de-a343-e058355fb218 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5790f617b4964f1095d121255aa4e1c0'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:44:37.553974 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-9da72611-cc52-47de-a343-e058355fb218 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5790f617b4964f1095d121255aa4e1c0'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:44:37.554585 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-9da72611-cc52-47de-a343-e058355fb218 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5790f617b4964f1095d121255aa4e1c0'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:44:37.555254 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-9da72611-cc52-47de-a343-e058355fb218 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5790f617b4964f1095d121255aa4e1c0'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:44:37.574598 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1200/2404] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jul 11 14:44:37 2022] DELETE /identity/v3/users/5790f617b4964f1095d121255aa4e1c0 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:44:37.579950 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c05118b-34bd-4edb-b561-137a4d4f6874 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:44:37.580838 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c05118b-34bd-4edb-b561-137a4d4f6874 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:44:37.580838 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c05118b-34bd-4edb-b561-137a4d4f6874 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:44:37.600894 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-6c05118b-34bd-4edb-b561-137a4d4f6874 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:44:37.602159 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-6c05118b-34bd-4edb-b561-137a4d4f6874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:44:37.685275 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1205/2405] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:44:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:44:37.700453 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da72611-cc52-47de-a343-e058355fb218 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:44:37.702211 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-9da72611-cc52-47de-a343-e058355fb218 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:44:37.795702 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da72611-cc52-47de-a343-e058355fb218 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:44:37.799412 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57997abd-6ba5-4aa9-ab90-488950050bb7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20eede5ccd834862b00123310b5c3975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:44:37.800646 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57997abd-6ba5-4aa9-ab90-488950050bb7 service neutron] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:44:37.800922 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57997abd-6ba5-4aa9-ab90-488950050bb7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:44:37.801205 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57997abd-6ba5-4aa9-ab90-488950050bb7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:44:37.811520 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57997abd-6ba5-4aa9-ab90-488950050bb7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:44:37.813271 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57997abd-6ba5-4aa9-ab90-488950050bb7 service neutron] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:44:37.825694 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1201/2406] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:44:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:44:38.109164 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c05118b-34bd-4edb-b561-137a4d4f6874 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:44:38.110680 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-6c05118b-34bd-4edb-b561-137a4d4f6874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:44:38.124298 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c05118b-34bd-4edb-b561-137a4d4f6874 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:44:38.129520 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fef781-5b6a-4906-90cd-8ed5a250a0a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:44:38.130410 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fef781-5b6a-4906-90cd-8ed5a250a0a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:44:38.130697 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fef781-5b6a-4906-90cd-8ed5a250a0a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:44:38.130965 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fef781-5b6a-4906-90cd-8ed5a250a0a4 admin admin] PATH_INFO: `/v3/projects/87db6e2922d8452cb5048997f04f7f3c` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:44:38.132284 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fef781-5b6a-4906-90cd-8ed5a250a0a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=87db6e2922d8452cb5048997f04f7f3c)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:44:38.134236 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fef781-5b6a-4906-90cd-8ed5a250a0a4 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:44:38.184460 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-13fef781-5b6a-4906-90cd-8ed5a250a0a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87db6e2922d8452cb5048997f04f7f3c', 'request_id': 'req-13fef781-5b6a-4906-90cd-8ed5a250a0a4'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:44:38.190344 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-13fef781-5b6a-4906-90cd-8ed5a250a0a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87db6e2922d8452cb5048997f04f7f3c', 'request_id': 'req-13fef781-5b6a-4906-90cd-8ed5a250a0a4'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:44:38.197208 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-13fef781-5b6a-4906-90cd-8ed5a250a0a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87db6e2922d8452cb5048997f04f7f3c', 'request_id': 'req-13fef781-5b6a-4906-90cd-8ed5a250a0a4'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:44:38.212939 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-13fef781-5b6a-4906-90cd-8ed5a250a0a4 admin admin] The token cache is being invalidate because project 87db6e2922d8452cb5048997f04f7f3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:44:38.213465 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-13fef781-5b6a-4906-90cd-8ed5a250a0a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:44:38.214247 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-13fef781-5b6a-4906-90cd-8ed5a250a0a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:44:38.216680 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1206/2407] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jul 11 14:44:38 2022] DELETE /identity/v3/projects/87db6e2922d8452cb5048997f04f7f3c => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:44:40.811911 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c87f108-562f-48a1-ab61-e605258c4709 None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:44:40.812874 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c87f108-562f-48a1-ab61-e605258c4709 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:44:40.813159 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c87f108-562f-48a1-ab61-e605258c4709 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:44:40.833477 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-8c87f108-562f-48a1-ab61-e605258c4709 None None] MFA Rules not processed for user `2ef7b195b623456aa0b12dac0a4bf4d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:44:40.834681 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-8c87f108-562f-48a1-ab61-e605258c4709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:44:40.891911 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1202/2408] 10.222.0.70 () {58 vars in 1009 bytes} [Mon Jul 11 14:44:40 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:44:40.914421 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fef781-5b6a-4906-90cd-8ed5a250a0a4 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:44:40.915866 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-13fef781-5b6a-4906-90cd-8ed5a250a0a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:44:40.988358 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fef781-5b6a-4906-90cd-8ed5a250a0a4 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:44:40.993286 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7c73b6-fda7-4f27-9f09-997cc75a9fb2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0217add2f5e74a80a1a33b160cc57a2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:44:40.993934 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7c73b6-fda7-4f27-9f09-997cc75a9fb2 service swift] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:44:40.994219 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7c73b6-fda7-4f27-9f09-997cc75a9fb2 service swift] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:44:40.994491 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7c73b6-fda7-4f27-9f09-997cc75a9fb2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:44:41.003306 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7c73b6-fda7-4f27-9f09-997cc75a9fb2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:44:41.004784 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7c73b6-fda7-4f27-9f09-997cc75a9fb2 service swift] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:44:41.013627 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1207/2409] 10.222.0.70 () {60 vars in 1384 bytes} [Mon Jul 11 14:44:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 14:44:45.244746 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd98a0b-f524-40ab-9b0a-81d65e5c72d0 None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:44:45.245497 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd98a0b-f524-40ab-9b0a-81d65e5c72d0 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:44:45.245497 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd98a0b-f524-40ab-9b0a-81d65e5c72d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:44:45.266508 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-fcd98a0b-f524-40ab-9b0a-81d65e5c72d0 None None] MFA Rules not processed for user `a05157265eef48ee9816f55bfff09a92`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:44:45.267845 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-fcd98a0b-f524-40ab-9b0a-81d65e5c72d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:44:45.286022 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:44:45.345306 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1203/2410] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:44:45 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:44:51.010342 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=86,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:44:55.338035 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=16 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:44:58.456361 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db97783-f641-4f0b-9072-edf92edfb901 None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:44:58.456958 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db97783-f641-4f0b-9072-edf92edfb901 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:44:58.456958 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db97783-f641-4f0b-9072-edf92edfb901 None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:44:58.458558 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1208/2411] 10.222.0.70 () {54 vars in 921 bytes} [Mon Jul 11 14:44:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:44:58.466167 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc08451-8507-49d8-826d-e64e4a2594d4 None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:44:58.466850 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc08451-8507-49d8-826d-e64e4a2594d4 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:44:58.466850 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc08451-8507-49d8-826d-e64e4a2594d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:44:58.488948 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-6fc08451-8507-49d8-826d-e64e4a2594d4 None None] MFA Rules not processed for user `f4f8c0d696af4bd5a205ca8e9110b8cc`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:44:58.490179 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-6fc08451-8507-49d8-826d-e64e4a2594d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:44:58.571434 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1204/2412] 10.222.0.70 () {58 vars in 1018 bytes} [Mon Jul 11 14:44:58 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:44:58.584684 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db97783-f641-4f0b-9072-edf92edfb901 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:44:58.592827 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-4db97783-f641-4f0b-9072-edf92edfb901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:44:58.657692 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db97783-f641-4f0b-9072-edf92edfb901 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:44:58.661930 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b52ca44-06bd-4ade-af9b-e4475dae1c56 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa21b44163d84534b9ca1ffe5b5a6071', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:44:58.662597 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b52ca44-06bd-4ade-af9b-e4475dae1c56 service glance] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:44:58.662878 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b52ca44-06bd-4ade-af9b-e4475dae1c56 service glance] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:44:58.663154 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b52ca44-06bd-4ade-af9b-e4475dae1c56 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:44:58.675272 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b52ca44-06bd-4ade-af9b-e4475dae1c56 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:44:58.676785 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b52ca44-06bd-4ade-af9b-e4475dae1c56 service glance] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:44:58.690029 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1209/2413] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:44:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:44:58.779249 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fa4e0d-1831-42f7-bb9c-8aa4fb2bbcbd None None] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:44:58.779593 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fa4e0d-1831-42f7-bb9c-8aa4fb2bbcbd None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:44:58.779801 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fa4e0d-1831-42f7-bb9c-8aa4fb2bbcbd None None] PATH_INFO: `/` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:44:58.781288 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1205/2414] 10.222.0.70 () {54 vars in 921 bytes} [Mon Jul 11 14:44:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:44:58.788581 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a1a839-252c-460e-ab8b-5935d24152c9 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:44:58.788978 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a1a839-252c-460e-ab8b-5935d24152c9 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:44:58.789211 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a1a839-252c-460e-ab8b-5935d24152c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:44:58.812813 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-d1a1a839-252c-460e-ab8b-5935d24152c9 None None] MFA Rules not processed for user `20eede5ccd834862b00123310b5c3975`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:44:58.814810 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-d1a1a839-252c-460e-ab8b-5935d24152c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:44:58.874130 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1210/2415] 10.222.0.70 () {58 vars in 1018 bytes} [Mon Jul 11 14:44:58 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:44:58.887455 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fa4e0d-1831-42f7-bb9c-8aa4fb2bbcbd None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:44:58.889210 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-b4fa4e0d-1831-42f7-bb9c-8aa4fb2bbcbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:44:58.904742 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fa4e0d-1831-42f7-bb9c-8aa4fb2bbcbd None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:44:58.908978 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79be9455-1db7-4a58-851d-71e70caad40c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20eede5ccd834862b00123310b5c3975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:44:58.909639 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79be9455-1db7-4a58-851d-71e70caad40c service neutron] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:44:58.909923 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79be9455-1db7-4a58-851d-71e70caad40c service neutron] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:44:58.910199 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79be9455-1db7-4a58-851d-71e70caad40c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:44:58.918164 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79be9455-1db7-4a58-851d-71e70caad40c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:44:58.919610 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79be9455-1db7-4a58-851d-71e70caad40c service neutron] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:44:58.929665 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1206/2416] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:44:58 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:44:59.018618 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1ec2fd-f428-40b2-8cbc-82204fba2b28 None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:44:59.018921 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1ec2fd-f428-40b2-8cbc-82204fba2b28 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:44:59.019206 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1ec2fd-f428-40b2-8cbc-82204fba2b28 None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:44:59.020636 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1211/2417] 10.222.0.70 () {54 vars in 921 bytes} [Mon Jul 11 14:44:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:44:59.026445 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19665297-7c4c-4582-be00-4c6a08d6c8bd None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:44:59.026445 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19665297-7c4c-4582-be00-4c6a08d6c8bd None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:44:59.026649 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19665297-7c4c-4582-be00-4c6a08d6c8bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:44:59.045753 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-19665297-7c4c-4582-be00-4c6a08d6c8bd None None] MFA Rules not processed for user `f4f8c0d696af4bd5a205ca8e9110b8cc`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:44:59.047004 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-19665297-7c4c-4582-be00-4c6a08d6c8bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:44:59.057007 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1207/2418] 10.222.0.70 () {58 vars in 1018 bytes} [Mon Jul 11 14:44:59 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:44:59.068769 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1ec2fd-f428-40b2-8cbc-82204fba2b28 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:44:59.070621 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-bb1ec2fd-f428-40b2-8cbc-82204fba2b28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:44:59.084518 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1ec2fd-f428-40b2-8cbc-82204fba2b28 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:44:59.088110 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd508fee-f124-4f7d-ba55-4e4c0a45f3fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20eede5ccd834862b00123310b5c3975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:44:59.089382 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd508fee-f124-4f7d-ba55-4e4c0a45f3fa service neutron] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:44:59.089671 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd508fee-f124-4f7d-ba55-4e4c0a45f3fa service neutron] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:44:59.089949 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd508fee-f124-4f7d-ba55-4e4c0a45f3fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:44:59.101916 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd508fee-f124-4f7d-ba55-4e4c0a45f3fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:44:59.103354 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd508fee-f124-4f7d-ba55-4e4c0a45f3fa service neutron] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:44:59.116029 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1212/2419] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:44:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:45:02.138773 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11909470-cb94-476a-b5db-1ae787dbb12f None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:02.139277 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11909470-cb94-476a-b5db-1ae787dbb12f None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:02.139815 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11909470-cb94-476a-b5db-1ae787dbb12f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:02.164631 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-11909470-cb94-476a-b5db-1ae787dbb12f None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:45:02.165858 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-11909470-cb94-476a-b5db-1ae787dbb12f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:45:02.241057 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1208/2420] 10.222.0.62 () {58 vars in 1016 bytes} [Mon Jul 11 14:45:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:45:02.256720 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd508fee-f124-4f7d-ba55-4e4c0a45f3fa service neutron] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:02.258249 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-cd508fee-f124-4f7d-ba55-4e4c0a45f3fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:45:02.279170 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd508fee-f124-4f7d-ba55-4e4c0a45f3fa service neutron] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:02.285501 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb143e56-ea4d-4240-8612-e5fe031728c4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4f8c0d696af4bd5a205ca8e9110b8cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:02.286166 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb143e56-ea4d-4240-8612-e5fe031728c4 service nova] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:02.286451 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb143e56-ea4d-4240-8612-e5fe031728c4 service nova] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:02.286729 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb143e56-ea4d-4240-8612-e5fe031728c4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:02.296307 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb143e56-ea4d-4240-8612-e5fe031728c4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:02.297909 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb143e56-ea4d-4240-8612-e5fe031728c4 service nova] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:02.309376 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1213/2421] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:45:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:45:02.345200 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79581942-3ce4-4cf4-a853-1345f44657bd None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:02.345618 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79581942-3ce4-4cf4-a853-1345f44657bd None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:02.346081 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79581942-3ce4-4cf4-a853-1345f44657bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:02.364862 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-79581942-3ce4-4cf4-a853-1345f44657bd None None] MFA Rules not processed for user `2ef7b195b623456aa0b12dac0a4bf4d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:45:02.366102 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-79581942-3ce4-4cf4-a853-1345f44657bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:45:02.373472 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1209/2422] 10.222.0.70 () {58 vars in 1009 bytes} [Mon Jul 11 14:45:02 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:45:02.387680 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb143e56-ea4d-4240-8612-e5fe031728c4 service nova] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:02.401075 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb143e56-ea4d-4240-8612-e5fe031728c4 service nova] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:02.409288 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d39828-e785-40c9-ac54-5be8dca9855c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0217add2f5e74a80a1a33b160cc57a2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:02.410029 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d39828-e785-40c9-ac54-5be8dca9855c service swift] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:02.410318 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d39828-e785-40c9-ac54-5be8dca9855c service swift] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:02.410595 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d39828-e785-40c9-ac54-5be8dca9855c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:02.419896 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d39828-e785-40c9-ac54-5be8dca9855c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:02.421551 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d39828-e785-40c9-ac54-5be8dca9855c service swift] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:02.431056 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1214/2423] 10.222.0.70 () {60 vars in 1384 bytes} [Mon Jul 11 14:45:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 14:45:12.359195 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=70 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:45:12.426996 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=67 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:45:20.895469 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8d495d-e8c3-40f7-9898-f577893d85f3 None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:20.896059 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8d495d-e8c3-40f7-9898-f577893d85f3 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:20.896059 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8d495d-e8c3-40f7-9898-f577893d85f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:20.914060 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-6c8d495d-e8c3-40f7-9898-f577893d85f3 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:45:20.915263 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-6c8d495d-e8c3-40f7-9898-f577893d85f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:45:20.923714 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1210/2424] 10.222.0.62 () {58 vars in 1016 bytes} [Mon Jul 11 14:45:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:45:20.937416 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d39828-e785-40c9-ac54-5be8dca9855c service swift] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:20.939782 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-16d39828-e785-40c9-ac54-5be8dca9855c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:45:20.956906 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d39828-e785-40c9-ac54-5be8dca9855c service swift] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:20.962720 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d599f4-32d1-4a2c-a49c-09f7a1b0d282 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4f8c0d696af4bd5a205ca8e9110b8cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:20.963365 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d599f4-32d1-4a2c-a49c-09f7a1b0d282 service nova] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:20.963646 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d599f4-32d1-4a2c-a49c-09f7a1b0d282 service nova] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:20.963924 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d599f4-32d1-4a2c-a49c-09f7a1b0d282 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:20.972816 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d599f4-32d1-4a2c-a49c-09f7a1b0d282 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:20.974414 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d599f4-32d1-4a2c-a49c-09f7a1b0d282 service nova] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:20.984141 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1215/2425] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:45:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:45:26.042833 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8331f1ed-d173-4b94-a31e-63705a0d28f9 None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:26.043350 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8331f1ed-d173-4b94-a31e-63705a0d28f9 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:26.043459 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8331f1ed-d173-4b94-a31e-63705a0d28f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:26.064479 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-8331f1ed-d173-4b94-a31e-63705a0d28f9 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:45:26.065778 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-8331f1ed-d173-4b94-a31e-63705a0d28f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:45:26.074267 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1211/2426] 10.222.0.62 () {58 vars in 1016 bytes} [Mon Jul 11 14:45:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:45:26.089382 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d599f4-32d1-4a2c-a49c-09f7a1b0d282 service nova] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:26.101481 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d599f4-32d1-4a2c-a49c-09f7a1b0d282 service nova] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:26.109066 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f694281-7353-4b7e-a206-f6186e88f790 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4f8c0d696af4bd5a205ca8e9110b8cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:26.109066 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f694281-7353-4b7e-a206-f6186e88f790 service nova] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:26.109066 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f694281-7353-4b7e-a206-f6186e88f790 service nova] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:26.109066 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f694281-7353-4b7e-a206-f6186e88f790 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:26.118356 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f694281-7353-4b7e-a206-f6186e88f790 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:26.120005 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f694281-7353-4b7e-a206-f6186e88f790 service nova] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:26.131294 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1216/2427] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:45:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:45:29.511756 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad2e77f-993e-4fab-85d3-31183ac70637 None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:29.513250 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad2e77f-993e-4fab-85d3-31183ac70637 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:29.513562 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad2e77f-993e-4fab-85d3-31183ac70637 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:29.535475 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-cad2e77f-993e-4fab-85d3-31183ac70637 None None] MFA Rules not processed for user `2ef7b195b623456aa0b12dac0a4bf4d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:45:29.536758 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-cad2e77f-993e-4fab-85d3-31183ac70637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:45:29.544080 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1212/2428] 10.222.0.70 () {58 vars in 967 bytes} [Mon Jul 11 14:45:29 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:45:29.558710 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f694281-7353-4b7e-a206-f6186e88f790 service nova] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:29.573245 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f694281-7353-4b7e-a206-f6186e88f790 service nova] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:29.580787 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af677be-515d-4f8b-a3f2-d45a4c9b8206 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0217add2f5e74a80a1a33b160cc57a2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:29.581441 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af677be-515d-4f8b-a3f2-d45a4c9b8206 service swift] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:29.581724 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af677be-515d-4f8b-a3f2-d45a4c9b8206 service swift] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:29.581998 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af677be-515d-4f8b-a3f2-d45a4c9b8206 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:29.590675 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af677be-515d-4f8b-a3f2-d45a4c9b8206 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:29.592195 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af677be-515d-4f8b-a3f2-d45a4c9b8206 service swift] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:29.601899 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1217/2429] 10.222.0.70 () {60 vars in 1384 bytes} [Mon Jul 11 14:45:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 11 14:45:31.289331 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d02df78-faa1-4cd5-b6d4-9bdfaeb622d2 None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:31.289848 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d02df78-faa1-4cd5-b6d4-9bdfaeb622d2 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:31.289966 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d02df78-faa1-4cd5-b6d4-9bdfaeb622d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:31.312653 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-3d02df78-faa1-4cd5-b6d4-9bdfaeb622d2 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:45:31.313923 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-3d02df78-faa1-4cd5-b6d4-9bdfaeb622d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:45:31.323017 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1213/2430] 10.222.0.62 () {58 vars in 1016 bytes} [Mon Jul 11 14:45:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:45:31.339044 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af677be-515d-4f8b-a3f2-d45a4c9b8206 service swift] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:31.352224 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af677be-515d-4f8b-a3f2-d45a4c9b8206 service swift] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:31.357793 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bc3ade-f256-4029-94d2-4d19f523cbd7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4f8c0d696af4bd5a205ca8e9110b8cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:31.358449 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bc3ade-f256-4029-94d2-4d19f523cbd7 service nova] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:31.358737 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bc3ade-f256-4029-94d2-4d19f523cbd7 service nova] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:31.359038 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bc3ade-f256-4029-94d2-4d19f523cbd7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:31.368943 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bc3ade-f256-4029-94d2-4d19f523cbd7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:31.370538 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bc3ade-f256-4029-94d2-4d19f523cbd7 service nova] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:31.381026 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1218/2431] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:45:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:45:35.504321 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a235cd-8a30-4577-834f-26f39ec71bda None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:35.504872 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a235cd-8a30-4577-834f-26f39ec71bda None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:35.504872 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a235cd-8a30-4577-834f-26f39ec71bda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:35.524060 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-b6a235cd-8a30-4577-834f-26f39ec71bda None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:45:35.525290 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-b6a235cd-8a30-4577-834f-26f39ec71bda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:45:35.545469 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1214/2432] 10.222.0.62 () {58 vars in 1016 bytes} [Mon Jul 11 14:45:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:45:35.561568 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bc3ade-f256-4029-94d2-4d19f523cbd7 service nova] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:35.576715 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bc3ade-f256-4029-94d2-4d19f523cbd7 service nova] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:35.585515 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f749cf-f89c-46bf-bdf4-67a74df77106 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4f8c0d696af4bd5a205ca8e9110b8cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:35.586158 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f749cf-f89c-46bf-bdf4-67a74df77106 service nova] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:35.586440 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f749cf-f89c-46bf-bdf4-67a74df77106 service nova] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:35.586713 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f749cf-f89c-46bf-bdf4-67a74df77106 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:35.597697 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f749cf-f89c-46bf-bdf4-67a74df77106 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:35.599284 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f749cf-f89c-46bf-bdf4-67a74df77106 service nova] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:35.611794 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1219/2433] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:45:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:45:45.518867 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=15 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:45:45.605951 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=30 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:45:50.022003 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc7c437-182c-4087-be77-340466ad08ec None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:50.022561 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc7c437-182c-4087-be77-340466ad08ec None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:50.022723 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc7c437-182c-4087-be77-340466ad08ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:50.041217 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-dbc7c437-182c-4087-be77-340466ad08ec None None] MFA Rules not processed for user `fee6e5aa4b4947faa8b6f7937250986b`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:45:50.042340 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-dbc7c437-182c-4087-be77-340466ad08ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:45:50.097650 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1215/2434] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:45:50 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:46:00.089993 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=25 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:46:02.324708 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f749cf-f89c-46bf-bdf4-67a74df77106 service nova] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:02.326800 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-f3f749cf-f89c-46bf-bdf4-67a74df77106 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:02.383230 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f749cf-f89c-46bf-bdf4-67a74df77106 service nova] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:02.386874 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcc09b3-af59-4eea-adde-ed96e35fe64a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '868e7c2dec264512b972c8736d659c34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:02.387517 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcc09b3-af59-4eea-adde-ed96e35fe64a service cinder] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:02.387805 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcc09b3-af59-4eea-adde-ed96e35fe64a service cinder] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:02.388079 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcc09b3-af59-4eea-adde-ed96e35fe64a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:02.389953 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-bbcc09b3-af59-4eea-adde-ed96e35fe64a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:02.403330 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcc09b3-af59-4eea-adde-ed96e35fe64a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:02.404797 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcc09b3-af59-4eea-adde-ed96e35fe64a service cinder] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:02.415701 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1220/2435] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:46:02 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:46:03.856835 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc7c437-182c-4087-be77-340466ad08ec None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:03.868888 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc7c437-182c-4087-be77-340466ad08ec None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:03.872834 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4072cc43-6695-472b-a7ac-5cc4c5875ce6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20eede5ccd834862b00123310b5c3975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:03.873568 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4072cc43-6695-472b-a7ac-5cc4c5875ce6 service neutron] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:03.873913 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4072cc43-6695-472b-a7ac-5cc4c5875ce6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:03.874360 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4072cc43-6695-472b-a7ac-5cc4c5875ce6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:03.876417 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-4072cc43-6695-472b-a7ac-5cc4c5875ce6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:03.892196 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4072cc43-6695-472b-a7ac-5cc4c5875ce6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:03.893662 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4072cc43-6695-472b-a7ac-5cc4c5875ce6 service neutron] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:03.905031 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1216/2436] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:46:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:46:09.247014 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcc09b3-af59-4eea-adde-ed96e35fe64a service cinder] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:09.249597 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-bbcc09b3-af59-4eea-adde-ed96e35fe64a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:09.265460 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcc09b3-af59-4eea-adde-ed96e35fe64a service cinder] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:09.270663 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81479d3e-f13d-4880-8b47-170c08fe865e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:09.271575 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81479d3e-f13d-4880-8b47-170c08fe865e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:09.271863 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81479d3e-f13d-4880-8b47-170c08fe865e admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:09.272140 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81479d3e-f13d-4880-8b47-170c08fe865e admin admin] PATH_INFO: `/v3/users/a05157265eef48ee9816f55bfff09a92` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:09.273471 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81479d3e-f13d-4880-8b47-170c08fe865e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a05157265eef48ee9816f55bfff09a92)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:09.275458 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81479d3e-f13d-4880-8b47-170c08fe865e admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:09.345349 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-81479d3e-f13d-4880-8b47-170c08fe865e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a05157265eef48ee9816f55bfff09a92'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:09.353345 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-81479d3e-f13d-4880-8b47-170c08fe865e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a05157265eef48ee9816f55bfff09a92'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:09.362730 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-81479d3e-f13d-4880-8b47-170c08fe865e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a05157265eef48ee9816f55bfff09a92'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:09.363454 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-81479d3e-f13d-4880-8b47-170c08fe865e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a05157265eef48ee9816f55bfff09a92'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:09.364093 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-81479d3e-f13d-4880-8b47-170c08fe865e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a05157265eef48ee9816f55bfff09a92'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:09.383764 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1221/2437] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jul 11 14:46:09 2022] DELETE /identity/v3/users/a05157265eef48ee9816f55bfff09a92 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:46:09.586553 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4072cc43-6695-472b-a7ac-5cc4c5875ce6 service neutron] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:09.605997 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4072cc43-6695-472b-a7ac-5cc4c5875ce6 service neutron] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:09.677037 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02ae79f-65c3-471f-8eda-a0cb83d94c61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:09.677984 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02ae79f-65c3-471f-8eda-a0cb83d94c61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:09.678290 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02ae79f-65c3-471f-8eda-a0cb83d94c61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:09.678576 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02ae79f-65c3-471f-8eda-a0cb83d94c61 admin admin] PATH_INFO: `/v3/projects/b3c0900bc4a043d49fa17051ce3529b1` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:09.679875 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02ae79f-65c3-471f-8eda-a0cb83d94c61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3c0900bc4a043d49fa17051ce3529b1)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:09.681960 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02ae79f-65c3-471f-8eda-a0cb83d94c61 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:09.738892 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-e02ae79f-65c3-471f-8eda-a0cb83d94c61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3c0900bc4a043d49fa17051ce3529b1', 'request_id': 'req-e02ae79f-65c3-471f-8eda-a0cb83d94c61'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:09.745607 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-e02ae79f-65c3-471f-8eda-a0cb83d94c61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3c0900bc4a043d49fa17051ce3529b1', 'request_id': 'req-e02ae79f-65c3-471f-8eda-a0cb83d94c61'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:09.755838 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-e02ae79f-65c3-471f-8eda-a0cb83d94c61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3c0900bc4a043d49fa17051ce3529b1', 'request_id': 'req-e02ae79f-65c3-471f-8eda-a0cb83d94c61'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:09.769355 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-e02ae79f-65c3-471f-8eda-a0cb83d94c61 admin admin] The token cache is being invalidate because project b3c0900bc4a043d49fa17051ce3529b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80534) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:46:09.769664 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-e02ae79f-65c3-471f-8eda-a0cb83d94c61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:09.770333 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-e02ae79f-65c3-471f-8eda-a0cb83d94c61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:46:09.772174 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1217/2438] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jul 11 14:46:09 2022] DELETE /identity/v3/projects/b3c0900bc4a043d49fa17051ce3529b1 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:46:14.439131 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b5f427-55fa-46aa-bc2d-25f33342325c None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:14.439680 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b5f427-55fa-46aa-bc2d-25f33342325c None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:14.439680 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b5f427-55fa-46aa-bc2d-25f33342325c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:14.459332 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-98b5f427-55fa-46aa-bc2d-25f33342325c None None] MFA Rules not processed for user `caa770e36e624905b2e23610e901e22d`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:46:14.460613 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-98b5f427-55fa-46aa-bc2d-25f33342325c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:14.527488 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1222/2439] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:46:14 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:46:14.845663 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02ae79f-65c3-471f-8eda-a0cb83d94c61 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:14.847134 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-e02ae79f-65c3-471f-8eda-a0cb83d94c61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:14.912312 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02ae79f-65c3-471f-8eda-a0cb83d94c61 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:14.915949 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac84ddd6-2a8a-4024-849a-f3b00ec37ca5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20eede5ccd834862b00123310b5c3975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:14.916643 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac84ddd6-2a8a-4024-849a-f3b00ec37ca5 service neutron] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:14.916926 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac84ddd6-2a8a-4024-849a-f3b00ec37ca5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:14.917196 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac84ddd6-2a8a-4024-849a-f3b00ec37ca5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:14.919570 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-ac84ddd6-2a8a-4024-849a-f3b00ec37ca5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:14.930829 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac84ddd6-2a8a-4024-849a-f3b00ec37ca5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:14.932679 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac84ddd6-2a8a-4024-849a-f3b00ec37ca5 service neutron] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:14.943321 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1218/2440] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:46:14 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:46:15.283185 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b5f427-55fa-46aa-bc2d-25f33342325c None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:15.284712 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-98b5f427-55fa-46aa-bc2d-25f33342325c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:15.309451 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:46:15.376846 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b5f427-55fa-46aa-bc2d-25f33342325c None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:15.382693 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a647510d-85dc-4af1-b95e-aadea74fee24 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bf25c7951dc4182996335ca1f0e56ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:15.383468 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a647510d-85dc-4af1-b95e-aadea74fee24 service placement] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:15.383796 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a647510d-85dc-4af1-b95e-aadea74fee24 service placement] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:15.384136 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a647510d-85dc-4af1-b95e-aadea74fee24 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:15.386250 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-a647510d-85dc-4af1-b95e-aadea74fee24 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:15.400923 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a647510d-85dc-4af1-b95e-aadea74fee24 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:15.402442 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a647510d-85dc-4af1-b95e-aadea74fee24 service placement] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:15.415157 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1223/2441] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:46:15 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:46:23.389548 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac84ddd6-2a8a-4024-849a-f3b00ec37ca5 service neutron] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:23.391324 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-ac84ddd6-2a8a-4024-849a-f3b00ec37ca5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:23.427061 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:46:23.493508 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac84ddd6-2a8a-4024-849a-f3b00ec37ca5 service neutron] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:23.499685 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678b5f8c-3c38-43ed-b366-461dcbd27f99 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4f8c0d696af4bd5a205ca8e9110b8cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:23.500373 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678b5f8c-3c38-43ed-b366-461dcbd27f99 service nova] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:23.500654 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678b5f8c-3c38-43ed-b366-461dcbd27f99 service nova] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:23.500923 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678b5f8c-3c38-43ed-b366-461dcbd27f99 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:23.502720 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-678b5f8c-3c38-43ed-b366-461dcbd27f99 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:23.514494 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678b5f8c-3c38-43ed-b366-461dcbd27f99 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:23.516072 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678b5f8c-3c38-43ed-b366-461dcbd27f99 service nova] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:23.525702 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1219/2442] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:46:23 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:46:25.410188 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=23 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:46:33.521315 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=25 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:46:37.588718 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a647510d-85dc-4af1-b95e-aadea74fee24 service placement] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:37.591299 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-a647510d-85dc-4af1-b95e-aadea74fee24 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:37.609033 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a647510d-85dc-4af1-b95e-aadea74fee24 service placement] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:37.614955 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35aea7f9-6b9b-4f86-8885-a875c01553a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4f8c0d696af4bd5a205ca8e9110b8cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:37.615700 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aea7f9-6b9b-4f86-8885-a875c01553a8 service nova] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:37.617385 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aea7f9-6b9b-4f86-8885-a875c01553a8 service nova] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:37.617714 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aea7f9-6b9b-4f86-8885-a875c01553a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:37.619602 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-35aea7f9-6b9b-4f86-8885-a875c01553a8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:37.685278 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35aea7f9-6b9b-4f86-8885-a875c01553a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:37.687076 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35aea7f9-6b9b-4f86-8885-a875c01553a8 service nova] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:37.696288 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1224/2443] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:46:37 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:46:42.396364 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678b5f8c-3c38-43ed-b366-461dcbd27f99 service nova] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:42.412656 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678b5f8c-3c38-43ed-b366-461dcbd27f99 service nova] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:42.419642 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0970c70a-19d9-4fbd-a635-2106a61bd8de service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4f8c0d696af4bd5a205ca8e9110b8cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:42.420481 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0970c70a-19d9-4fbd-a635-2106a61bd8de service nova] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:42.420953 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0970c70a-19d9-4fbd-a635-2106a61bd8de service nova] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:42.421236 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0970c70a-19d9-4fbd-a635-2106a61bd8de service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:42.423259 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-0970c70a-19d9-4fbd-a635-2106a61bd8de service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:42.439884 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0970c70a-19d9-4fbd-a635-2106a61bd8de service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:42.441761 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0970c70a-19d9-4fbd-a635-2106a61bd8de service nova] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:42.465926 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1220/2444] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:46:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:46:46.385300 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6e36d3-94e2-457d-8820-0c924f285fe8 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:46.385898 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6e36d3-94e2-457d-8820-0c924f285fe8 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:46.385898 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6e36d3-94e2-457d-8820-0c924f285fe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:46.404544 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-9b6e36d3-94e2-457d-8820-0c924f285fe8 None None] MFA Rules not processed for user `8d5ccf016a41426cb589005da57bbf6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:46:46.406640 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-9b6e36d3-94e2-457d-8820-0c924f285fe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:46.415039 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1225/2445] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:46:46 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:46:46.743001 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0970c70a-19d9-4fbd-a635-2106a61bd8de service nova] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:46.752883 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0970c70a-19d9-4fbd-a635-2106a61bd8de service nova] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:46.756488 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feeb7a57-b8e6-4c3a-a8a6-7de149f7e10f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20eede5ccd834862b00123310b5c3975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:46.757150 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeb7a57-b8e6-4c3a-a8a6-7de149f7e10f service neutron] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:46.757432 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeb7a57-b8e6-4c3a-a8a6-7de149f7e10f service neutron] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:46.757705 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeb7a57-b8e6-4c3a-a8a6-7de149f7e10f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:46.759567 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-feeb7a57-b8e6-4c3a-a8a6-7de149f7e10f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:46.771172 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feeb7a57-b8e6-4c3a-a8a6-7de149f7e10f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:46.772684 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feeb7a57-b8e6-4c3a-a8a6-7de149f7e10f service neutron] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:46.783542 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1221/2446] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:46:46 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:46:48.980004 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6e36d3-94e2-457d-8820-0c924f285fe8 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:48.982190 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-9b6e36d3-94e2-457d-8820-0c924f285fe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:48.997610 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6e36d3-94e2-457d-8820-0c924f285fe8 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:49.001683 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65e3e7f-7d53-4370-af6d-0387abb60cd9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20eede5ccd834862b00123310b5c3975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:49.002763 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65e3e7f-7d53-4370-af6d-0387abb60cd9 service neutron] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:49.003005 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65e3e7f-7d53-4370-af6d-0387abb60cd9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:49.003258 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65e3e7f-7d53-4370-af6d-0387abb60cd9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:49.005491 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-a65e3e7f-7d53-4370-af6d-0387abb60cd9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:49.017417 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65e3e7f-7d53-4370-af6d-0387abb60cd9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:49.018944 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65e3e7f-7d53-4370-af6d-0387abb60cd9 service neutron] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:49.029357 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1226/2447] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:46:48 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:46:56.268341 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feeb7a57-b8e6-4c3a-a8a6-7de149f7e10f service neutron] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:46:56.288059 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feeb7a57-b8e6-4c3a-a8a6-7de149f7e10f service neutron] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:46:56.296321 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabb3e66-6ade-4a8a-a62f-b65da68ca499 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4f8c0d696af4bd5a205ca8e9110b8cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:46:56.297204 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabb3e66-6ade-4a8a-a62f-b65da68ca499 service nova] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:46:56.297618 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabb3e66-6ade-4a8a-a62f-b65da68ca499 service nova] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:46:56.298083 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabb3e66-6ade-4a8a-a62f-b65da68ca499 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:46:56.300581 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-eabb3e66-6ade-4a8a-a62f-b65da68ca499 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:46:56.331996 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabb3e66-6ade-4a8a-a62f-b65da68ca499 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:46:56.334646 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabb3e66-6ade-4a8a-a62f-b65da68ca499 service nova] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:46:56.350447 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1222/2448] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:46:56 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:46:59.024007 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=37 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:47:00.035624 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65e3e7f-7d53-4370-af6d-0387abb60cd9 service neutron] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:00.049922 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65e3e7f-7d53-4370-af6d-0387abb60cd9 service neutron] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:00.055575 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61079cf1-35fd-4519-a1db-6119512127f1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4f8c0d696af4bd5a205ca8e9110b8cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:00.056250 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61079cf1-35fd-4519-a1db-6119512127f1 service nova] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:00.056542 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61079cf1-35fd-4519-a1db-6119512127f1 service nova] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:00.056834 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61079cf1-35fd-4519-a1db-6119512127f1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:00.059438 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-61079cf1-35fd-4519-a1db-6119512127f1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:00.072509 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61079cf1-35fd-4519-a1db-6119512127f1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:00.074256 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61079cf1-35fd-4519-a1db-6119512127f1 service nova] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:00.086358 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1227/2449] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:47:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:47:00.603210 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabb3e66-6ade-4a8a-a62f-b65da68ca499 service nova] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:00.605526 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-eabb3e66-6ade-4a8a-a62f-b65da68ca499 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:00.670813 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabb3e66-6ade-4a8a-a62f-b65da68ca499 service nova] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:00.674539 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdaff23-1893-4316-9456-8a0b8b951535 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '868e7c2dec264512b972c8736d659c34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:00.675279 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdaff23-1893-4316-9456-8a0b8b951535 service cinder] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:00.675631 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdaff23-1893-4316-9456-8a0b8b951535 service cinder] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:00.675976 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdaff23-1893-4316-9456-8a0b8b951535 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:00.678028 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-dcdaff23-1893-4316-9456-8a0b8b951535 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:00.747299 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdaff23-1893-4316-9456-8a0b8b951535 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:00.748916 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdaff23-1893-4316-9456-8a0b8b951535 service cinder] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:00.760180 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1223/2450] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:47:00 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:47:10.081339 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=6 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:47:10.754699 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=66 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:47:19.582588 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61079cf1-35fd-4519-a1db-6119512127f1 service nova] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:19.592563 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61079cf1-35fd-4519-a1db-6119512127f1 service nova] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:19.596100 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72de4712-51c2-48f3-ac67-67b299155b04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20eede5ccd834862b00123310b5c3975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:19.596773 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72de4712-51c2-48f3-ac67-67b299155b04 service neutron] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:19.597057 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72de4712-51c2-48f3-ac67-67b299155b04 service neutron] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:19.597333 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72de4712-51c2-48f3-ac67-67b299155b04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:19.599126 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-72de4712-51c2-48f3-ac67-67b299155b04 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:19.662995 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72de4712-51c2-48f3-ac67-67b299155b04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:19.664454 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72de4712-51c2-48f3-ac67-67b299155b04 service neutron] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:19.675182 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1228/2451] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:47:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:47:22.788933 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdaff23-1893-4316-9456-8a0b8b951535 service cinder] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:22.791290 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-dcdaff23-1893-4316-9456-8a0b8b951535 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:22.807803 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdaff23-1893-4316-9456-8a0b8b951535 service cinder] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:22.818003 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd72733-4fcd-4332-8107-9fb91b44a5ed service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bf25c7951dc4182996335ca1f0e56ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:22.819283 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd72733-4fcd-4332-8107-9fb91b44a5ed service placement] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:22.820031 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd72733-4fcd-4332-8107-9fb91b44a5ed service placement] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:22.820582 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd72733-4fcd-4332-8107-9fb91b44a5ed service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:22.823841 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-fbd72733-4fcd-4332-8107-9fb91b44a5ed service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:22.844878 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd72733-4fcd-4332-8107-9fb91b44a5ed service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:22.846743 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd72733-4fcd-4332-8107-9fb91b44a5ed service placement] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:22.861153 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1224/2452] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:47:22 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:47:22.875080 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72de4712-51c2-48f3-ac67-67b299155b04 service neutron] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:22.878660 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-72de4712-51c2-48f3-ac67-67b299155b04 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:22.900168 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72de4712-51c2-48f3-ac67-67b299155b04 service neutron] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:22.910253 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb80cbf-f42d-4aff-82bb-61e863f9e52a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:22.911384 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb80cbf-f42d-4aff-82bb-61e863f9e52a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:22.911670 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb80cbf-f42d-4aff-82bb-61e863f9e52a admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:22.912038 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb80cbf-f42d-4aff-82bb-61e863f9e52a admin admin] PATH_INFO: `/v3/users/fee6e5aa4b4947faa8b6f7937250986b` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:22.913228 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb80cbf-f42d-4aff-82bb-61e863f9e52a admin admin] RBAC: Authorizing `identity:delete_user(user_id=fee6e5aa4b4947faa8b6f7937250986b)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:22.916437 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb80cbf-f42d-4aff-82bb-61e863f9e52a admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:22.970109 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-5bb80cbf-f42d-4aff-82bb-61e863f9e52a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fee6e5aa4b4947faa8b6f7937250986b'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:22.978832 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-5bb80cbf-f42d-4aff-82bb-61e863f9e52a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fee6e5aa4b4947faa8b6f7937250986b'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:22.986425 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-5bb80cbf-f42d-4aff-82bb-61e863f9e52a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fee6e5aa4b4947faa8b6f7937250986b'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:22.987037 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-5bb80cbf-f42d-4aff-82bb-61e863f9e52a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fee6e5aa4b4947faa8b6f7937250986b'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:22.987651 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-5bb80cbf-f42d-4aff-82bb-61e863f9e52a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fee6e5aa4b4947faa8b6f7937250986b'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:23.006685 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1229/2453] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jul 11 14:47:22 2022] DELETE /identity/v3/users/fee6e5aa4b4947faa8b6f7937250986b => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:47:23.185488 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd72733-4fcd-4332-8107-9fb91b44a5ed service placement] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:23.198948 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd72733-4fcd-4332-8107-9fb91b44a5ed service placement] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:23.261518 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e111bb77-ce06-4374-ad1e-c11089e42fd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:23.262379 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e111bb77-ce06-4374-ad1e-c11089e42fd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:23.262658 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e111bb77-ce06-4374-ad1e-c11089e42fd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:23.262931 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e111bb77-ce06-4374-ad1e-c11089e42fd8 admin admin] PATH_INFO: `/v3/projects/825d34a4f14e4f7eb8981e67b936a77f` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:23.264111 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e111bb77-ce06-4374-ad1e-c11089e42fd8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=825d34a4f14e4f7eb8981e67b936a77f)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:23.266071 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e111bb77-ce06-4374-ad1e-c11089e42fd8 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:23.315511 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-e111bb77-ce06-4374-ad1e-c11089e42fd8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '825d34a4f14e4f7eb8981e67b936a77f', 'request_id': 'req-e111bb77-ce06-4374-ad1e-c11089e42fd8'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:23.322445 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-e111bb77-ce06-4374-ad1e-c11089e42fd8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '825d34a4f14e4f7eb8981e67b936a77f', 'request_id': 'req-e111bb77-ce06-4374-ad1e-c11089e42fd8'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:23.329527 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-e111bb77-ce06-4374-ad1e-c11089e42fd8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '825d34a4f14e4f7eb8981e67b936a77f', 'request_id': 'req-e111bb77-ce06-4374-ad1e-c11089e42fd8'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:23.340854 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-e111bb77-ce06-4374-ad1e-c11089e42fd8 admin admin] The token cache is being invalidate because project 825d34a4f14e4f7eb8981e67b936a77f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80534) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:47:23.341139 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-e111bb77-ce06-4374-ad1e-c11089e42fd8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:23.341769 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-e111bb77-ce06-4374-ad1e-c11089e42fd8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:23.343351 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1225/2454] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jul 11 14:47:23 2022] DELETE /identity/v3/projects/825d34a4f14e4f7eb8981e67b936a77f => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:47:23.348449 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04d264c-d422-4057-8a25-b5548671aeb3 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:23.348746 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04d264c-d422-4057-8a25-b5548671aeb3 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:23.349024 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04d264c-d422-4057-8a25-b5548671aeb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:23.368373 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-d04d264c-d422-4057-8a25-b5548671aeb3 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:47:23.369588 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-d04d264c-d422-4057-8a25-b5548671aeb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:23.429417 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1230/2455] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:47:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:47:23.437943 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320ad2a1-3001-45fa-9424-46f450bc0586 None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:23.438230 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320ad2a1-3001-45fa-9424-46f450bc0586 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:23.438508 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320ad2a1-3001-45fa-9424-46f450bc0586 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:23.456803 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-320ad2a1-3001-45fa-9424-46f450bc0586 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:47:23.458018 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-320ad2a1-3001-45fa-9424-46f450bc0586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:23.465988 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1226/2456] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:47:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:47:23.470331 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04d264c-d422-4057-8a25-b5548671aeb3 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:23.480900 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04d264c-d422-4057-8a25-b5548671aeb3 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:23.485544 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2055cb-d592-4eaa-9517-82632cded634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:23.486231 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2055cb-d592-4eaa-9517-82632cded634 admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:23.486512 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2055cb-d592-4eaa-9517-82632cded634 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:23.486787 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2055cb-d592-4eaa-9517-82632cded634 admin admin] PATH_INFO: `/v3/domains` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:23.487511 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2055cb-d592-4eaa-9517-82632cded634 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:47:23.487815 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2055cb-d592-4eaa-9517-82632cded634 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:23.489442 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2055cb-d592-4eaa-9517-82632cded634 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:23.490995 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:47:23.503221 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1231/2457] 10.222.0.70 () {58 vars in 1152 bytes} [Mon Jul 11 14:47:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:47:23.507293 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320ad2a1-3001-45fa-9424-46f450bc0586 None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:23.517142 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320ad2a1-3001-45fa-9424-46f450bc0586 None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:23.521817 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e44e9a3-3a1b-463f-b9e5-dddf2512af3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:23.522468 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e44e9a3-3a1b-463f-b9e5-dddf2512af3e admin admin] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:23.522751 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e44e9a3-3a1b-463f-b9e5-dddf2512af3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:23.523029 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e44e9a3-3a1b-463f-b9e5-dddf2512af3e admin admin] PATH_INFO: `/v3/projects` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:23.523725 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e44e9a3-3a1b-463f-b9e5-dddf2512af3e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:23.526289 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e44e9a3-3a1b-463f-b9e5-dddf2512af3e admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:23.565438 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1227/2458] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jul 11 14:47:23 2022] POST /identity/v3/projects => generated 367 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:47:23.569887 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2055cb-d592-4eaa-9517-82632cded634 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:23.581851 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2055cb-d592-4eaa-9517-82632cded634 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:23.641765 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ccae6d-c248-4dff-94b2-fb352ad6cea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:23.642432 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ccae6d-c248-4dff-94b2-fb352ad6cea2 admin admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:23.642720 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ccae6d-c248-4dff-94b2-fb352ad6cea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:23.642999 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ccae6d-c248-4dff-94b2-fb352ad6cea2 admin admin] PATH_INFO: `/v3/users` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:23.643692 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ccae6d-c248-4dff-94b2-fb352ad6cea2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:23.645656 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ccae6d-c248-4dff-94b2-fb352ad6cea2 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:23.666400 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1232/2459] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jul 11 14:47:23 2022] POST /identity/v3/users => generated 284 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:47:23.670527 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e44e9a3-3a1b-463f-b9e5-dddf2512af3e admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:23.680863 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e44e9a3-3a1b-463f-b9e5-dddf2512af3e admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:23.685625 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bad147-1a76-4aca-bf18-6f7f87b82405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:23.686272 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bad147-1a76-4aca-bf18-6f7f87b82405 admin admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:23.686549 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bad147-1a76-4aca-bf18-6f7f87b82405 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:23.686816 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bad147-1a76-4aca-bf18-6f7f87b82405 admin admin] PATH_INFO: `/v3/roles` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:23.687538 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bad147-1a76-4aca-bf18-6f7f87b82405 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:23.689139 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bad147-1a76-4aca-bf18-6f7f87b82405 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:23.700853 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1228/2460] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:47:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:47:23.705106 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ccae6d-c248-4dff-94b2-fb352ad6cea2 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:23.715928 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ccae6d-c248-4dff-94b2-fb352ad6cea2 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:23.720553 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7eea3f-71a2-4e1a-bade-4677f1638f39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:23.721202 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7eea3f-71a2-4e1a-bade-4677f1638f39 admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:23.721482 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7eea3f-71a2-4e1a-bade-4677f1638f39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:23.721754 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7eea3f-71a2-4e1a-bade-4677f1638f39 admin admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:23.722499 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7eea3f-71a2-4e1a-bade-4677f1638f39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:23.724071 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7eea3f-71a2-4e1a-bade-4677f1638f39 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:23.734164 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1233/2461] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:47:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 14:47:23.738386 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bad147-1a76-4aca-bf18-6f7f87b82405 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:23.749012 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bad147-1a76-4aca-bf18-6f7f87b82405 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:23.753731 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9d2ba9-a01f-4957-bc00-b4844d7f32f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:23.754609 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9d2ba9-a01f-4957-bc00-b4844d7f32f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:23.754913 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9d2ba9-a01f-4957-bc00-b4844d7f32f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:23.755186 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9d2ba9-a01f-4957-bc00-b4844d7f32f5 admin admin] PATH_INFO: `/v3/projects/ebabfb0e4abd4a00b42012b147c12656/users/d5e4703f42a242eabcb19a0709ae7393/roles/8eff41f243c843ed95505a488ca6eada` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:23.771334 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9d2ba9-a01f-4957-bc00-b4844d7f32f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebabfb0e4abd4a00b42012b147c12656, user_id=d5e4703f42a242eabcb19a0709ae7393, role_id=8eff41f243c843ed95505a488ca6eada)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:23.774015 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9d2ba9-a01f-4957-bc00-b4844d7f32f5 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:23.787105 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1229/2462] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jul 11 14:47:23 2022] PUT /identity/v3/projects/ebabfb0e4abd4a00b42012b147c12656/users/d5e4703f42a242eabcb19a0709ae7393/roles/8eff41f243c843ed95505a488ca6eada => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:47:23.798623 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0bc674-78c9-4dbd-93c8-737ee0748a2a None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:23.798917 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0bc674-78c9-4dbd-93c8-737ee0748a2a None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:23.799201 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0bc674-78c9-4dbd-93c8-737ee0748a2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:23.827742 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-dd0bc674-78c9-4dbd-93c8-737ee0748a2a None None] MFA Rules not processed for user `d5e4703f42a242eabcb19a0709ae7393`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:47:23.828925 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-dd0bc674-78c9-4dbd-93c8-737ee0748a2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:23.902079 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1234/2463] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:47:23 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:47:23.913021 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9d2ba9-a01f-4957-bc00-b4844d7f32f5 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:23.914885 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-9b9d2ba9-a01f-4957-bc00-b4844d7f32f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:23.929396 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:47:23.976694 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9d2ba9-a01f-4957-bc00-b4844d7f32f5 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:23.980592 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e9c95a-9f9c-4509-83c0-52875426f50c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '868e7c2dec264512b972c8736d659c34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:23.981261 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e9c95a-9f9c-4509-83c0-52875426f50c service cinder] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:23.981545 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e9c95a-9f9c-4509-83c0-52875426f50c service cinder] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:23.981846 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e9c95a-9f9c-4509-83c0-52875426f50c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:23.990223 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e9c95a-9f9c-4509-83c0-52875426f50c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:23.991635 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e9c95a-9f9c-4509-83c0-52875426f50c service cinder] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:24.001205 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1230/2464] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:47:23 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:47:32.346623 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0bc674-78c9-4dbd-93c8-737ee0748a2a None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:32.411900 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0bc674-78c9-4dbd-93c8-737ee0748a2a None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:32.417059 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ac684e-2274-4cad-8957-54b21ebce77e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:32.417973 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ac684e-2274-4cad-8957-54b21ebce77e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:32.418254 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ac684e-2274-4cad-8957-54b21ebce77e admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:32.418534 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ac684e-2274-4cad-8957-54b21ebce77e admin admin] PATH_INFO: `/v3/users/d5e4703f42a242eabcb19a0709ae7393` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:32.419744 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ac684e-2274-4cad-8957-54b21ebce77e admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5e4703f42a242eabcb19a0709ae7393)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:32.421702 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ac684e-2274-4cad-8957-54b21ebce77e admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:32.424117 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:47:32.469641 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-85ac684e-2274-4cad-8957-54b21ebce77e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5e4703f42a242eabcb19a0709ae7393'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:32.476578 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-85ac684e-2274-4cad-8957-54b21ebce77e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5e4703f42a242eabcb19a0709ae7393'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:32.485228 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-85ac684e-2274-4cad-8957-54b21ebce77e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5e4703f42a242eabcb19a0709ae7393'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:32.485849 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-85ac684e-2274-4cad-8957-54b21ebce77e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5e4703f42a242eabcb19a0709ae7393'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:32.486464 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-85ac684e-2274-4cad-8957-54b21ebce77e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5e4703f42a242eabcb19a0709ae7393'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:32.505712 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1235/2465] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jul 11 14:47:32 2022] DELETE /identity/v3/users/d5e4703f42a242eabcb19a0709ae7393 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:47:32.511153 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a508590e-4b76-464d-93c3-4d04650051f0 None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:32.511703 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a508590e-4b76-464d-93c3-4d04650051f0 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:32.511831 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a508590e-4b76-464d-93c3-4d04650051f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:32.529904 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-a508590e-4b76-464d-93c3-4d04650051f0 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:47:32.531106 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-a508590e-4b76-464d-93c3-4d04650051f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:32.593981 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1231/2466] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:47:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:47:32.604171 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ac684e-2274-4cad-8957-54b21ebce77e admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:32.606078 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-85ac684e-2274-4cad-8957-54b21ebce77e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:32.664606 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ac684e-2274-4cad-8957-54b21ebce77e admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:32.668518 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb826011-dc32-47ab-bea3-b1ef41879936 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20eede5ccd834862b00123310b5c3975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:32.669224 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb826011-dc32-47ab-bea3-b1ef41879936 service neutron] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:32.669547 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb826011-dc32-47ab-bea3-b1ef41879936 service neutron] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:32.669821 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb826011-dc32-47ab-bea3-b1ef41879936 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:32.679749 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb826011-dc32-47ab-bea3-b1ef41879936 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:32.681654 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb826011-dc32-47ab-bea3-b1ef41879936 service neutron] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:32.691680 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1236/2467] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:47:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:47:32.968007 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a508590e-4b76-464d-93c3-4d04650051f0 None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:32.969688 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-a508590e-4b76-464d-93c3-4d04650051f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:32.983048 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a508590e-4b76-464d-93c3-4d04650051f0 None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:32.987933 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6e29a4-669f-46a4-9894-3a4098f51b8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:32.988945 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6e29a4-669f-46a4-9894-3a4098f51b8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:32.989537 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6e29a4-669f-46a4-9894-3a4098f51b8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:32.989891 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6e29a4-669f-46a4-9894-3a4098f51b8e admin admin] PATH_INFO: `/v3/projects/ebabfb0e4abd4a00b42012b147c12656` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:32.991173 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6e29a4-669f-46a4-9894-3a4098f51b8e admin admin] RBAC: Authorizing `identity:delete_project(project_id=ebabfb0e4abd4a00b42012b147c12656)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:32.995014 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6e29a4-669f-46a4-9894-3a4098f51b8e admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:33.042287 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-2b6e29a4-669f-46a4-9894-3a4098f51b8e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ebabfb0e4abd4a00b42012b147c12656', 'request_id': 'req-2b6e29a4-669f-46a4-9894-3a4098f51b8e'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:33.048389 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-2b6e29a4-669f-46a4-9894-3a4098f51b8e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ebabfb0e4abd4a00b42012b147c12656', 'request_id': 'req-2b6e29a4-669f-46a4-9894-3a4098f51b8e'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:33.056390 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-2b6e29a4-669f-46a4-9894-3a4098f51b8e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ebabfb0e4abd4a00b42012b147c12656', 'request_id': 'req-2b6e29a4-669f-46a4-9894-3a4098f51b8e'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:33.067537 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-2b6e29a4-669f-46a4-9894-3a4098f51b8e admin admin] The token cache is being invalidate because project ebabfb0e4abd4a00b42012b147c12656 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80534) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:47:33.067825 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-2b6e29a4-669f-46a4-9894-3a4098f51b8e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:33.068485 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-2b6e29a4-669f-46a4-9894-3a4098f51b8e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:33.070018 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1232/2468] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jul 11 14:47:32 2022] DELETE /identity/v3/projects/ebabfb0e4abd4a00b42012b147c12656 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:47:33.075498 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f34bc8-73be-437a-9538-b3cbb111f049 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:33.075793 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f34bc8-73be-437a-9538-b3cbb111f049 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:33.076073 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f34bc8-73be-437a-9538-b3cbb111f049 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:33.093535 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-c0f34bc8-73be-437a-9538-b3cbb111f049 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:47:33.094664 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-c0f34bc8-73be-437a-9538-b3cbb111f049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:33.155116 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1237/2469] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:47:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:47:33.162910 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81dd06e-06fb-4027-a231-317be54397dd None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:33.163203 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81dd06e-06fb-4027-a231-317be54397dd None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:33.163486 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81dd06e-06fb-4027-a231-317be54397dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:33.183260 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-c81dd06e-06fb-4027-a231-317be54397dd None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:47:33.184507 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-c81dd06e-06fb-4027-a231-317be54397dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:33.192641 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1233/2470] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:47:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:47:33.197081 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f34bc8-73be-437a-9538-b3cbb111f049 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:33.206727 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f34bc8-73be-437a-9538-b3cbb111f049 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:33.211284 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254887a6-f339-43f6-989e-7f378a38a095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:33.212064 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254887a6-f339-43f6-989e-7f378a38a095 admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:33.212374 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254887a6-f339-43f6-989e-7f378a38a095 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:33.212646 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254887a6-f339-43f6-989e-7f378a38a095 admin admin] PATH_INFO: `/v3/domains` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:33.213360 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254887a6-f339-43f6-989e-7f378a38a095 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:47:33.213662 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254887a6-f339-43f6-989e-7f378a38a095 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:33.215265 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254887a6-f339-43f6-989e-7f378a38a095 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:33.227148 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1238/2471] 10.222.0.70 () {58 vars in 1152 bytes} [Mon Jul 11 14:47:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:47:33.231325 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81dd06e-06fb-4027-a231-317be54397dd None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:33.240421 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81dd06e-06fb-4027-a231-317be54397dd None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:33.245695 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd00db7-cc1d-4675-8581-34615100aa84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:33.246337 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd00db7-cc1d-4675-8581-34615100aa84 admin admin] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:33.246638 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd00db7-cc1d-4675-8581-34615100aa84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:33.246890 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd00db7-cc1d-4675-8581-34615100aa84 admin admin] PATH_INFO: `/v3/projects` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:33.247580 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd00db7-cc1d-4675-8581-34615100aa84 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:33.249471 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd00db7-cc1d-4675-8581-34615100aa84 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:33.274285 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1234/2472] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jul 11 14:47:33 2022] POST /identity/v3/projects => generated 369 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:47:33.278877 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254887a6-f339-43f6-989e-7f378a38a095 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:33.289047 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254887a6-f339-43f6-989e-7f378a38a095 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:33.297456 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:47:33.350011 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af10f68c-2399-4700-9335-9f35f5763766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:33.350676 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af10f68c-2399-4700-9335-9f35f5763766 admin admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:33.350864 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af10f68c-2399-4700-9335-9f35f5763766 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:33.351142 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af10f68c-2399-4700-9335-9f35f5763766 admin admin] PATH_INFO: `/v3/users` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:33.352512 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af10f68c-2399-4700-9335-9f35f5763766 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:33.354558 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af10f68c-2399-4700-9335-9f35f5763766 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:33.376011 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1239/2473] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jul 11 14:47:33 2022] POST /identity/v3/users => generated 285 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:47:33.380258 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd00db7-cc1d-4675-8581-34615100aa84 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:33.390640 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd00db7-cc1d-4675-8581-34615100aa84 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:33.395147 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253d9899-ce5d-4ec7-979b-2f2eb83b3c5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:33.395801 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253d9899-ce5d-4ec7-979b-2f2eb83b3c5c admin admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:33.396088 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253d9899-ce5d-4ec7-979b-2f2eb83b3c5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:33.396403 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253d9899-ce5d-4ec7-979b-2f2eb83b3c5c admin admin] PATH_INFO: `/v3/roles` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:33.397126 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253d9899-ce5d-4ec7-979b-2f2eb83b3c5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:33.398840 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253d9899-ce5d-4ec7-979b-2f2eb83b3c5c admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:33.404394 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:47:33.419070 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1235/2474] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:47:33 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:47:33.420862 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af10f68c-2399-4700-9335-9f35f5763766 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:33.431739 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af10f68c-2399-4700-9335-9f35f5763766 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:33.437197 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373724de-3cc6-40b5-a8a9-28ed1eb519e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:33.437848 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373724de-3cc6-40b5-a8a9-28ed1eb519e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:33.438143 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373724de-3cc6-40b5-a8a9-28ed1eb519e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:33.438424 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373724de-3cc6-40b5-a8a9-28ed1eb519e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:33.439149 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373724de-3cc6-40b5-a8a9-28ed1eb519e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:33.440809 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373724de-3cc6-40b5-a8a9-28ed1eb519e8 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:33.450907 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1240/2475] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:47:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:47:33.455254 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253d9899-ce5d-4ec7-979b-2f2eb83b3c5c admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:33.465566 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253d9899-ce5d-4ec7-979b-2f2eb83b3c5c admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:33.470950 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c405b6-eca7-4bc4-8c68-5dd1e985fc00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:33.471855 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c405b6-eca7-4bc4-8c68-5dd1e985fc00 admin admin] REQUEST_METHOD: `PUT` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:33.472137 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c405b6-eca7-4bc4-8c68-5dd1e985fc00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:33.472734 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c405b6-eca7-4bc4-8c68-5dd1e985fc00 admin admin] PATH_INFO: `/v3/projects/e0c8620485264cf69a7b34fcffed5654/users/0ecbcf332e844fd18ba43fc5255b4a79/roles/8eff41f243c843ed95505a488ca6eada` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:33.489159 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c405b6-eca7-4bc4-8c68-5dd1e985fc00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0c8620485264cf69a7b34fcffed5654, user_id=0ecbcf332e844fd18ba43fc5255b4a79, role_id=8eff41f243c843ed95505a488ca6eada)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:33.491889 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c405b6-eca7-4bc4-8c68-5dd1e985fc00 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:33.507368 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1236/2476] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jul 11 14:47:33 2022] PUT /identity/v3/projects/e0c8620485264cf69a7b34fcffed5654/users/0ecbcf332e844fd18ba43fc5255b4a79/roles/8eff41f243c843ed95505a488ca6eada => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:47:33.518365 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7684740-9e43-4f7c-8fbe-5b26c51d0f99 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:33.518655 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7684740-9e43-4f7c-8fbe-5b26c51d0f99 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:33.518933 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7684740-9e43-4f7c-8fbe-5b26c51d0f99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:33.546433 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-c7684740-9e43-4f7c-8fbe-5b26c51d0f99 None None] MFA Rules not processed for user `0ecbcf332e844fd18ba43fc5255b4a79`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:47:33.547637 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-c7684740-9e43-4f7c-8fbe-5b26c51d0f99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:33.614877 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1241/2477] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:47:33 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:47:33.629307 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c405b6-eca7-4bc4-8c68-5dd1e985fc00 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:33.631084 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-45c405b6-eca7-4bc4-8c68-5dd1e985fc00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:33.704968 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c405b6-eca7-4bc4-8c68-5dd1e985fc00 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:33.710492 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840f0f24-c590-41e8-9d6e-da3a5d7fed9e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4f8c0d696af4bd5a205ca8e9110b8cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:33.711725 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840f0f24-c590-41e8-9d6e-da3a5d7fed9e service nova] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:33.712024 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840f0f24-c590-41e8-9d6e-da3a5d7fed9e service nova] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:33.712328 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840f0f24-c590-41e8-9d6e-da3a5d7fed9e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:33.720036 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840f0f24-c590-41e8-9d6e-da3a5d7fed9e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:33.721622 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840f0f24-c590-41e8-9d6e-da3a5d7fed9e service nova] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:33.731054 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1237/2478] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:47:33 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:47:33.947242 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7684740-9e43-4f7c-8fbe-5b26c51d0f99 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:34.008529 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7684740-9e43-4f7c-8fbe-5b26c51d0f99 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:34.013141 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba4e9c9-f9be-439a-9ecd-ccebfb626c98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:34.014004 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba4e9c9-f9be-439a-9ecd-ccebfb626c98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:34.014281 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba4e9c9-f9be-439a-9ecd-ccebfb626c98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:34.014556 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba4e9c9-f9be-439a-9ecd-ccebfb626c98 admin admin] PATH_INFO: `/v3/users/0ecbcf332e844fd18ba43fc5255b4a79` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:34.015750 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba4e9c9-f9be-439a-9ecd-ccebfb626c98 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ecbcf332e844fd18ba43fc5255b4a79)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:34.017687 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba4e9c9-f9be-439a-9ecd-ccebfb626c98 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:34.039851 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:47:34.065732 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-5ba4e9c9-f9be-439a-9ecd-ccebfb626c98 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ecbcf332e844fd18ba43fc5255b4a79'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:34.073708 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-5ba4e9c9-f9be-439a-9ecd-ccebfb626c98 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ecbcf332e844fd18ba43fc5255b4a79'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:34.081119 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-5ba4e9c9-f9be-439a-9ecd-ccebfb626c98 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ecbcf332e844fd18ba43fc5255b4a79'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:34.081786 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-5ba4e9c9-f9be-439a-9ecd-ccebfb626c98 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ecbcf332e844fd18ba43fc5255b4a79'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:34.082431 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-5ba4e9c9-f9be-439a-9ecd-ccebfb626c98 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ecbcf332e844fd18ba43fc5255b4a79'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:34.100764 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1242/2479] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jul 11 14:47:33 2022] DELETE /identity/v3/users/0ecbcf332e844fd18ba43fc5255b4a79 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:47:34.105808 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97efbcb8-28f9-45bb-a916-1a3b9e62fa93 None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:34.106094 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97efbcb8-28f9-45bb-a916-1a3b9e62fa93 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:34.106370 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97efbcb8-28f9-45bb-a916-1a3b9e62fa93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:34.123904 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-97efbcb8-28f9-45bb-a916-1a3b9e62fa93 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:47:34.125067 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-97efbcb8-28f9-45bb-a916-1a3b9e62fa93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:34.184046 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1238/2480] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:47:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:47:34.193935 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba4e9c9-f9be-439a-9ecd-ccebfb626c98 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:34.196152 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-5ba4e9c9-f9be-439a-9ecd-ccebfb626c98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:34.253310 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba4e9c9-f9be-439a-9ecd-ccebfb626c98 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:34.257098 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6966b973-64d6-4562-91e7-8eff5638378e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20eede5ccd834862b00123310b5c3975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:34.257763 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6966b973-64d6-4562-91e7-8eff5638378e service neutron] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:34.258651 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6966b973-64d6-4562-91e7-8eff5638378e service neutron] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:34.258910 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6966b973-64d6-4562-91e7-8eff5638378e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:34.269583 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6966b973-64d6-4562-91e7-8eff5638378e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:34.271269 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6966b973-64d6-4562-91e7-8eff5638378e service neutron] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:34.282060 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1243/2481] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:47:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:47:34.560382 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97efbcb8-28f9-45bb-a916-1a3b9e62fa93 None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:34.561808 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-97efbcb8-28f9-45bb-a916-1a3b9e62fa93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:34.576286 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97efbcb8-28f9-45bb-a916-1a3b9e62fa93 None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:34.581148 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52cc50b-193b-4c47-ad3a-016ebf6c496d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:34.582019 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52cc50b-193b-4c47-ad3a-016ebf6c496d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:34.582330 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52cc50b-193b-4c47-ad3a-016ebf6c496d admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:34.582782 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52cc50b-193b-4c47-ad3a-016ebf6c496d admin admin] PATH_INFO: `/v3/projects/e0c8620485264cf69a7b34fcffed5654` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:34.583982 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52cc50b-193b-4c47-ad3a-016ebf6c496d admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0c8620485264cf69a7b34fcffed5654)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:34.586211 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52cc50b-193b-4c47-ad3a-016ebf6c496d admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:34.636847 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-b52cc50b-193b-4c47-ad3a-016ebf6c496d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0c8620485264cf69a7b34fcffed5654', 'request_id': 'req-b52cc50b-193b-4c47-ad3a-016ebf6c496d'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:34.642915 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-b52cc50b-193b-4c47-ad3a-016ebf6c496d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0c8620485264cf69a7b34fcffed5654', 'request_id': 'req-b52cc50b-193b-4c47-ad3a-016ebf6c496d'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:34.645500 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:47:34.650782 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-b52cc50b-193b-4c47-ad3a-016ebf6c496d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0c8620485264cf69a7b34fcffed5654', 'request_id': 'req-b52cc50b-193b-4c47-ad3a-016ebf6c496d'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:34.662031 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-b52cc50b-193b-4c47-ad3a-016ebf6c496d admin admin] The token cache is being invalidate because project e0c8620485264cf69a7b34fcffed5654 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80534) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:47:34.662319 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-b52cc50b-193b-4c47-ad3a-016ebf6c496d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:34.662946 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-b52cc50b-193b-4c47-ad3a-016ebf6c496d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:34.665431 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1239/2482] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jul 11 14:47:34 2022] DELETE /identity/v3/projects/e0c8620485264cf69a7b34fcffed5654 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:47:34.669996 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bf89ad-3d0c-4f80-8804-102c4c1fbcb3 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:34.670454 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bf89ad-3d0c-4f80-8804-102c4c1fbcb3 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:34.670546 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bf89ad-3d0c-4f80-8804-102c4c1fbcb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:34.688683 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-02bf89ad-3d0c-4f80-8804-102c4c1fbcb3 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:47:34.689886 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-02bf89ad-3d0c-4f80-8804-102c4c1fbcb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:34.751237 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1244/2483] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:47:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:47:34.759604 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2137de-bd0c-4b88-a386-224580d2f66e None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:34.759889 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2137de-bd0c-4b88-a386-224580d2f66e None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:34.760172 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2137de-bd0c-4b88-a386-224580d2f66e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:34.779520 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-bb2137de-bd0c-4b88-a386-224580d2f66e None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:47:34.780772 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-bb2137de-bd0c-4b88-a386-224580d2f66e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:34.788902 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1240/2484] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:47:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:47:34.793745 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bf89ad-3d0c-4f80-8804-102c4c1fbcb3 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:34.803398 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bf89ad-3d0c-4f80-8804-102c4c1fbcb3 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:34.809014 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24adea77-5027-431a-b7b7-b0ab11f87000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:34.809673 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24adea77-5027-431a-b7b7-b0ab11f87000 admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:34.809953 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24adea77-5027-431a-b7b7-b0ab11f87000 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:34.810224 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24adea77-5027-431a-b7b7-b0ab11f87000 admin admin] PATH_INFO: `/v3/domains` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:34.810952 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24adea77-5027-431a-b7b7-b0ab11f87000 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:47:34.811248 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24adea77-5027-431a-b7b7-b0ab11f87000 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:34.812929 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24adea77-5027-431a-b7b7-b0ab11f87000 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:34.824560 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1245/2485] 10.222.0.70 () {58 vars in 1152 bytes} [Mon Jul 11 14:47:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:47:34.828841 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2137de-bd0c-4b88-a386-224580d2f66e None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:34.839037 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2137de-bd0c-4b88-a386-224580d2f66e None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:34.843898 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89771da2-d03a-4ee7-a852-8857251ec5a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:34.844624 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89771da2-d03a-4ee7-a852-8857251ec5a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:34.844906 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89771da2-d03a-4ee7-a852-8857251ec5a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:34.845179 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89771da2-d03a-4ee7-a852-8857251ec5a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:34.845889 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89771da2-d03a-4ee7-a852-8857251ec5a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:34.847826 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89771da2-d03a-4ee7-a852-8857251ec5a6 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:34.874465 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1241/2486] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jul 11 14:47:34 2022] POST /identity/v3/projects => generated 405 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:47:34.878630 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24adea77-5027-431a-b7b7-b0ab11f87000 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:34.889590 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24adea77-5027-431a-b7b7-b0ab11f87000 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:34.916825 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:47:34.949762 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2840ad3-611d-4a75-8b91-f6ef224bcf58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:34.950440 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2840ad3-611d-4a75-8b91-f6ef224bcf58 admin admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:34.950725 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2840ad3-611d-4a75-8b91-f6ef224bcf58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:34.951007 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2840ad3-611d-4a75-8b91-f6ef224bcf58 admin admin] PATH_INFO: `/v3/users` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:34.951701 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2840ad3-611d-4a75-8b91-f6ef224bcf58 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:34.953873 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2840ad3-611d-4a75-8b91-f6ef224bcf58 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:34.974683 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1246/2487] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jul 11 14:47:34 2022] POST /identity/v3/users => generated 303 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:47:34.979560 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89771da2-d03a-4ee7-a852-8857251ec5a6 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:34.989871 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89771da2-d03a-4ee7-a852-8857251ec5a6 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:34.995222 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe1c3e1-4fcd-44fd-ae98-8283da2f6ce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:34.995878 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe1c3e1-4fcd-44fd-ae98-8283da2f6ce0 admin admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:34.996157 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe1c3e1-4fcd-44fd-ae98-8283da2f6ce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:34.996460 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe1c3e1-4fcd-44fd-ae98-8283da2f6ce0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:34.997180 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe1c3e1-4fcd-44fd-ae98-8283da2f6ce0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:34.998755 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe1c3e1-4fcd-44fd-ae98-8283da2f6ce0 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:35.009529 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1242/2488] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:47:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:47:35.013630 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2840ad3-611d-4a75-8b91-f6ef224bcf58 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:35.024693 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2840ad3-611d-4a75-8b91-f6ef224bcf58 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:35.029385 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436d25c9-e0e2-4a7d-875a-8bfc5d40930e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:35.030048 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436d25c9-e0e2-4a7d-875a-8bfc5d40930e admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:35.030339 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436d25c9-e0e2-4a7d-875a-8bfc5d40930e admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:35.030615 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436d25c9-e0e2-4a7d-875a-8bfc5d40930e admin admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:35.031340 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436d25c9-e0e2-4a7d-875a-8bfc5d40930e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:35.033048 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436d25c9-e0e2-4a7d-875a-8bfc5d40930e admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:35.044686 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1247/2489] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:47:35 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:47:35.049686 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe1c3e1-4fcd-44fd-ae98-8283da2f6ce0 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:35.060033 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe1c3e1-4fcd-44fd-ae98-8283da2f6ce0 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:35.064670 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8da725-ebed-42b3-b15e-6d2abbdac616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:35.065546 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8da725-ebed-42b3-b15e-6d2abbdac616 admin admin] REQUEST_METHOD: `PUT` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:35.065823 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8da725-ebed-42b3-b15e-6d2abbdac616 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:35.066095 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8da725-ebed-42b3-b15e-6d2abbdac616 admin admin] PATH_INFO: `/v3/projects/2c09fe5cd8814261aca0a7afc2341a3c/users/434a8e509e3241e4aa1d7639ffc6affe/roles/8eff41f243c843ed95505a488ca6eada` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:35.080654 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8da725-ebed-42b3-b15e-6d2abbdac616 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c09fe5cd8814261aca0a7afc2341a3c, user_id=434a8e509e3241e4aa1d7639ffc6affe, role_id=8eff41f243c843ed95505a488ca6eada)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:35.083271 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8da725-ebed-42b3-b15e-6d2abbdac616 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:35.098721 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1243/2490] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jul 11 14:47:35 2022] PUT /identity/v3/projects/2c09fe5cd8814261aca0a7afc2341a3c/users/434a8e509e3241e4aa1d7639ffc6affe/roles/8eff41f243c843ed95505a488ca6eada => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:47:35.110103 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb14b4cd-df56-450f-9051-169b8fcc8878 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:35.110394 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb14b4cd-df56-450f-9051-169b8fcc8878 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:35.110676 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb14b4cd-df56-450f-9051-169b8fcc8878 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:35.137560 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-bb14b4cd-df56-450f-9051-169b8fcc8878 None None] MFA Rules not processed for user `434a8e509e3241e4aa1d7639ffc6affe`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:47:35.138785 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-bb14b4cd-df56-450f-9051-169b8fcc8878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:35.203780 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1248/2491] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:47:35 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:47:35.208239 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8da725-ebed-42b3-b15e-6d2abbdac616 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:35.270080 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8da725-ebed-42b3-b15e-6d2abbdac616 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:35.275642 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6647dae6-94d9-4f10-97a3-66909a16f355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:35.276327 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6647dae6-94d9-4f10-97a3-66909a16f355 admin admin] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:35.276611 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6647dae6-94d9-4f10-97a3-66909a16f355 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:35.276898 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6647dae6-94d9-4f10-97a3-66909a16f355 admin admin] PATH_INFO: `/v3/projects` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:35.277585 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6647dae6-94d9-4f10-97a3-66909a16f355 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:35.279463 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6647dae6-94d9-4f10-97a3-66909a16f355 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:35.306232 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1244/2492] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jul 11 14:47:35 2022] POST /identity/v3/projects => generated 405 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:47:35.310766 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb14b4cd-df56-450f-9051-169b8fcc8878 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:35.321597 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb14b4cd-df56-450f-9051-169b8fcc8878 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:35.378161 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee386ab4-b547-40c8-b294-b18e09c70f98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:35.378971 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee386ab4-b547-40c8-b294-b18e09c70f98 admin admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:35.379258 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee386ab4-b547-40c8-b294-b18e09c70f98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:35.379581 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee386ab4-b547-40c8-b294-b18e09c70f98 admin admin] PATH_INFO: `/v3/users` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:35.380315 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee386ab4-b547-40c8-b294-b18e09c70f98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:35.382396 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee386ab4-b547-40c8-b294-b18e09c70f98 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:35.404428 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1249/2493] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jul 11 14:47:35 2022] POST /identity/v3/users => generated 309 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:47:35.408508 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6647dae6-94d9-4f10-97a3-66909a16f355 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:35.419203 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6647dae6-94d9-4f10-97a3-66909a16f355 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:35.423928 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d867f2-3639-4fb9-91eb-7bba852b47b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:35.424612 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d867f2-3639-4fb9-91eb-7bba852b47b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:35.424898 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d867f2-3639-4fb9-91eb-7bba852b47b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:35.425175 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d867f2-3639-4fb9-91eb-7bba852b47b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:35.425895 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d867f2-3639-4fb9-91eb-7bba852b47b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:35.427478 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d867f2-3639-4fb9-91eb-7bba852b47b2 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:35.438771 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1245/2494] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:47:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:47:35.442835 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee386ab4-b547-40c8-b294-b18e09c70f98 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:35.453601 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee386ab4-b547-40c8-b294-b18e09c70f98 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:35.458996 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4633756f-867c-4e24-a1cc-ca4ecc4b0aaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:35.460077 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4633756f-867c-4e24-a1cc-ca4ecc4b0aaa admin admin] REQUEST_METHOD: `PUT` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:35.460390 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4633756f-867c-4e24-a1cc-ca4ecc4b0aaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:35.460676 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4633756f-867c-4e24-a1cc-ca4ecc4b0aaa admin admin] PATH_INFO: `/v3/projects/6e8d66475b60424c8a2742a937bd57e1/users/b79065caa10f4bc0a6324e1ad9b52d56/roles/b46df176b0fe479da63c318db225bed4` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:35.476479 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4633756f-867c-4e24-a1cc-ca4ecc4b0aaa admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e8d66475b60424c8a2742a937bd57e1, user_id=b79065caa10f4bc0a6324e1ad9b52d56, role_id=b46df176b0fe479da63c318db225bed4)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:35.479830 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4633756f-867c-4e24-a1cc-ca4ecc4b0aaa admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:35.494296 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1250/2495] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jul 11 14:47:35 2022] PUT /identity/v3/projects/6e8d66475b60424c8a2742a937bd57e1/users/b79065caa10f4bc0a6324e1ad9b52d56/roles/b46df176b0fe479da63c318db225bed4 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:47:35.498288 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d867f2-3639-4fb9-91eb-7bba852b47b2 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:35.514735 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d867f2-3639-4fb9-91eb-7bba852b47b2 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:35.565214 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:47:35.578425 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cbb24a-6585-46d0-846d-b5e6095cbb0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:35.579445 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cbb24a-6585-46d0-846d-b5e6095cbb0f admin admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:35.580054 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cbb24a-6585-46d0-846d-b5e6095cbb0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:35.580786 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cbb24a-6585-46d0-846d-b5e6095cbb0f admin admin] PATH_INFO: `/v3/roles` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:35.581900 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cbb24a-6585-46d0-846d-b5e6095cbb0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:35.583498 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cbb24a-6585-46d0-846d-b5e6095cbb0f admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:35.596029 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1246/2496] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:47:35 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:47:35.600375 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4633756f-867c-4e24-a1cc-ca4ecc4b0aaa admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:35.605811 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:47:35.612916 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4633756f-867c-4e24-a1cc-ca4ecc4b0aaa admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:35.618287 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcaddcd-ff3f-49be-9bf9-623e2a6ed2b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:35.619243 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcaddcd-ff3f-49be-9bf9-623e2a6ed2b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:35.619563 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcaddcd-ff3f-49be-9bf9-623e2a6ed2b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:35.619855 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcaddcd-ff3f-49be-9bf9-623e2a6ed2b9 admin admin] PATH_INFO: `/v3/projects/6e8d66475b60424c8a2742a937bd57e1/users/b79065caa10f4bc0a6324e1ad9b52d56/roles/b46df176b0fe479da63c318db225bed4` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:35.622035 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcaddcd-ff3f-49be-9bf9-623e2a6ed2b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e8d66475b60424c8a2742a937bd57e1, user_id=b79065caa10f4bc0a6324e1ad9b52d56, role_id=b46df176b0fe479da63c318db225bed4)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:35.624846 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcaddcd-ff3f-49be-9bf9-623e2a6ed2b9 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:35.636174 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1251/2497] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jul 11 14:47:35 2022] PUT /identity/v3/projects/6e8d66475b60424c8a2742a937bd57e1/users/b79065caa10f4bc0a6324e1ad9b52d56/roles/b46df176b0fe479da63c318db225bed4 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:47:35.647941 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146117aa-996a-498a-a0c1-3e08e2d715d0 None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:35.648534 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146117aa-996a-498a-a0c1-3e08e2d715d0 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:35.648665 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146117aa-996a-498a-a0c1-3e08e2d715d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:35.674756 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-146117aa-996a-498a-a0c1-3e08e2d715d0 None None] MFA Rules not processed for user `b79065caa10f4bc0a6324e1ad9b52d56`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:47:35.675951 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-146117aa-996a-498a-a0c1-3e08e2d715d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:35.747432 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1247/2498] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:47:35 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:47:35.758468 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcaddcd-ff3f-49be-9bf9-623e2a6ed2b9 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:35.760515 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-7dcaddcd-ff3f-49be-9bf9-623e2a6ed2b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:35.823714 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcaddcd-ff3f-49be-9bf9-623e2a6ed2b9 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:35.827582 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5add02a1-9b52-45e7-b4ec-110607219fed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '868e7c2dec264512b972c8736d659c34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:35.828298 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5add02a1-9b52-45e7-b4ec-110607219fed service cinder] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:35.828587 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5add02a1-9b52-45e7-b4ec-110607219fed service cinder] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:35.828864 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5add02a1-9b52-45e7-b4ec-110607219fed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:35.838219 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5add02a1-9b52-45e7-b4ec-110607219fed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:35.839647 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5add02a1-9b52-45e7-b4ec-110607219fed service cinder] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:35.849176 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1252/2499] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:47:35 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:47:35.979020 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146117aa-996a-498a-a0c1-3e08e2d715d0 None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:36.049741 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146117aa-996a-498a-a0c1-3e08e2d715d0 None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:36.054186 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c124f724-59f0-4736-a9c3-6f26eecb2f2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:36.056113 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c124f724-59f0-4736-a9c3-6f26eecb2f2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:36.056428 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c124f724-59f0-4736-a9c3-6f26eecb2f2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:36.056708 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c124f724-59f0-4736-a9c3-6f26eecb2f2d admin admin] PATH_INFO: `/v3/users/434a8e509e3241e4aa1d7639ffc6affe` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:36.058205 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c124f724-59f0-4736-a9c3-6f26eecb2f2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=434a8e509e3241e4aa1d7639ffc6affe)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:36.060158 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c124f724-59f0-4736-a9c3-6f26eecb2f2d admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:36.109125 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-c124f724-59f0-4736-a9c3-6f26eecb2f2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '434a8e509e3241e4aa1d7639ffc6affe'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:36.116251 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-c124f724-59f0-4736-a9c3-6f26eecb2f2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '434a8e509e3241e4aa1d7639ffc6affe'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:36.124531 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-c124f724-59f0-4736-a9c3-6f26eecb2f2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '434a8e509e3241e4aa1d7639ffc6affe'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:36.125215 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-c124f724-59f0-4736-a9c3-6f26eecb2f2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '434a8e509e3241e4aa1d7639ffc6affe'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:36.125766 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-c124f724-59f0-4736-a9c3-6f26eecb2f2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '434a8e509e3241e4aa1d7639ffc6affe'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:36.137082 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:47:36.144701 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1248/2500] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jul 11 14:47:35 2022] DELETE /identity/v3/users/434a8e509e3241e4aa1d7639ffc6affe => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:47:36.149009 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354301a6-5eb0-4cdf-aa45-702185f12690 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:36.149293 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354301a6-5eb0-4cdf-aa45-702185f12690 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:36.149565 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354301a6-5eb0-4cdf-aa45-702185f12690 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:36.167528 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-354301a6-5eb0-4cdf-aa45-702185f12690 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:47:36.168767 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-354301a6-5eb0-4cdf-aa45-702185f12690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:36.228838 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1253/2501] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:47:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:47:36.238378 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c124f724-59f0-4736-a9c3-6f26eecb2f2d admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:36.239823 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-c124f724-59f0-4736-a9c3-6f26eecb2f2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:36.297865 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c124f724-59f0-4736-a9c3-6f26eecb2f2d admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:36.301593 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36e9003-67b9-4423-9f42-db5d205e41a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20eede5ccd834862b00123310b5c3975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:36.302192 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36e9003-67b9-4423-9f42-db5d205e41a3 service neutron] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:36.302497 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36e9003-67b9-4423-9f42-db5d205e41a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:36.302800 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36e9003-67b9-4423-9f42-db5d205e41a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:36.314636 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36e9003-67b9-4423-9f42-db5d205e41a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:36.316363 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36e9003-67b9-4423-9f42-db5d205e41a3 service neutron] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:36.326714 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1249/2502] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:47:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:47:36.600580 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354301a6-5eb0-4cdf-aa45-702185f12690 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:36.602273 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-354301a6-5eb0-4cdf-aa45-702185f12690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:36.616412 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354301a6-5eb0-4cdf-aa45-702185f12690 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:36.621597 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe3483b-817e-4fdb-9991-c8d109a4b648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:36.622475 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe3483b-817e-4fdb-9991-c8d109a4b648 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:36.622761 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe3483b-817e-4fdb-9991-c8d109a4b648 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:36.623212 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe3483b-817e-4fdb-9991-c8d109a4b648 admin admin] PATH_INFO: `/v3/projects/2c09fe5cd8814261aca0a7afc2341a3c` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:36.624439 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe3483b-817e-4fdb-9991-c8d109a4b648 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c09fe5cd8814261aca0a7afc2341a3c)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:36.626361 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe3483b-817e-4fdb-9991-c8d109a4b648 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:36.673585 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-1fe3483b-817e-4fdb-9991-c8d109a4b648 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c09fe5cd8814261aca0a7afc2341a3c', 'request_id': 'req-1fe3483b-817e-4fdb-9991-c8d109a4b648'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:36.679194 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-1fe3483b-817e-4fdb-9991-c8d109a4b648 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c09fe5cd8814261aca0a7afc2341a3c', 'request_id': 'req-1fe3483b-817e-4fdb-9991-c8d109a4b648'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:36.686190 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-1fe3483b-817e-4fdb-9991-c8d109a4b648 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c09fe5cd8814261aca0a7afc2341a3c', 'request_id': 'req-1fe3483b-817e-4fdb-9991-c8d109a4b648'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:36.698972 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-1fe3483b-817e-4fdb-9991-c8d109a4b648 admin admin] The token cache is being invalidate because project 2c09fe5cd8814261aca0a7afc2341a3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:47:36.699258 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-1fe3483b-817e-4fdb-9991-c8d109a4b648 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:36.699879 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-1fe3483b-817e-4fdb-9991-c8d109a4b648 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:36.701428 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1254/2503] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jul 11 14:47:36 2022] DELETE /identity/v3/projects/2c09fe5cd8814261aca0a7afc2341a3c => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:47:36.705556 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36e9003-67b9-4423-9f42-db5d205e41a3 service neutron] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:36.715669 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36e9003-67b9-4423-9f42-db5d205e41a3 service neutron] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:36.771947 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f3211e-9c37-452f-8d10-6975d994003f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:36.772861 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f3211e-9c37-452f-8d10-6975d994003f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:36.773145 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f3211e-9c37-452f-8d10-6975d994003f admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:36.773568 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f3211e-9c37-452f-8d10-6975d994003f admin admin] PATH_INFO: `/v3/users/b79065caa10f4bc0a6324e1ad9b52d56` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:36.774664 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f3211e-9c37-452f-8d10-6975d994003f admin admin] RBAC: Authorizing `identity:delete_user(user_id=b79065caa10f4bc0a6324e1ad9b52d56)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:36.776619 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f3211e-9c37-452f-8d10-6975d994003f admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:36.824889 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-93f3211e-9c37-452f-8d10-6975d994003f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b79065caa10f4bc0a6324e1ad9b52d56'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:36.831916 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-93f3211e-9c37-452f-8d10-6975d994003f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b79065caa10f4bc0a6324e1ad9b52d56'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:36.839984 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-93f3211e-9c37-452f-8d10-6975d994003f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b79065caa10f4bc0a6324e1ad9b52d56'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:36.840639 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-93f3211e-9c37-452f-8d10-6975d994003f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b79065caa10f4bc0a6324e1ad9b52d56'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:36.841256 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-93f3211e-9c37-452f-8d10-6975d994003f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b79065caa10f4bc0a6324e1ad9b52d56'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:36.861825 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1250/2504] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jul 11 14:47:36 2022] DELETE /identity/v3/users/b79065caa10f4bc0a6324e1ad9b52d56 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:47:37.144672 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe3483b-817e-4fdb-9991-c8d109a4b648 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:37.146160 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-1fe3483b-817e-4fdb-9991-c8d109a4b648 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:37.160542 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe3483b-817e-4fdb-9991-c8d109a4b648 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:37.177972 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:47:37.227719 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f683fe8e-3059-4f1f-bf9b-c1952ad24954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:37.228621 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f683fe8e-3059-4f1f-bf9b-c1952ad24954 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:37.228910 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f683fe8e-3059-4f1f-bf9b-c1952ad24954 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:37.229190 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f683fe8e-3059-4f1f-bf9b-c1952ad24954 admin admin] PATH_INFO: `/v3/projects/6e8d66475b60424c8a2742a937bd57e1` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:37.230394 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f683fe8e-3059-4f1f-bf9b-c1952ad24954 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e8d66475b60424c8a2742a937bd57e1)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:37.232356 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f683fe8e-3059-4f1f-bf9b-c1952ad24954 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:37.279435 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-f683fe8e-3059-4f1f-bf9b-c1952ad24954 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e8d66475b60424c8a2742a937bd57e1', 'request_id': 'req-f683fe8e-3059-4f1f-bf9b-c1952ad24954'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:37.285050 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-f683fe8e-3059-4f1f-bf9b-c1952ad24954 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e8d66475b60424c8a2742a937bd57e1', 'request_id': 'req-f683fe8e-3059-4f1f-bf9b-c1952ad24954'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:37.291282 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-f683fe8e-3059-4f1f-bf9b-c1952ad24954 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e8d66475b60424c8a2742a937bd57e1', 'request_id': 'req-f683fe8e-3059-4f1f-bf9b-c1952ad24954'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:37.303917 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-f683fe8e-3059-4f1f-bf9b-c1952ad24954 admin admin] The token cache is being invalidate because project 6e8d66475b60424c8a2742a937bd57e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:47:37.304227 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-f683fe8e-3059-4f1f-bf9b-c1952ad24954 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:37.305975 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-f683fe8e-3059-4f1f-bf9b-c1952ad24954 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:37.307535 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1255/2505] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jul 11 14:47:37 2022] DELETE /identity/v3/projects/6e8d66475b60424c8a2742a937bd57e1 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:47:37.312815 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b0f6d6-f474-43ca-ba8a-b434451d232f None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:37.313174 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b0f6d6-f474-43ca-ba8a-b434451d232f None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:37.313511 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b0f6d6-f474-43ca-ba8a-b434451d232f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:37.332233 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-08b0f6d6-f474-43ca-ba8a-b434451d232f None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:47:37.333442 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-08b0f6d6-f474-43ca-ba8a-b434451d232f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:37.345460 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:47:37.394325 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1251/2506] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:47:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:47:37.403932 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17febbb8-027c-4847-98ec-d696b9832cfb None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:37.404251 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17febbb8-027c-4847-98ec-d696b9832cfb None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:37.404542 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17febbb8-027c-4847-98ec-d696b9832cfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:37.422939 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-17febbb8-027c-4847-98ec-d696b9832cfb None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:47:37.424157 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-17febbb8-027c-4847-98ec-d696b9832cfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:37.433401 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1256/2507] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:47:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:47:37.437552 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b0f6d6-f474-43ca-ba8a-b434451d232f None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:37.448037 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b0f6d6-f474-43ca-ba8a-b434451d232f None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:37.452709 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a00513-fca0-4528-9e07-e4cfd55b0c2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:37.453367 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a00513-fca0-4528-9e07-e4cfd55b0c2d admin admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:37.453647 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a00513-fca0-4528-9e07-e4cfd55b0c2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:37.453981 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a00513-fca0-4528-9e07-e4cfd55b0c2d admin admin] PATH_INFO: `/v3/domains` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:37.454738 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a00513-fca0-4528-9e07-e4cfd55b0c2d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:47:37.455042 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a00513-fca0-4528-9e07-e4cfd55b0c2d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:37.456659 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a00513-fca0-4528-9e07-e4cfd55b0c2d admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:37.469093 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1252/2508] 10.222.0.70 () {58 vars in 1152 bytes} [Mon Jul 11 14:47:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:47:37.473740 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17febbb8-027c-4847-98ec-d696b9832cfb None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:37.483467 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17febbb8-027c-4847-98ec-d696b9832cfb None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:37.488486 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb829376-afed-442a-84a9-ec200a2793b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:37.489161 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb829376-afed-442a-84a9-ec200a2793b2 admin admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:37.489451 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb829376-afed-442a-84a9-ec200a2793b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:37.489730 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb829376-afed-442a-84a9-ec200a2793b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:37.490425 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb829376-afed-442a-84a9-ec200a2793b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:37.493137 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb829376-afed-442a-84a9-ec200a2793b2 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:37.520253 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1257/2509] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jul 11 14:47:37 2022] POST /identity/v3/projects => generated 365 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:47:37.525008 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a00513-fca0-4528-9e07-e4cfd55b0c2d admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:37.535391 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a00513-fca0-4528-9e07-e4cfd55b0c2d admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:37.592760 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0958801-52e5-4e30-8499-3785e5620839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:37.593492 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0958801-52e5-4e30-8499-3785e5620839 admin admin] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:37.593803 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0958801-52e5-4e30-8499-3785e5620839 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:37.594101 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0958801-52e5-4e30-8499-3785e5620839 admin admin] PATH_INFO: `/v3/users` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:37.594833 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0958801-52e5-4e30-8499-3785e5620839 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:37.596934 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0958801-52e5-4e30-8499-3785e5620839 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:37.619135 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1253/2510] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jul 11 14:47:37 2022] POST /identity/v3/users => generated 283 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:47:37.623370 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb829376-afed-442a-84a9-ec200a2793b2 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:37.634350 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb829376-afed-442a-84a9-ec200a2793b2 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:37.638839 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ff698f-f2b3-41e2-a789-b81362c00aea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:37.639493 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ff698f-f2b3-41e2-a789-b81362c00aea admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:37.639774 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ff698f-f2b3-41e2-a789-b81362c00aea admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:37.640044 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ff698f-f2b3-41e2-a789-b81362c00aea admin admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:37.640802 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ff698f-f2b3-41e2-a789-b81362c00aea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:37.642363 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ff698f-f2b3-41e2-a789-b81362c00aea admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:37.653675 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1258/2511] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:47:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:47:37.657831 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0958801-52e5-4e30-8499-3785e5620839 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:37.668748 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0958801-52e5-4e30-8499-3785e5620839 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:37.673405 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6076eb7-a40d-4c8d-9733-02372536690c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:37.674061 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6076eb7-a40d-4c8d-9733-02372536690c admin admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:37.674345 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6076eb7-a40d-4c8d-9733-02372536690c admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:37.674627 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6076eb7-a40d-4c8d-9733-02372536690c admin admin] PATH_INFO: `/v3/roles` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:37.675361 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6076eb7-a40d-4c8d-9733-02372536690c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:37.676994 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6076eb7-a40d-4c8d-9733-02372536690c admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:37.688158 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1254/2512] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:47:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:47:37.692396 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ff698f-f2b3-41e2-a789-b81362c00aea admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:37.702739 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ff698f-f2b3-41e2-a789-b81362c00aea admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:37.707555 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4691643d-14a0-445d-be88-242b3301a485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:37.708476 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4691643d-14a0-445d-be88-242b3301a485 admin admin] REQUEST_METHOD: `PUT` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:37.708762 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4691643d-14a0-445d-be88-242b3301a485 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:37.709041 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4691643d-14a0-445d-be88-242b3301a485 admin admin] PATH_INFO: `/v3/projects/40aba6fa56c94843be16f6b78db85a46/users/40d05eb3824a4f64a11d530d92a271ff/roles/8eff41f243c843ed95505a488ca6eada` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:37.723968 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4691643d-14a0-445d-be88-242b3301a485 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40aba6fa56c94843be16f6b78db85a46, user_id=40d05eb3824a4f64a11d530d92a271ff, role_id=8eff41f243c843ed95505a488ca6eada)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:37.727348 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4691643d-14a0-445d-be88-242b3301a485 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:37.741028 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1259/2513] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jul 11 14:47:37 2022] PUT /identity/v3/projects/40aba6fa56c94843be16f6b78db85a46/users/40d05eb3824a4f64a11d530d92a271ff/roles/8eff41f243c843ed95505a488ca6eada => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:47:37.752406 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22de7075-3d85-47ad-a762-d32bdfc2b193 None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:37.753073 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22de7075-3d85-47ad-a762-d32bdfc2b193 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:37.753073 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22de7075-3d85-47ad-a762-d32bdfc2b193 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:37.781714 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-22de7075-3d85-47ad-a762-d32bdfc2b193 None None] MFA Rules not processed for user `40d05eb3824a4f64a11d530d92a271ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:47:37.782930 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-22de7075-3d85-47ad-a762-d32bdfc2b193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:37.849574 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1255/2514] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:47:37 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:47:37.854709 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4691643d-14a0-445d-be88-242b3301a485 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:37.900792 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:47:37.919785 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4691643d-14a0-445d-be88-242b3301a485 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:37.924471 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9200ad81-9753-4f08-9aca-841028a4ea86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:37.925125 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9200ad81-9753-4f08-9aca-841028a4ea86 admin admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:37.925404 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9200ad81-9753-4f08-9aca-841028a4ea86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:37.925676 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9200ad81-9753-4f08-9aca-841028a4ea86 admin admin] PATH_INFO: `/v3/projects` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:37.926358 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9200ad81-9753-4f08-9aca-841028a4ea86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:37.928264 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9200ad81-9753-4f08-9aca-841028a4ea86 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:37.954452 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1260/2515] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jul 11 14:47:37 2022] POST /identity/v3/projects => generated 367 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:47:37.958546 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22de7075-3d85-47ad-a762-d32bdfc2b193 None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:37.970871 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22de7075-3d85-47ad-a762-d32bdfc2b193 None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:37.980055 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:47:38.028858 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce392fce-1ccf-4fc4-9a68-d9a9caf46ed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:38.029521 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce392fce-1ccf-4fc4-9a68-d9a9caf46ed0 admin admin] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:38.029801 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce392fce-1ccf-4fc4-9a68-d9a9caf46ed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:38.030076 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce392fce-1ccf-4fc4-9a68-d9a9caf46ed0 admin admin] PATH_INFO: `/v3/users` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:38.030761 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce392fce-1ccf-4fc4-9a68-d9a9caf46ed0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:38.032684 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce392fce-1ccf-4fc4-9a68-d9a9caf46ed0 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:38.052818 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1256/2516] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jul 11 14:47:37 2022] POST /identity/v3/users => generated 290 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:47:38.056830 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9200ad81-9753-4f08-9aca-841028a4ea86 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:38.067345 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9200ad81-9753-4f08-9aca-841028a4ea86 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:38.072065 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3eb335-f0c6-4882-bb12-3345e52bdb95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:38.072789 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3eb335-f0c6-4882-bb12-3345e52bdb95 admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:38.073070 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3eb335-f0c6-4882-bb12-3345e52bdb95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:38.073345 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3eb335-f0c6-4882-bb12-3345e52bdb95 admin admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:38.074063 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3eb335-f0c6-4882-bb12-3345e52bdb95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:38.075647 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3eb335-f0c6-4882-bb12-3345e52bdb95 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:38.087348 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1261/2517] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:47:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:47:38.091256 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce392fce-1ccf-4fc4-9a68-d9a9caf46ed0 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:38.102169 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce392fce-1ccf-4fc4-9a68-d9a9caf46ed0 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:38.106852 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1603ac8-5ee5-444a-b25a-671145823bbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:38.107732 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1603ac8-5ee5-444a-b25a-671145823bbb admin admin] REQUEST_METHOD: `PUT` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:38.108014 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1603ac8-5ee5-444a-b25a-671145823bbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:38.108330 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1603ac8-5ee5-444a-b25a-671145823bbb admin admin] PATH_INFO: `/v3/projects/a236ea9c1ee14ee3b684e20b1f56f163/users/7f46b6ca168343ecbce83b67c45bdbd4/roles/b46df176b0fe479da63c318db225bed4` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:38.123179 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1603ac8-5ee5-444a-b25a-671145823bbb admin admin] RBAC: Authorizing `identity:create_grant(project_id=a236ea9c1ee14ee3b684e20b1f56f163, user_id=7f46b6ca168343ecbce83b67c45bdbd4, role_id=b46df176b0fe479da63c318db225bed4)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:38.125906 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1603ac8-5ee5-444a-b25a-671145823bbb admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:38.139462 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1257/2518] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jul 11 14:47:38 2022] PUT /identity/v3/projects/a236ea9c1ee14ee3b684e20b1f56f163/users/7f46b6ca168343ecbce83b67c45bdbd4/roles/b46df176b0fe479da63c318db225bed4 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:47:38.143446 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3eb335-f0c6-4882-bb12-3345e52bdb95 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:38.154059 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3eb335-f0c6-4882-bb12-3345e52bdb95 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:38.211404 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4ef611-f72e-46ec-9b5e-c87b4119577b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:38.212094 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4ef611-f72e-46ec-9b5e-c87b4119577b admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:38.212410 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4ef611-f72e-46ec-9b5e-c87b4119577b admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:38.212685 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4ef611-f72e-46ec-9b5e-c87b4119577b admin admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:38.213400 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4ef611-f72e-46ec-9b5e-c87b4119577b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:38.214999 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4ef611-f72e-46ec-9b5e-c87b4119577b admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:38.225071 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1262/2519] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:47:38 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:47:38.230058 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1603ac8-5ee5-444a-b25a-671145823bbb admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:38.240377 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1603ac8-5ee5-444a-b25a-671145823bbb admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:38.245863 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b337e2-fbdd-4214-a0ba-f77a60579d2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:38.246860 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b337e2-fbdd-4214-a0ba-f77a60579d2d admin admin] REQUEST_METHOD: `PUT` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:38.247148 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b337e2-fbdd-4214-a0ba-f77a60579d2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:38.247456 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b337e2-fbdd-4214-a0ba-f77a60579d2d admin admin] PATH_INFO: `/v3/projects/a236ea9c1ee14ee3b684e20b1f56f163/users/7f46b6ca168343ecbce83b67c45bdbd4/roles/b46df176b0fe479da63c318db225bed4` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:38.249516 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b337e2-fbdd-4214-a0ba-f77a60579d2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a236ea9c1ee14ee3b684e20b1f56f163, user_id=7f46b6ca168343ecbce83b67c45bdbd4, role_id=b46df176b0fe479da63c318db225bed4)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:38.252185 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b337e2-fbdd-4214-a0ba-f77a60579d2d admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:38.262683 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1258/2520] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jul 11 14:47:38 2022] PUT /identity/v3/projects/a236ea9c1ee14ee3b684e20b1f56f163/users/7f46b6ca168343ecbce83b67c45bdbd4/roles/b46df176b0fe479da63c318db225bed4 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:47:38.274539 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2893a23-e27a-4679-95ca-18dce49c09d4 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:38.274912 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2893a23-e27a-4679-95ca-18dce49c09d4 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:38.275193 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2893a23-e27a-4679-95ca-18dce49c09d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:38.309611 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-e2893a23-e27a-4679-95ca-18dce49c09d4 None None] MFA Rules not processed for user `7f46b6ca168343ecbce83b67c45bdbd4`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:47:38.311125 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-e2893a23-e27a-4679-95ca-18dce49c09d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:38.380486 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1263/2521] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:47:38 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:47:38.392132 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b337e2-fbdd-4214-a0ba-f77a60579d2d admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:38.393895 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-07b337e2-fbdd-4214-a0ba-f77a60579d2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:38.455823 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b337e2-fbdd-4214-a0ba-f77a60579d2d admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:38.459866 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ce1d05-b61b-487e-9905-d05e64b45be5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '868e7c2dec264512b972c8736d659c34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:38.460534 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ce1d05-b61b-487e-9905-d05e64b45be5 service cinder] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:38.461576 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ce1d05-b61b-487e-9905-d05e64b45be5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:38.462423 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ce1d05-b61b-487e-9905-d05e64b45be5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:38.471660 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ce1d05-b61b-487e-9905-d05e64b45be5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:38.473123 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ce1d05-b61b-487e-9905-d05e64b45be5 service cinder] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:38.483066 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1259/2522] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:47:38 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:47:38.528485 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2893a23-e27a-4679-95ca-18dce49c09d4 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:38.529892 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-e2893a23-e27a-4679-95ca-18dce49c09d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:38.543217 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2893a23-e27a-4679-95ca-18dce49c09d4 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:38.548094 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e54619-c73c-4890-8c22-7b13e6de9026 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '868e7c2dec264512b972c8736d659c34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:38.548786 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e54619-c73c-4890-8c22-7b13e6de9026 service cinder] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:38.549072 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e54619-c73c-4890-8c22-7b13e6de9026 service cinder] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:38.549353 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e54619-c73c-4890-8c22-7b13e6de9026 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:38.590956 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:47:38.614606 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e54619-c73c-4890-8c22-7b13e6de9026 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:38.616054 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e54619-c73c-4890-8c22-7b13e6de9026 service cinder] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:38.625138 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1264/2523] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:47:38 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:47:41.962597 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ce1d05-b61b-487e-9905-d05e64b45be5 service cinder] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:42.027165 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ce1d05-b61b-487e-9905-d05e64b45be5 service cinder] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:42.031771 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cfe6de-fdde-4ebe-b74e-ef59eb5f7226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:42.032593 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cfe6de-fdde-4ebe-b74e-ef59eb5f7226 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:42.032878 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cfe6de-fdde-4ebe-b74e-ef59eb5f7226 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:42.033158 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cfe6de-fdde-4ebe-b74e-ef59eb5f7226 admin admin] PATH_INFO: `/v3/users/40d05eb3824a4f64a11d530d92a271ff` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:42.034376 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cfe6de-fdde-4ebe-b74e-ef59eb5f7226 admin admin] RBAC: Authorizing `identity:delete_user(user_id=40d05eb3824a4f64a11d530d92a271ff)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:42.036313 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cfe6de-fdde-4ebe-b74e-ef59eb5f7226 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:42.048144 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:47:42.085304 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-b2cfe6de-fdde-4ebe-b74e-ef59eb5f7226 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40d05eb3824a4f64a11d530d92a271ff'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:42.093035 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-b2cfe6de-fdde-4ebe-b74e-ef59eb5f7226 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40d05eb3824a4f64a11d530d92a271ff'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:42.100519 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-b2cfe6de-fdde-4ebe-b74e-ef59eb5f7226 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40d05eb3824a4f64a11d530d92a271ff'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:42.101237 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-b2cfe6de-fdde-4ebe-b74e-ef59eb5f7226 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40d05eb3824a4f64a11d530d92a271ff'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:42.102363 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-b2cfe6de-fdde-4ebe-b74e-ef59eb5f7226 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40d05eb3824a4f64a11d530d92a271ff'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:42.120370 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1260/2524] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jul 11 14:47:41 2022] DELETE /identity/v3/users/40d05eb3824a4f64a11d530d92a271ff => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:47:42.124977 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e99c9d-043f-4d59-939b-cb7f5e11ecfd None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:42.125471 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e99c9d-043f-4d59-939b-cb7f5e11ecfd None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:42.125564 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e99c9d-043f-4d59-939b-cb7f5e11ecfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:42.143158 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-e6e99c9d-043f-4d59-939b-cb7f5e11ecfd None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:47:42.144381 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-e6e99c9d-043f-4d59-939b-cb7f5e11ecfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:42.203103 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1265/2525] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:47:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:47:42.213483 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cfe6de-fdde-4ebe-b74e-ef59eb5f7226 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:42.214925 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-b2cfe6de-fdde-4ebe-b74e-ef59eb5f7226 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:42.273666 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cfe6de-fdde-4ebe-b74e-ef59eb5f7226 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:42.277625 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781e373d-75cb-4fe1-818e-3d29299b5282 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20eede5ccd834862b00123310b5c3975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:42.278275 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781e373d-75cb-4fe1-818e-3d29299b5282 service neutron] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:42.278564 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781e373d-75cb-4fe1-818e-3d29299b5282 service neutron] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:42.278841 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781e373d-75cb-4fe1-818e-3d29299b5282 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:42.288007 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781e373d-75cb-4fe1-818e-3d29299b5282 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:42.289619 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781e373d-75cb-4fe1-818e-3d29299b5282 service neutron] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:42.299077 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1261/2526] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:47:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:47:42.578387 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e99c9d-043f-4d59-939b-cb7f5e11ecfd None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:42.579866 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-e6e99c9d-043f-4d59-939b-cb7f5e11ecfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:42.592419 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e99c9d-043f-4d59-939b-cb7f5e11ecfd None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:42.597202 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4786023d-2eb2-4cb9-879f-834db7f5c6b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:42.598075 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4786023d-2eb2-4cb9-879f-834db7f5c6b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:42.598358 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4786023d-2eb2-4cb9-879f-834db7f5c6b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:42.598634 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4786023d-2eb2-4cb9-879f-834db7f5c6b0 admin admin] PATH_INFO: `/v3/projects/40aba6fa56c94843be16f6b78db85a46` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:42.599836 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4786023d-2eb2-4cb9-879f-834db7f5c6b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=40aba6fa56c94843be16f6b78db85a46)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:42.602285 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4786023d-2eb2-4cb9-879f-834db7f5c6b0 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:42.655516 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-4786023d-2eb2-4cb9-879f-834db7f5c6b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40aba6fa56c94843be16f6b78db85a46', 'request_id': 'req-4786023d-2eb2-4cb9-879f-834db7f5c6b0'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:42.661513 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-4786023d-2eb2-4cb9-879f-834db7f5c6b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40aba6fa56c94843be16f6b78db85a46', 'request_id': 'req-4786023d-2eb2-4cb9-879f-834db7f5c6b0'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:42.668300 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-4786023d-2eb2-4cb9-879f-834db7f5c6b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40aba6fa56c94843be16f6b78db85a46', 'request_id': 'req-4786023d-2eb2-4cb9-879f-834db7f5c6b0'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:42.682785 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-4786023d-2eb2-4cb9-879f-834db7f5c6b0 admin admin] The token cache is being invalidate because project 40aba6fa56c94843be16f6b78db85a46 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:47:42.683076 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-4786023d-2eb2-4cb9-879f-834db7f5c6b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:42.683698 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-4786023d-2eb2-4cb9-879f-834db7f5c6b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:42.685295 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1266/2527] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jul 11 14:47:42 2022] DELETE /identity/v3/projects/40aba6fa56c94843be16f6b78db85a46 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:47:42.689201 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781e373d-75cb-4fe1-818e-3d29299b5282 service neutron] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:42.699949 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781e373d-75cb-4fe1-818e-3d29299b5282 service neutron] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:42.757967 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f807b24-202d-4254-b98d-160a8a13a7ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:42.758754 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f807b24-202d-4254-b98d-160a8a13a7ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:42.759039 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f807b24-202d-4254-b98d-160a8a13a7ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:42.759310 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f807b24-202d-4254-b98d-160a8a13a7ee admin admin] PATH_INFO: `/v3/users/7f46b6ca168343ecbce83b67c45bdbd4` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:42.760553 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f807b24-202d-4254-b98d-160a8a13a7ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f46b6ca168343ecbce83b67c45bdbd4)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:42.762486 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f807b24-202d-4254-b98d-160a8a13a7ee admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:42.797864 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:DELETE=15,keystone:SELECT=84,keystone:INSERT=1 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:47:42.813809 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-7f807b24-202d-4254-b98d-160a8a13a7ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f46b6ca168343ecbce83b67c45bdbd4'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:42.821148 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-7f807b24-202d-4254-b98d-160a8a13a7ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f46b6ca168343ecbce83b67c45bdbd4'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:42.828831 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-7f807b24-202d-4254-b98d-160a8a13a7ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f46b6ca168343ecbce83b67c45bdbd4'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:42.829589 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-7f807b24-202d-4254-b98d-160a8a13a7ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f46b6ca168343ecbce83b67c45bdbd4'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:42.830197 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-7f807b24-202d-4254-b98d-160a8a13a7ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f46b6ca168343ecbce83b67c45bdbd4'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:42.848472 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1262/2528] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jul 11 14:47:42 2022] DELETE /identity/v3/users/7f46b6ca168343ecbce83b67c45bdbd4 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:47:43.134280 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4786023d-2eb2-4cb9-879f-834db7f5c6b0 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:43.136554 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-4786023d-2eb2-4cb9-879f-834db7f5c6b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:43.155182 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4786023d-2eb2-4cb9-879f-834db7f5c6b0 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:43.214652 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bbc371-c30b-47e7-91d6-365a9f619125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:43.215516 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bbc371-c30b-47e7-91d6-365a9f619125 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:43.215801 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bbc371-c30b-47e7-91d6-365a9f619125 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:43.216081 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bbc371-c30b-47e7-91d6-365a9f619125 admin admin] PATH_INFO: `/v3/projects/a236ea9c1ee14ee3b684e20b1f56f163` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:43.217304 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bbc371-c30b-47e7-91d6-365a9f619125 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a236ea9c1ee14ee3b684e20b1f56f163)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:43.219622 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bbc371-c30b-47e7-91d6-365a9f619125 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:43.221250 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:47:43.267824 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-58bbc371-c30b-47e7-91d6-365a9f619125 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a236ea9c1ee14ee3b684e20b1f56f163', 'request_id': 'req-58bbc371-c30b-47e7-91d6-365a9f619125'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:43.273467 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-58bbc371-c30b-47e7-91d6-365a9f619125 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a236ea9c1ee14ee3b684e20b1f56f163', 'request_id': 'req-58bbc371-c30b-47e7-91d6-365a9f619125'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:43.279484 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-58bbc371-c30b-47e7-91d6-365a9f619125 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a236ea9c1ee14ee3b684e20b1f56f163', 'request_id': 'req-58bbc371-c30b-47e7-91d6-365a9f619125'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:43.291677 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-58bbc371-c30b-47e7-91d6-365a9f619125 admin admin] The token cache is being invalidate because project a236ea9c1ee14ee3b684e20b1f56f163 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:47:43.291892 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-58bbc371-c30b-47e7-91d6-365a9f619125 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:43.292516 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-58bbc371-c30b-47e7-91d6-365a9f619125 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:43.294046 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1267/2529] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jul 11 14:47:43 2022] DELETE /identity/v3/projects/a236ea9c1ee14ee3b684e20b1f56f163 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:47:43.298948 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713ca303-1a50-43a4-8dd8-46e0f9746871 None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:43.299428 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713ca303-1a50-43a4-8dd8-46e0f9746871 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:43.299540 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713ca303-1a50-43a4-8dd8-46e0f9746871 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:43.318733 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-713ca303-1a50-43a4-8dd8-46e0f9746871 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:47:43.320548 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-713ca303-1a50-43a4-8dd8-46e0f9746871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:43.378986 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1263/2530] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:47:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:47:43.387365 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afff5ddc-f43d-499c-ab1d-f39a3c6f4900 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:43.387658 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afff5ddc-f43d-499c-ab1d-f39a3c6f4900 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:43.387938 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afff5ddc-f43d-499c-ab1d-f39a3c6f4900 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:43.406322 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-afff5ddc-f43d-499c-ab1d-f39a3c6f4900 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:47:43.407525 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-afff5ddc-f43d-499c-ab1d-f39a3c6f4900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:43.416373 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1268/2531] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:47:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:47:43.420590 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713ca303-1a50-43a4-8dd8-46e0f9746871 None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:43.431495 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713ca303-1a50-43a4-8dd8-46e0f9746871 None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:43.436470 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53db3ef-69e5-4f88-b308-33049c0afe06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:43.437153 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53db3ef-69e5-4f88-b308-33049c0afe06 admin admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:43.437442 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53db3ef-69e5-4f88-b308-33049c0afe06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:43.437716 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53db3ef-69e5-4f88-b308-33049c0afe06 admin admin] PATH_INFO: `/v3/domains` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:43.438441 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53db3ef-69e5-4f88-b308-33049c0afe06 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:47:43.438751 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53db3ef-69e5-4f88-b308-33049c0afe06 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:43.440389 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53db3ef-69e5-4f88-b308-33049c0afe06 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:43.453295 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1264/2532] 10.222.0.70 () {58 vars in 1152 bytes} [Mon Jul 11 14:47:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:47:43.457846 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afff5ddc-f43d-499c-ab1d-f39a3c6f4900 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:43.468706 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afff5ddc-f43d-499c-ab1d-f39a3c6f4900 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:43.473185 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020fcb2d-e045-47d7-876d-f18c6916d042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:43.473841 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020fcb2d-e045-47d7-876d-f18c6916d042 admin admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:43.474126 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020fcb2d-e045-47d7-876d-f18c6916d042 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:43.474402 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020fcb2d-e045-47d7-876d-f18c6916d042 admin admin] PATH_INFO: `/v3/projects` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:43.475082 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020fcb2d-e045-47d7-876d-f18c6916d042 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:43.477033 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020fcb2d-e045-47d7-876d-f18c6916d042 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:43.506747 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1269/2533] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jul 11 14:47:43 2022] POST /identity/v3/projects => generated 399 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:47:43.509640 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53db3ef-69e5-4f88-b308-33049c0afe06 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:43.520742 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53db3ef-69e5-4f88-b308-33049c0afe06 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:43.585195 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e226b0-6324-4a0f-8db5-cae53c36841c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:43.585967 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e226b0-6324-4a0f-8db5-cae53c36841c admin admin] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:43.586503 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e226b0-6324-4a0f-8db5-cae53c36841c admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:43.586790 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e226b0-6324-4a0f-8db5-cae53c36841c admin admin] PATH_INFO: `/v3/users` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:43.587498 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e226b0-6324-4a0f-8db5-cae53c36841c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:43.589531 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e226b0-6324-4a0f-8db5-cae53c36841c admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:43.610842 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1265/2534] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jul 11 14:47:43 2022] POST /identity/v3/users => generated 300 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:47:43.615039 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020fcb2d-e045-47d7-876d-f18c6916d042 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:43.626915 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020fcb2d-e045-47d7-876d-f18c6916d042 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:43.632064 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a244978d-3a8a-4b83-91e1-7e1079b0dfa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:43.632416 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a244978d-3a8a-4b83-91e1-7e1079b0dfa9 admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:43.632776 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a244978d-3a8a-4b83-91e1-7e1079b0dfa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:43.633026 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a244978d-3a8a-4b83-91e1-7e1079b0dfa9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:43.633793 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a244978d-3a8a-4b83-91e1-7e1079b0dfa9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:43.635422 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a244978d-3a8a-4b83-91e1-7e1079b0dfa9 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:43.648264 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1270/2535] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:47:43 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 14:47:43.652464 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e226b0-6324-4a0f-8db5-cae53c36841c admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:43.662963 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e226b0-6324-4a0f-8db5-cae53c36841c admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:43.669012 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf68fc0-af46-44f9-a1a0-865db5c85fff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:43.669742 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf68fc0-af46-44f9-a1a0-865db5c85fff admin admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:43.670173 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf68fc0-af46-44f9-a1a0-865db5c85fff admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:43.670565 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf68fc0-af46-44f9-a1a0-865db5c85fff admin admin] PATH_INFO: `/v3/roles` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:43.671294 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf68fc0-af46-44f9-a1a0-865db5c85fff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:43.672919 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf68fc0-af46-44f9-a1a0-865db5c85fff admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:43.684426 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1266/2536] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:47:43 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 14:47:43.688830 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a244978d-3a8a-4b83-91e1-7e1079b0dfa9 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:43.700227 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a244978d-3a8a-4b83-91e1-7e1079b0dfa9 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:43.705728 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664fdd3c-71a2-4a61-bd53-449e6c32f825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:43.706644 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664fdd3c-71a2-4a61-bd53-449e6c32f825 admin admin] REQUEST_METHOD: `PUT` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:43.706929 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664fdd3c-71a2-4a61-bd53-449e6c32f825 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:43.707238 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664fdd3c-71a2-4a61-bd53-449e6c32f825 admin admin] PATH_INFO: `/v3/projects/47f29d004771464294563eda2c1eb5ed/users/795a531f380b46d3bd5fe4aacc314325/roles/8eff41f243c843ed95505a488ca6eada` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:43.726911 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664fdd3c-71a2-4a61-bd53-449e6c32f825 admin admin] RBAC: Authorizing `identity:create_grant(project_id=47f29d004771464294563eda2c1eb5ed, user_id=795a531f380b46d3bd5fe4aacc314325, role_id=8eff41f243c843ed95505a488ca6eada)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:43.730050 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664fdd3c-71a2-4a61-bd53-449e6c32f825 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:43.744903 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1271/2537] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jul 11 14:47:43 2022] PUT /identity/v3/projects/47f29d004771464294563eda2c1eb5ed/users/795a531f380b46d3bd5fe4aacc314325/roles/8eff41f243c843ed95505a488ca6eada => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:47:43.755126 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee2b9a3-d22d-44af-b61b-8e2680cacd3f None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:43.755499 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee2b9a3-d22d-44af-b61b-8e2680cacd3f None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:43.755844 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee2b9a3-d22d-44af-b61b-8e2680cacd3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:43.794273 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-5ee2b9a3-d22d-44af-b61b-8e2680cacd3f None None] MFA Rules not processed for user `795a531f380b46d3bd5fe4aacc314325`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:47:43.795427 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-5ee2b9a3-d22d-44af-b61b-8e2680cacd3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:43.799454 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:47:43.868676 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1267/2538] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:47:43 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:47:43.873279 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664fdd3c-71a2-4a61-bd53-449e6c32f825 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:43.938002 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664fdd3c-71a2-4a61-bd53-449e6c32f825 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:43.942637 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7407119c-c244-4986-9f7d-3e1c7a91216f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:43.943298 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7407119c-c244-4986-9f7d-3e1c7a91216f admin admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:43.943584 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7407119c-c244-4986-9f7d-3e1c7a91216f admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:43.943864 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7407119c-c244-4986-9f7d-3e1c7a91216f admin admin] PATH_INFO: `/v3/projects` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:43.944585 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7407119c-c244-4986-9f7d-3e1c7a91216f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:43.946915 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7407119c-c244-4986-9f7d-3e1c7a91216f admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:43.971825 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1272/2539] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jul 11 14:47:43 2022] POST /identity/v3/projects => generated 397 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:47:43.976645 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee2b9a3-d22d-44af-b61b-8e2680cacd3f None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:43.987317 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee2b9a3-d22d-44af-b61b-8e2680cacd3f None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:44.043313 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1872662-520e-43d3-8e3b-95848d3167be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:44.043973 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1872662-520e-43d3-8e3b-95848d3167be admin admin] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:44.044369 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1872662-520e-43d3-8e3b-95848d3167be admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:44.044547 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1872662-520e-43d3-8e3b-95848d3167be admin admin] PATH_INFO: `/v3/users` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:44.045228 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1872662-520e-43d3-8e3b-95848d3167be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:44.047112 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1872662-520e-43d3-8e3b-95848d3167be admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:44.067440 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1268/2540] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jul 11 14:47:43 2022] POST /identity/v3/users => generated 305 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:47:44.071734 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7407119c-c244-4986-9f7d-3e1c7a91216f admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:44.082188 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7407119c-c244-4986-9f7d-3e1c7a91216f admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:44.087523 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6a2e5f-d3f2-4d7e-91a2-59e4dc2b988b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:44.088177 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6a2e5f-d3f2-4d7e-91a2-59e4dc2b988b admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:44.088495 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6a2e5f-d3f2-4d7e-91a2-59e4dc2b988b admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:44.088776 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6a2e5f-d3f2-4d7e-91a2-59e4dc2b988b admin admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:44.089503 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6a2e5f-d3f2-4d7e-91a2-59e4dc2b988b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:44.091092 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6a2e5f-d3f2-4d7e-91a2-59e4dc2b988b admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:44.096264 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:47:44.104754 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1273/2541] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:47:44 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 14:47:44.109093 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1872662-520e-43d3-8e3b-95848d3167be admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:44.119038 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1872662-520e-43d3-8e3b-95848d3167be admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:44.123854 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b273230c-0868-4979-b945-2a0fbd5f0410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:44.124773 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b273230c-0868-4979-b945-2a0fbd5f0410 admin admin] REQUEST_METHOD: `PUT` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:44.125048 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b273230c-0868-4979-b945-2a0fbd5f0410 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:44.125312 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b273230c-0868-4979-b945-2a0fbd5f0410 admin admin] PATH_INFO: `/v3/projects/08dab1a08ac641438cab7f47dea978a4/users/3a269e63ded3417f80636159f54d3ce2/roles/b46df176b0fe479da63c318db225bed4` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:44.139942 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b273230c-0868-4979-b945-2a0fbd5f0410 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08dab1a08ac641438cab7f47dea978a4, user_id=3a269e63ded3417f80636159f54d3ce2, role_id=b46df176b0fe479da63c318db225bed4)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:44.142596 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b273230c-0868-4979-b945-2a0fbd5f0410 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:44.155903 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1269/2542] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jul 11 14:47:44 2022] PUT /identity/v3/projects/08dab1a08ac641438cab7f47dea978a4/users/3a269e63ded3417f80636159f54d3ce2/roles/b46df176b0fe479da63c318db225bed4 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:47:44.159812 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6a2e5f-d3f2-4d7e-91a2-59e4dc2b988b admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:44.170566 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6a2e5f-d3f2-4d7e-91a2-59e4dc2b988b admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:44.229548 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853fe605-a0da-4bf8-9f2f-5f3f4381aedb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:44.230286 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853fe605-a0da-4bf8-9f2f-5f3f4381aedb admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:44.230575 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853fe605-a0da-4bf8-9f2f-5f3f4381aedb admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:44.230856 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853fe605-a0da-4bf8-9f2f-5f3f4381aedb admin admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:44.231652 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853fe605-a0da-4bf8-9f2f-5f3f4381aedb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:44.233585 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853fe605-a0da-4bf8-9f2f-5f3f4381aedb admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:44.244337 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1274/2543] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:47:44 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:47:44.248832 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b273230c-0868-4979-b945-2a0fbd5f0410 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:44.259741 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b273230c-0868-4979-b945-2a0fbd5f0410 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:44.264896 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40a075b-d6f8-4816-9496-634c7b6a08e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:44.265779 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40a075b-d6f8-4816-9496-634c7b6a08e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:44.266062 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40a075b-d6f8-4816-9496-634c7b6a08e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:44.266338 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40a075b-d6f8-4816-9496-634c7b6a08e8 admin admin] PATH_INFO: `/v3/projects/08dab1a08ac641438cab7f47dea978a4/users/3a269e63ded3417f80636159f54d3ce2/roles/b46df176b0fe479da63c318db225bed4` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:44.268391 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40a075b-d6f8-4816-9496-634c7b6a08e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08dab1a08ac641438cab7f47dea978a4, user_id=3a269e63ded3417f80636159f54d3ce2, role_id=b46df176b0fe479da63c318db225bed4)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:44.271169 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40a075b-d6f8-4816-9496-634c7b6a08e8 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:44.282677 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1270/2544] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jul 11 14:47:44 2022] PUT /identity/v3/projects/08dab1a08ac641438cab7f47dea978a4/users/3a269e63ded3417f80636159f54d3ce2/roles/b46df176b0fe479da63c318db225bed4 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:47:44.294773 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b03116-44de-4f9e-858f-3fcadf6c52dc None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:44.294938 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b03116-44de-4f9e-858f-3fcadf6c52dc None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:44.295190 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b03116-44de-4f9e-858f-3fcadf6c52dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:44.323551 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-70b03116-44de-4f9e-858f-3fcadf6c52dc None None] MFA Rules not processed for user `3a269e63ded3417f80636159f54d3ce2`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:47:44.324784 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-70b03116-44de-4f9e-858f-3fcadf6c52dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:44.393796 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1275/2545] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:47:44 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:47:44.405738 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40a075b-d6f8-4816-9496-634c7b6a08e8 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:44.407562 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-c40a075b-d6f8-4816-9496-634c7b6a08e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:44.466472 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40a075b-d6f8-4816-9496-634c7b6a08e8 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:44.470000 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba79ef5-231f-44e2-a364-ce85fee13360 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '868e7c2dec264512b972c8736d659c34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:44.470641 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba79ef5-231f-44e2-a364-ce85fee13360 service cinder] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:44.470918 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba79ef5-231f-44e2-a364-ce85fee13360 service cinder] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:44.471188 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba79ef5-231f-44e2-a364-ce85fee13360 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:44.481313 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba79ef5-231f-44e2-a364-ce85fee13360 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:44.482735 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba79ef5-231f-44e2-a364-ce85fee13360 service cinder] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:44.487902 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:47:44.493836 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1271/2546] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:47:44 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:47:44.576523 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b03116-44de-4f9e-858f-3fcadf6c52dc None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:44.586754 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b03116-44de-4f9e-858f-3fcadf6c52dc None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:44.590589 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea28135-d54e-4440-8195-0470974bad12 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '868e7c2dec264512b972c8736d659c34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:44.591362 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea28135-d54e-4440-8195-0470974bad12 service cinder] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:44.591669 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea28135-d54e-4440-8195-0470974bad12 service cinder] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:44.591988 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea28135-d54e-4440-8195-0470974bad12 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:44.653734 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea28135-d54e-4440-8195-0470974bad12 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:44.655180 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea28135-d54e-4440-8195-0470974bad12 service cinder] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:44.664768 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1276/2547] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:47:44 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:47:48.753739 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba79ef5-231f-44e2-a364-ce85fee13360 service cinder] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:48.819078 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba79ef5-231f-44e2-a364-ce85fee13360 service cinder] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:48.824638 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef305102-5f3f-438b-9f5b-0f60d85b5cf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:48.825786 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef305102-5f3f-438b-9f5b-0f60d85b5cf2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:48.826062 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef305102-5f3f-438b-9f5b-0f60d85b5cf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:48.826267 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef305102-5f3f-438b-9f5b-0f60d85b5cf2 admin admin] PATH_INFO: `/v3/users/795a531f380b46d3bd5fe4aacc314325` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:48.827477 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef305102-5f3f-438b-9f5b-0f60d85b5cf2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=795a531f380b46d3bd5fe4aacc314325)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:48.829569 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef305102-5f3f-438b-9f5b-0f60d85b5cf2 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:48.879122 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-ef305102-5f3f-438b-9f5b-0f60d85b5cf2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '795a531f380b46d3bd5fe4aacc314325'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:48.886906 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-ef305102-5f3f-438b-9f5b-0f60d85b5cf2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '795a531f380b46d3bd5fe4aacc314325'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:48.895606 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-ef305102-5f3f-438b-9f5b-0f60d85b5cf2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '795a531f380b46d3bd5fe4aacc314325'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:48.896391 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-ef305102-5f3f-438b-9f5b-0f60d85b5cf2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '795a531f380b46d3bd5fe4aacc314325'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:48.897013 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-ef305102-5f3f-438b-9f5b-0f60d85b5cf2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '795a531f380b46d3bd5fe4aacc314325'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:48.915674 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1272/2548] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jul 11 14:47:48 2022] DELETE /identity/v3/users/795a531f380b46d3bd5fe4aacc314325 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:47:48.920460 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c445b1f5-7d01-4a25-a82a-2bcb330caefd None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:48.921302 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c445b1f5-7d01-4a25-a82a-2bcb330caefd None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:48.921778 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c445b1f5-7d01-4a25-a82a-2bcb330caefd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:48.939781 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-c445b1f5-7d01-4a25-a82a-2bcb330caefd None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:47:48.941076 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-c445b1f5-7d01-4a25-a82a-2bcb330caefd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:48.954842 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:47:49.008659 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1277/2549] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:47:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:47:49.018477 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef305102-5f3f-438b-9f5b-0f60d85b5cf2 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:49.020611 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-ef305102-5f3f-438b-9f5b-0f60d85b5cf2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:49.081034 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef305102-5f3f-438b-9f5b-0f60d85b5cf2 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:49.084714 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412b30e6-28de-4796-9c63-a33b8f2d1581 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20eede5ccd834862b00123310b5c3975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:49.086015 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412b30e6-28de-4796-9c63-a33b8f2d1581 service neutron] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:49.086297 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412b30e6-28de-4796-9c63-a33b8f2d1581 service neutron] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:49.086568 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412b30e6-28de-4796-9c63-a33b8f2d1581 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:49.096089 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412b30e6-28de-4796-9c63-a33b8f2d1581 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:49.097541 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412b30e6-28de-4796-9c63-a33b8f2d1581 service neutron] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:49.107356 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1273/2550] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:47:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:47:49.417409 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c445b1f5-7d01-4a25-a82a-2bcb330caefd None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:49.418843 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-c445b1f5-7d01-4a25-a82a-2bcb330caefd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:49.434643 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c445b1f5-7d01-4a25-a82a-2bcb330caefd None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:49.440706 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66cc249-62ae-4096-b517-85562ff92318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:49.442291 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66cc249-62ae-4096-b517-85562ff92318 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:49.442696 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66cc249-62ae-4096-b517-85562ff92318 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:49.443226 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66cc249-62ae-4096-b517-85562ff92318 admin admin] PATH_INFO: `/v3/projects/47f29d004771464294563eda2c1eb5ed` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:49.445689 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66cc249-62ae-4096-b517-85562ff92318 admin admin] RBAC: Authorizing `identity:delete_project(project_id=47f29d004771464294563eda2c1eb5ed)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:49.448762 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66cc249-62ae-4096-b517-85562ff92318 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:49.502462 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-d66cc249-62ae-4096-b517-85562ff92318 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47f29d004771464294563eda2c1eb5ed', 'request_id': 'req-d66cc249-62ae-4096-b517-85562ff92318'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:49.508550 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-d66cc249-62ae-4096-b517-85562ff92318 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47f29d004771464294563eda2c1eb5ed', 'request_id': 'req-d66cc249-62ae-4096-b517-85562ff92318'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:49.514985 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-d66cc249-62ae-4096-b517-85562ff92318 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47f29d004771464294563eda2c1eb5ed', 'request_id': 'req-d66cc249-62ae-4096-b517-85562ff92318'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:49.528310 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-d66cc249-62ae-4096-b517-85562ff92318 admin admin] The token cache is being invalidate because project 47f29d004771464294563eda2c1eb5ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:47:49.528605 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-d66cc249-62ae-4096-b517-85562ff92318 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:49.529304 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-d66cc249-62ae-4096-b517-85562ff92318 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:49.531564 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1278/2551] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jul 11 14:47:49 2022] DELETE /identity/v3/projects/47f29d004771464294563eda2c1eb5ed => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:47:49.535761 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412b30e6-28de-4796-9c63-a33b8f2d1581 service neutron] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:49.545734 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412b30e6-28de-4796-9c63-a33b8f2d1581 service neutron] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:49.565393 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:47:49.608751 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0de8c6-79a4-4ace-98d4-ea3e3754cba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:49.609542 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0de8c6-79a4-4ace-98d4-ea3e3754cba1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:49.609842 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0de8c6-79a4-4ace-98d4-ea3e3754cba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:49.610098 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0de8c6-79a4-4ace-98d4-ea3e3754cba1 admin admin] PATH_INFO: `/v3/users/3a269e63ded3417f80636159f54d3ce2` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:49.611288 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0de8c6-79a4-4ace-98d4-ea3e3754cba1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a269e63ded3417f80636159f54d3ce2)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:49.613250 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0de8c6-79a4-4ace-98d4-ea3e3754cba1 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:49.660952 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-af0de8c6-79a4-4ace-98d4-ea3e3754cba1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a269e63ded3417f80636159f54d3ce2'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:49.668343 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-af0de8c6-79a4-4ace-98d4-ea3e3754cba1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a269e63ded3417f80636159f54d3ce2'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:49.676046 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-af0de8c6-79a4-4ace-98d4-ea3e3754cba1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a269e63ded3417f80636159f54d3ce2'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:49.676707 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-af0de8c6-79a4-4ace-98d4-ea3e3754cba1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a269e63ded3417f80636159f54d3ce2'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:49.677345 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-af0de8c6-79a4-4ace-98d4-ea3e3754cba1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a269e63ded3417f80636159f54d3ce2'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:49.696686 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1274/2552] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jul 11 14:47:49 2022] DELETE /identity/v3/users/3a269e63ded3417f80636159f54d3ce2 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:47:49.965666 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66cc249-62ae-4096-b517-85562ff92318 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:49.967362 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-d66cc249-62ae-4096-b517-85562ff92318 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:49.983643 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66cc249-62ae-4096-b517-85562ff92318 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:50.050646 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3db638-dbc7-42a2-b3e5-2f275f9cef8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:50.051515 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3db638-dbc7-42a2-b3e5-2f275f9cef8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:50.051807 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3db638-dbc7-42a2-b3e5-2f275f9cef8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:50.052089 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3db638-dbc7-42a2-b3e5-2f275f9cef8e admin admin] PATH_INFO: `/v3/projects/08dab1a08ac641438cab7f47dea978a4` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:50.053298 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3db638-dbc7-42a2-b3e5-2f275f9cef8e admin admin] RBAC: Authorizing `identity:delete_project(project_id=08dab1a08ac641438cab7f47dea978a4)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:50.055468 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3db638-dbc7-42a2-b3e5-2f275f9cef8e admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:50.102334 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:47:50.105748 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-be3db638-dbc7-42a2-b3e5-2f275f9cef8e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08dab1a08ac641438cab7f47dea978a4', 'request_id': 'req-be3db638-dbc7-42a2-b3e5-2f275f9cef8e'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:50.112259 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-be3db638-dbc7-42a2-b3e5-2f275f9cef8e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08dab1a08ac641438cab7f47dea978a4', 'request_id': 'req-be3db638-dbc7-42a2-b3e5-2f275f9cef8e'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:50.118752 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-be3db638-dbc7-42a2-b3e5-2f275f9cef8e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08dab1a08ac641438cab7f47dea978a4', 'request_id': 'req-be3db638-dbc7-42a2-b3e5-2f275f9cef8e'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:50.131556 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-be3db638-dbc7-42a2-b3e5-2f275f9cef8e admin admin] The token cache is being invalidate because project 08dab1a08ac641438cab7f47dea978a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:47:50.131922 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-be3db638-dbc7-42a2-b3e5-2f275f9cef8e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:50.132583 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-be3db638-dbc7-42a2-b3e5-2f275f9cef8e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:50.134207 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1279/2553] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jul 11 14:47:49 2022] DELETE /identity/v3/projects/08dab1a08ac641438cab7f47dea978a4 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:47:50.139351 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a27b148-0b34-40d6-88fa-37972681e3e9 None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:50.139839 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a27b148-0b34-40d6-88fa-37972681e3e9 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:50.139839 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a27b148-0b34-40d6-88fa-37972681e3e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:50.159383 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-2a27b148-0b34-40d6-88fa-37972681e3e9 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:47:50.160714 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-2a27b148-0b34-40d6-88fa-37972681e3e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:50.221564 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1275/2554] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:47:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:47:50.230045 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f687212-1015-48d2-b4ba-8f913ec242ee None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:50.230330 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f687212-1015-48d2-b4ba-8f913ec242ee None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:50.230605 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f687212-1015-48d2-b4ba-8f913ec242ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:50.251409 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-8f687212-1015-48d2-b4ba-8f913ec242ee None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:47:50.252827 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-8f687212-1015-48d2-b4ba-8f913ec242ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:50.261587 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1280/2555] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:47:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:47:50.265909 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a27b148-0b34-40d6-88fa-37972681e3e9 None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:50.276030 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a27b148-0b34-40d6-88fa-37972681e3e9 None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:50.280977 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24405e3-629a-49cd-98bc-71f9b4aa7b04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:50.281730 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24405e3-629a-49cd-98bc-71f9b4aa7b04 admin admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:50.281923 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24405e3-629a-49cd-98bc-71f9b4aa7b04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:50.282198 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24405e3-629a-49cd-98bc-71f9b4aa7b04 admin admin] PATH_INFO: `/v3/domains` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:50.282927 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24405e3-629a-49cd-98bc-71f9b4aa7b04 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:47:50.283231 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24405e3-629a-49cd-98bc-71f9b4aa7b04 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:50.284856 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24405e3-629a-49cd-98bc-71f9b4aa7b04 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:50.297780 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1276/2556] 10.222.0.70 () {58 vars in 1152 bytes} [Mon Jul 11 14:47:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:47:50.302225 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f687212-1015-48d2-b4ba-8f913ec242ee None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:50.313496 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f687212-1015-48d2-b4ba-8f913ec242ee None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:50.318197 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f701606-eec9-489a-aa4e-e840550268c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:50.318863 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f701606-eec9-489a-aa4e-e840550268c5 admin admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:50.319146 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f701606-eec9-489a-aa4e-e840550268c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:50.319487 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f701606-eec9-489a-aa4e-e840550268c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:50.320965 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f701606-eec9-489a-aa4e-e840550268c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:50.322920 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f701606-eec9-489a-aa4e-e840550268c5 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:50.350501 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1281/2557] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jul 11 14:47:50 2022] POST /identity/v3/projects => generated 365 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:47:50.355879 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24405e3-629a-49cd-98bc-71f9b4aa7b04 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:50.367443 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24405e3-629a-49cd-98bc-71f9b4aa7b04 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:50.399620 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:47:50.431293 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f41498-7eda-4ebd-8a5b-daf6ffb6440f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:50.431959 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f41498-7eda-4ebd-8a5b-daf6ffb6440f admin admin] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:50.432518 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f41498-7eda-4ebd-8a5b-daf6ffb6440f admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:50.432794 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f41498-7eda-4ebd-8a5b-daf6ffb6440f admin admin] PATH_INFO: `/v3/users` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:50.433490 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f41498-7eda-4ebd-8a5b-daf6ffb6440f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:50.435658 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f41498-7eda-4ebd-8a5b-daf6ffb6440f admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:50.455748 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1277/2558] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jul 11 14:47:50 2022] POST /identity/v3/users => generated 283 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:47:50.461067 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f701606-eec9-489a-aa4e-e840550268c5 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:50.471462 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f701606-eec9-489a-aa4e-e840550268c5 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:50.476332 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1cd527-3b38-476c-aefb-f460b22bddb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:50.477000 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1cd527-3b38-476c-aefb-f460b22bddb4 admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:50.477285 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1cd527-3b38-476c-aefb-f460b22bddb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:50.477564 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1cd527-3b38-476c-aefb-f460b22bddb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:50.478319 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1cd527-3b38-476c-aefb-f460b22bddb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:50.479921 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1cd527-3b38-476c-aefb-f460b22bddb4 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:50.490486 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1282/2559] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:47:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:47:50.494674 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f41498-7eda-4ebd-8a5b-daf6ffb6440f admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:50.504794 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f41498-7eda-4ebd-8a5b-daf6ffb6440f admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:50.510559 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d344945a-e506-4085-ad95-4d037054a4bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:50.511219 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d344945a-e506-4085-ad95-4d037054a4bb admin admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:50.511497 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d344945a-e506-4085-ad95-4d037054a4bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:50.511768 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d344945a-e506-4085-ad95-4d037054a4bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:50.512527 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d344945a-e506-4085-ad95-4d037054a4bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:50.514112 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d344945a-e506-4085-ad95-4d037054a4bb admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:50.525106 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1278/2560] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:47:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:47:50.529358 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1cd527-3b38-476c-aefb-f460b22bddb4 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:50.539730 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1cd527-3b38-476c-aefb-f460b22bddb4 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:50.544464 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa4e3d2-b87b-4bf3-a612-6ca3c5ffbfc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:50.545338 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa4e3d2-b87b-4bf3-a612-6ca3c5ffbfc2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:50.545617 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa4e3d2-b87b-4bf3-a612-6ca3c5ffbfc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:50.545891 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa4e3d2-b87b-4bf3-a612-6ca3c5ffbfc2 admin admin] PATH_INFO: `/v3/projects/e9f89986ef6945539f6dcf5755d5fd0b/users/1467280b507247669e085db78c1b0f4a/roles/8eff41f243c843ed95505a488ca6eada` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:50.562471 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa4e3d2-b87b-4bf3-a612-6ca3c5ffbfc2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9f89986ef6945539f6dcf5755d5fd0b, user_id=1467280b507247669e085db78c1b0f4a, role_id=8eff41f243c843ed95505a488ca6eada)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:50.565155 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa4e3d2-b87b-4bf3-a612-6ca3c5ffbfc2 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:50.579339 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1283/2561] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jul 11 14:47:50 2022] PUT /identity/v3/projects/e9f89986ef6945539f6dcf5755d5fd0b/users/1467280b507247669e085db78c1b0f4a/roles/8eff41f243c843ed95505a488ca6eada => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:47:50.592129 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd46c27-75c0-46ee-88c7-47a62e8f5ab0 None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:50.592466 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd46c27-75c0-46ee-88c7-47a62e8f5ab0 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:50.592742 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd46c27-75c0-46ee-88c7-47a62e8f5ab0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:50.619724 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-efd46c27-75c0-46ee-88c7-47a62e8f5ab0 None None] MFA Rules not processed for user `1467280b507247669e085db78c1b0f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:47:50.620968 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-efd46c27-75c0-46ee-88c7-47a62e8f5ab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:50.687292 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1279/2562] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:47:50 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:47:50.691766 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa4e3d2-b87b-4bf3-a612-6ca3c5ffbfc2 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:50.756579 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa4e3d2-b87b-4bf3-a612-6ca3c5ffbfc2 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:50.762310 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facf049a-1a21-4f80-b29f-d3eddc5d4cfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:50.762990 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facf049a-1a21-4f80-b29f-d3eddc5d4cfc admin admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:50.763275 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facf049a-1a21-4f80-b29f-d3eddc5d4cfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:50.763554 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facf049a-1a21-4f80-b29f-d3eddc5d4cfc admin admin] PATH_INFO: `/v3/projects` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:50.764276 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facf049a-1a21-4f80-b29f-d3eddc5d4cfc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:50.766221 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facf049a-1a21-4f80-b29f-d3eddc5d4cfc admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:50.796621 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1284/2563] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jul 11 14:47:50 2022] POST /identity/v3/projects => generated 365 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:47:50.798025 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd46c27-75c0-46ee-88c7-47a62e8f5ab0 None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:50.809974 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd46c27-75c0-46ee-88c7-47a62e8f5ab0 None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:50.870517 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba6e8d8-484e-4cc7-bb05-4721fb18b911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:50.871202 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba6e8d8-484e-4cc7-bb05-4721fb18b911 admin admin] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:50.871481 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba6e8d8-484e-4cc7-bb05-4721fb18b911 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:50.871755 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba6e8d8-484e-4cc7-bb05-4721fb18b911 admin admin] PATH_INFO: `/v3/users` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:50.872544 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba6e8d8-484e-4cc7-bb05-4721fb18b911 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:50.874572 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba6e8d8-484e-4cc7-bb05-4721fb18b911 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:50.896634 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1280/2564] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jul 11 14:47:50 2022] POST /identity/v3/users => generated 289 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:47:50.901442 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facf049a-1a21-4f80-b29f-d3eddc5d4cfc admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:50.911735 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facf049a-1a21-4f80-b29f-d3eddc5d4cfc admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:50.917307 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80e9656-7bdb-41d0-b11f-2b5fdfcdafde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:50.917968 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80e9656-7bdb-41d0-b11f-2b5fdfcdafde admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:50.918247 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80e9656-7bdb-41d0-b11f-2b5fdfcdafde admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:50.918526 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80e9656-7bdb-41d0-b11f-2b5fdfcdafde admin admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:50.919248 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80e9656-7bdb-41d0-b11f-2b5fdfcdafde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:50.920890 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80e9656-7bdb-41d0-b11f-2b5fdfcdafde admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:50.932939 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1285/2565] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:47:50 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 14:47:50.937387 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba6e8d8-484e-4cc7-bb05-4721fb18b911 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:50.948078 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba6e8d8-484e-4cc7-bb05-4721fb18b911 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:50.952710 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5269dc75-5ffb-4ab8-9957-651a0042ad26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:50.953598 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5269dc75-5ffb-4ab8-9957-651a0042ad26 admin admin] REQUEST_METHOD: `PUT` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:50.953880 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5269dc75-5ffb-4ab8-9957-651a0042ad26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:50.954207 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5269dc75-5ffb-4ab8-9957-651a0042ad26 admin admin] PATH_INFO: `/v3/projects/9aad25d5096d4cfd8f087e961aa97f59/users/d7302b7fb47d45f9b141a2fb6020ceb9/roles/b46df176b0fe479da63c318db225bed4` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:50.971635 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5269dc75-5ffb-4ab8-9957-651a0042ad26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9aad25d5096d4cfd8f087e961aa97f59, user_id=d7302b7fb47d45f9b141a2fb6020ceb9, role_id=b46df176b0fe479da63c318db225bed4)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:50.974327 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5269dc75-5ffb-4ab8-9957-651a0042ad26 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:50.989670 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1281/2566] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jul 11 14:47:50 2022] PUT /identity/v3/projects/9aad25d5096d4cfd8f087e961aa97f59/users/d7302b7fb47d45f9b141a2fb6020ceb9/roles/b46df176b0fe479da63c318db225bed4 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:47:50.994116 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80e9656-7bdb-41d0-b11f-2b5fdfcdafde admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:51.004376 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80e9656-7bdb-41d0-b11f-2b5fdfcdafde admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:51.054730 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:47:51.071745 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732f4561-976f-4f1b-945e-4682f4d1641b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:51.072452 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732f4561-976f-4f1b-945e-4682f4d1641b admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:51.072741 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732f4561-976f-4f1b-945e-4682f4d1641b admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:51.073021 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732f4561-976f-4f1b-945e-4682f4d1641b admin admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:51.073747 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732f4561-976f-4f1b-945e-4682f4d1641b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:51.075349 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732f4561-976f-4f1b-945e-4682f4d1641b admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:51.086202 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1286/2567] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:47:50 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:47:51.090872 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5269dc75-5ffb-4ab8-9957-651a0042ad26 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:51.097042 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:47:51.107475 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5269dc75-5ffb-4ab8-9957-651a0042ad26 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:51.115397 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a2f86b-30d5-44aa-910e-cf61386196d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:51.117348 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a2f86b-30d5-44aa-910e-cf61386196d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:51.117878 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a2f86b-30d5-44aa-910e-cf61386196d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:51.118379 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a2f86b-30d5-44aa-910e-cf61386196d5 admin admin] PATH_INFO: `/v3/projects/9aad25d5096d4cfd8f087e961aa97f59/users/d7302b7fb47d45f9b141a2fb6020ceb9/roles/b46df176b0fe479da63c318db225bed4` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:51.121943 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a2f86b-30d5-44aa-910e-cf61386196d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9aad25d5096d4cfd8f087e961aa97f59, user_id=d7302b7fb47d45f9b141a2fb6020ceb9, role_id=b46df176b0fe479da63c318db225bed4)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:51.127375 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a2f86b-30d5-44aa-910e-cf61386196d5 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:51.147002 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1282/2568] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jul 11 14:47:51 2022] PUT /identity/v3/projects/9aad25d5096d4cfd8f087e961aa97f59/users/d7302b7fb47d45f9b141a2fb6020ceb9/roles/b46df176b0fe479da63c318db225bed4 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:47:51.245395 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b476b0d-6d15-4a62-89f2-5af01a46a095 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:51.245734 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b476b0d-6d15-4a62-89f2-5af01a46a095 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:51.246110 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b476b0d-6d15-4a62-89f2-5af01a46a095 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:51.276616 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-2b476b0d-6d15-4a62-89f2-5af01a46a095 None None] MFA Rules not processed for user `d7302b7fb47d45f9b141a2fb6020ceb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:47:51.278567 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-2b476b0d-6d15-4a62-89f2-5af01a46a095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:51.350245 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1287/2569] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:47:51 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:47:51.364334 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a2f86b-30d5-44aa-910e-cf61386196d5 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:51.366059 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-09a2f86b-30d5-44aa-910e-cf61386196d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:51.438343 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a2f86b-30d5-44aa-910e-cf61386196d5 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:51.442263 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65035a02-2463-4a46-836a-550152300fe5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '868e7c2dec264512b972c8736d659c34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:51.442988 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65035a02-2463-4a46-836a-550152300fe5 service cinder] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:51.443424 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65035a02-2463-4a46-836a-550152300fe5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:51.443723 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65035a02-2463-4a46-836a-550152300fe5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:51.458122 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65035a02-2463-4a46-836a-550152300fe5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:51.459632 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65035a02-2463-4a46-836a-550152300fe5 service cinder] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:51.482282 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1283/2570] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:47:51 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:47:51.569142 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b476b0d-6d15-4a62-89f2-5af01a46a095 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:51.579604 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b476b0d-6d15-4a62-89f2-5af01a46a095 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:51.583330 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340cf04c-79ec-4566-9b36-18cb811a2a21 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '868e7c2dec264512b972c8736d659c34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:51.583984 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340cf04c-79ec-4566-9b36-18cb811a2a21 service cinder] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:51.584435 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340cf04c-79ec-4566-9b36-18cb811a2a21 service cinder] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:51.585435 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340cf04c-79ec-4566-9b36-18cb811a2a21 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:51.643925 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340cf04c-79ec-4566-9b36-18cb811a2a21 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:51.645446 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340cf04c-79ec-4566-9b36-18cb811a2a21 service cinder] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:51.656295 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1288/2571] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:47:51 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:47:54.495370 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e892d3d3-cb65-461e-b6c6-1c963a36b1f7 None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:54.495937 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e892d3d3-cb65-461e-b6c6-1c963a36b1f7 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:54.495937 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e892d3d3-cb65-461e-b6c6-1c963a36b1f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:54.518286 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-e892d3d3-cb65-461e-b6c6-1c963a36b1f7 None None] MFA Rules not processed for user `caa770e36e624905b2e23610e901e22d`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:47:54.519510 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-e892d3d3-cb65-461e-b6c6-1c963a36b1f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:54.589379 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1284/2572] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:47:54 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:47:56.563775 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340cf04c-79ec-4566-9b36-18cb811a2a21 service cinder] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:56.634362 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340cf04c-79ec-4566-9b36-18cb811a2a21 service cinder] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:56.638960 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339f0238-38ce-43c4-93bc-2c79c9b4fd3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:56.639834 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339f0238-38ce-43c4-93bc-2c79c9b4fd3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:56.640116 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339f0238-38ce-43c4-93bc-2c79c9b4fd3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:56.640421 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339f0238-38ce-43c4-93bc-2c79c9b4fd3f admin admin] PATH_INFO: `/v3/users/1467280b507247669e085db78c1b0f4a` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:56.641622 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339f0238-38ce-43c4-93bc-2c79c9b4fd3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=1467280b507247669e085db78c1b0f4a)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:56.643580 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339f0238-38ce-43c4-93bc-2c79c9b4fd3f admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:56.649303 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:47:56.697976 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-339f0238-38ce-43c4-93bc-2c79c9b4fd3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1467280b507247669e085db78c1b0f4a'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:56.710059 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-339f0238-38ce-43c4-93bc-2c79c9b4fd3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1467280b507247669e085db78c1b0f4a'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:56.719707 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-339f0238-38ce-43c4-93bc-2c79c9b4fd3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1467280b507247669e085db78c1b0f4a'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:56.720318 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-339f0238-38ce-43c4-93bc-2c79c9b4fd3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1467280b507247669e085db78c1b0f4a'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:56.720932 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-339f0238-38ce-43c4-93bc-2c79c9b4fd3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1467280b507247669e085db78c1b0f4a'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:56.742128 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1289/2573] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jul 11 14:47:56 2022] DELETE /identity/v3/users/1467280b507247669e085db78c1b0f4a => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:47:56.747021 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b67e32-bc2d-4db0-a4dd-3ee32cb044b8 None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:56.747574 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b67e32-bc2d-4db0-a4dd-3ee32cb044b8 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:56.747673 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b67e32-bc2d-4db0-a4dd-3ee32cb044b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:56.770301 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-c6b67e32-bc2d-4db0-a4dd-3ee32cb044b8 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:47:56.771529 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-c6b67e32-bc2d-4db0-a4dd-3ee32cb044b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:56.843556 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1285/2574] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:47:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:47:56.854452 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339f0238-38ce-43c4-93bc-2c79c9b4fd3f admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:56.855902 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-339f0238-38ce-43c4-93bc-2c79c9b4fd3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:56.917145 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339f0238-38ce-43c4-93bc-2c79c9b4fd3f admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:56.921018 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7bc09e-4893-4dca-88a9-b2c00b7761d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20eede5ccd834862b00123310b5c3975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:56.921684 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7bc09e-4893-4dca-88a9-b2c00b7761d4 service neutron] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:56.921979 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7bc09e-4893-4dca-88a9-b2c00b7761d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:56.922249 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7bc09e-4893-4dca-88a9-b2c00b7761d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:56.932844 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7bc09e-4893-4dca-88a9-b2c00b7761d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:56.934343 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7bc09e-4893-4dca-88a9-b2c00b7761d4 service neutron] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:56.945410 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1290/2575] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:47:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:47:57.621953 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b67e32-bc2d-4db0-a4dd-3ee32cb044b8 None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:57.623434 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-c6b67e32-bc2d-4db0-a4dd-3ee32cb044b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:57.640402 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b67e32-bc2d-4db0-a4dd-3ee32cb044b8 None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:57.650798 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa459c9-f060-4b51-925c-cd848f01a8b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:57.651956 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa459c9-f060-4b51-925c-cd848f01a8b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:57.652375 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa459c9-f060-4b51-925c-cd848f01a8b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:57.652980 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa459c9-f060-4b51-925c-cd848f01a8b1 admin admin] PATH_INFO: `/v3/projects/e9f89986ef6945539f6dcf5755d5fd0b` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:57.654459 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa459c9-f060-4b51-925c-cd848f01a8b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9f89986ef6945539f6dcf5755d5fd0b)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:57.656534 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa459c9-f060-4b51-925c-cd848f01a8b1 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:57.697613 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:47:57.714045 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-daa459c9-f060-4b51-925c-cd848f01a8b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9f89986ef6945539f6dcf5755d5fd0b', 'request_id': 'req-daa459c9-f060-4b51-925c-cd848f01a8b1'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:57.721223 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-daa459c9-f060-4b51-925c-cd848f01a8b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9f89986ef6945539f6dcf5755d5fd0b', 'request_id': 'req-daa459c9-f060-4b51-925c-cd848f01a8b1'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:57.730926 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-daa459c9-f060-4b51-925c-cd848f01a8b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9f89986ef6945539f6dcf5755d5fd0b', 'request_id': 'req-daa459c9-f060-4b51-925c-cd848f01a8b1'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:57.742659 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-daa459c9-f060-4b51-925c-cd848f01a8b1 admin admin] The token cache is being invalidate because project e9f89986ef6945539f6dcf5755d5fd0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80534) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:47:57.743036 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-daa459c9-f060-4b51-925c-cd848f01a8b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:57.743750 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-daa459c9-f060-4b51-925c-cd848f01a8b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:57.745338 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1286/2576] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jul 11 14:47:57 2022] DELETE /identity/v3/projects/e9f89986ef6945539f6dcf5755d5fd0b => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:47:57.749595 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7bc09e-4893-4dca-88a9-b2c00b7761d4 service neutron] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:57.763281 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7bc09e-4893-4dca-88a9-b2c00b7761d4 service neutron] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:57.828918 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbbc0b0-b6cc-498f-9826-7e43290d0a21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:57.829807 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbbc0b0-b6cc-498f-9826-7e43290d0a21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:57.830098 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbbc0b0-b6cc-498f-9826-7e43290d0a21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:57.830377 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbbc0b0-b6cc-498f-9826-7e43290d0a21 admin admin] PATH_INFO: `/v3/users/d7302b7fb47d45f9b141a2fb6020ceb9` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:57.832020 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbbc0b0-b6cc-498f-9826-7e43290d0a21 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7302b7fb47d45f9b141a2fb6020ceb9)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:57.833669 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbbc0b0-b6cc-498f-9826-7e43290d0a21 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:57.876846 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:47:57.904051 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-8dbbc0b0-b6cc-498f-9826-7e43290d0a21 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7302b7fb47d45f9b141a2fb6020ceb9'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:57.913522 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-8dbbc0b0-b6cc-498f-9826-7e43290d0a21 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7302b7fb47d45f9b141a2fb6020ceb9'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:57.923536 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-8dbbc0b0-b6cc-498f-9826-7e43290d0a21 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7302b7fb47d45f9b141a2fb6020ceb9'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:57.923988 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-8dbbc0b0-b6cc-498f-9826-7e43290d0a21 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7302b7fb47d45f9b141a2fb6020ceb9'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:57.924637 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-8dbbc0b0-b6cc-498f-9826-7e43290d0a21 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7302b7fb47d45f9b141a2fb6020ceb9'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:57.950979 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1291/2577] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jul 11 14:47:57 2022] DELETE /identity/v3/users/d7302b7fb47d45f9b141a2fb6020ceb9 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:47:58.291212 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa459c9-f060-4b51-925c-cd848f01a8b1 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:58.292783 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-daa459c9-f060-4b51-925c-cd848f01a8b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:58.330268 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa459c9-f060-4b51-925c-cd848f01a8b1 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:58.395072 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6f4405-15e1-43bb-a7bc-2bd55e2a7554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:58.396195 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6f4405-15e1-43bb-a7bc-2bd55e2a7554 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:58.396504 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6f4405-15e1-43bb-a7bc-2bd55e2a7554 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:58.396775 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6f4405-15e1-43bb-a7bc-2bd55e2a7554 admin admin] PATH_INFO: `/v3/projects/9aad25d5096d4cfd8f087e961aa97f59` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:58.398020 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6f4405-15e1-43bb-a7bc-2bd55e2a7554 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9aad25d5096d4cfd8f087e961aa97f59)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:58.400120 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6f4405-15e1-43bb-a7bc-2bd55e2a7554 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:58.470865 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-bb6f4405-15e1-43bb-a7bc-2bd55e2a7554 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9aad25d5096d4cfd8f087e961aa97f59', 'request_id': 'req-bb6f4405-15e1-43bb-a7bc-2bd55e2a7554'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:58.477953 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-bb6f4405-15e1-43bb-a7bc-2bd55e2a7554 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9aad25d5096d4cfd8f087e961aa97f59', 'request_id': 'req-bb6f4405-15e1-43bb-a7bc-2bd55e2a7554'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:58.487207 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-bb6f4405-15e1-43bb-a7bc-2bd55e2a7554 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9aad25d5096d4cfd8f087e961aa97f59', 'request_id': 'req-bb6f4405-15e1-43bb-a7bc-2bd55e2a7554'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:58.499489 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-bb6f4405-15e1-43bb-a7bc-2bd55e2a7554 admin admin] The token cache is being invalidate because project 9aad25d5096d4cfd8f087e961aa97f59 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80534) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:47:58.499769 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-bb6f4405-15e1-43bb-a7bc-2bd55e2a7554 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:58.500444 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-bb6f4405-15e1-43bb-a7bc-2bd55e2a7554 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:47:58.502113 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1287/2578] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jul 11 14:47:58 2022] DELETE /identity/v3/projects/9aad25d5096d4cfd8f087e961aa97f59 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:47:58.508447 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bed52c4-2a85-4108-9942-db77d5185317 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:58.508749 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bed52c4-2a85-4108-9942-db77d5185317 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:58.509230 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bed52c4-2a85-4108-9942-db77d5185317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:58.528008 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-1bed52c4-2a85-4108-9942-db77d5185317 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:47:58.529188 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-1bed52c4-2a85-4108-9942-db77d5185317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:58.597804 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1292/2579] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:47:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:47:58.606179 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0467f5d-8496-4727-879e-e2f7dc93a909 None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:58.606463 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0467f5d-8496-4727-879e-e2f7dc93a909 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:58.606737 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0467f5d-8496-4727-879e-e2f7dc93a909 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:58.625937 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-e0467f5d-8496-4727-879e-e2f7dc93a909 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:47:58.627129 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-e0467f5d-8496-4727-879e-e2f7dc93a909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:58.635656 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1288/2580] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:47:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:47:58.640238 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bed52c4-2a85-4108-9942-db77d5185317 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:58.651137 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bed52c4-2a85-4108-9942-db77d5185317 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:58.655785 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991b5a91-0537-4ba6-a569-8c30137d7289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:58.656475 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991b5a91-0537-4ba6-a569-8c30137d7289 admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:58.656797 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991b5a91-0537-4ba6-a569-8c30137d7289 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:58.657072 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991b5a91-0537-4ba6-a569-8c30137d7289 admin admin] PATH_INFO: `/v3/domains` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:58.657803 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991b5a91-0537-4ba6-a569-8c30137d7289 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:47:58.658114 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991b5a91-0537-4ba6-a569-8c30137d7289 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:58.659926 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991b5a91-0537-4ba6-a569-8c30137d7289 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:58.672568 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1293/2581] 10.222.0.70 () {58 vars in 1152 bytes} [Mon Jul 11 14:47:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:47:58.676931 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0467f5d-8496-4727-879e-e2f7dc93a909 None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:58.687139 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0467f5d-8496-4727-879e-e2f7dc93a909 None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:58.691834 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c04707-873a-4791-917d-ae87b3673d61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:58.692521 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c04707-873a-4791-917d-ae87b3673d61 admin admin] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:58.692806 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c04707-873a-4791-917d-ae87b3673d61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:58.693085 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c04707-873a-4791-917d-ae87b3673d61 admin admin] PATH_INFO: `/v3/projects` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:58.693783 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c04707-873a-4791-917d-ae87b3673d61 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:58.696514 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c04707-873a-4791-917d-ae87b3673d61 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:58.723624 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1289/2582] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jul 11 14:47:58 2022] POST /identity/v3/projects => generated 389 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:47:58.728388 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991b5a91-0537-4ba6-a569-8c30137d7289 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:58.739629 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991b5a91-0537-4ba6-a569-8c30137d7289 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:58.799704 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29acd11f-f30f-4fa1-b78a-6915eee97199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:58.800392 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29acd11f-f30f-4fa1-b78a-6915eee97199 admin admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:58.800598 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29acd11f-f30f-4fa1-b78a-6915eee97199 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:58.800874 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29acd11f-f30f-4fa1-b78a-6915eee97199 admin admin] PATH_INFO: `/v3/users` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:58.801569 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29acd11f-f30f-4fa1-b78a-6915eee97199 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:58.803618 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29acd11f-f30f-4fa1-b78a-6915eee97199 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:58.829068 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1294/2583] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jul 11 14:47:58 2022] POST /identity/v3/users => generated 295 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:47:58.830542 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c04707-873a-4791-917d-ae87b3673d61 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:58.843231 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c04707-873a-4791-917d-ae87b3673d61 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:58.848279 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d2038d-2cca-4654-8064-2206c11b6e21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:58.848947 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d2038d-2cca-4654-8064-2206c11b6e21 admin admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:58.849237 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d2038d-2cca-4654-8064-2206c11b6e21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:58.849511 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d2038d-2cca-4654-8064-2206c11b6e21 admin admin] PATH_INFO: `/v3/roles` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:58.850376 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d2038d-2cca-4654-8064-2206c11b6e21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:58.852161 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d2038d-2cca-4654-8064-2206c11b6e21 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:58.862967 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1290/2584] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:47:58 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:47:58.867494 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29acd11f-f30f-4fa1-b78a-6915eee97199 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:58.877515 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29acd11f-f30f-4fa1-b78a-6915eee97199 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:58.883277 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9aa1a9c-cb48-4d95-92fb-1d3c80320772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:58.883926 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aa1a9c-cb48-4d95-92fb-1d3c80320772 admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:58.884228 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aa1a9c-cb48-4d95-92fb-1d3c80320772 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:58.884514 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aa1a9c-cb48-4d95-92fb-1d3c80320772 admin admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:58.885234 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9aa1a9c-cb48-4d95-92fb-1d3c80320772 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:58.886818 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9aa1a9c-cb48-4d95-92fb-1d3c80320772 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:58.896746 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1295/2585] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:47:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:47:58.901556 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d2038d-2cca-4654-8064-2206c11b6e21 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:58.911552 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d2038d-2cca-4654-8064-2206c11b6e21 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:58.916298 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6404a4-42dd-4705-af09-0c5680f5a127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:58.917172 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6404a4-42dd-4705-af09-0c5680f5a127 admin admin] REQUEST_METHOD: `PUT` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:58.917453 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6404a4-42dd-4705-af09-0c5680f5a127 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:58.917728 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6404a4-42dd-4705-af09-0c5680f5a127 admin admin] PATH_INFO: `/v3/projects/0ae898a732b6441a8d105a877d6e8565/users/57ef1004647648dc94e4d91b5e82f74c/roles/8eff41f243c843ed95505a488ca6eada` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:58.926010 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:47:58.935920 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6404a4-42dd-4705-af09-0c5680f5a127 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ae898a732b6441a8d105a877d6e8565, user_id=57ef1004647648dc94e4d91b5e82f74c, role_id=8eff41f243c843ed95505a488ca6eada)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:58.938792 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6404a4-42dd-4705-af09-0c5680f5a127 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:58.953130 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1291/2586] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jul 11 14:47:58 2022] PUT /identity/v3/projects/0ae898a732b6441a8d105a877d6e8565/users/57ef1004647648dc94e4d91b5e82f74c/roles/8eff41f243c843ed95505a488ca6eada => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:47:58.965916 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7ec29e-fd51-4327-ba5a-95d2636a7344 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:58.966202 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7ec29e-fd51-4327-ba5a-95d2636a7344 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:58.966501 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7ec29e-fd51-4327-ba5a-95d2636a7344 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:58.985430 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:47:58.994223 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-8a7ec29e-fd51-4327-ba5a-95d2636a7344 None None] MFA Rules not processed for user `57ef1004647648dc94e4d91b5e82f74c`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:47:58.995805 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-8a7ec29e-fd51-4327-ba5a-95d2636a7344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:59.059926 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1296/2587] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:47:58 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:47:59.071600 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6404a4-42dd-4705-af09-0c5680f5a127 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:59.073348 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-fc6404a4-42dd-4705-af09-0c5680f5a127 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:59.134962 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6404a4-42dd-4705-af09-0c5680f5a127 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:59.138663 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36909e11-031c-4c06-8663-087bd5da89a9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '868e7c2dec264512b972c8736d659c34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:59.139309 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36909e11-031c-4c06-8663-087bd5da89a9 service cinder] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:59.139593 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36909e11-031c-4c06-8663-087bd5da89a9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:59.139871 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36909e11-031c-4c06-8663-087bd5da89a9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:59.151745 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36909e11-031c-4c06-8663-087bd5da89a9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:59.153514 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36909e11-031c-4c06-8663-087bd5da89a9 service cinder] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:59.163217 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1292/2588] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:47:59 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:48:09.056726 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=27 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:48:09.158729 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=31,keystone:INSERT=1 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:48:09.259984 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7ec29e-fd51-4327-ba5a-95d2636a7344 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:48:09.330933 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7ec29e-fd51-4327-ba5a-95d2636a7344 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:48:09.336286 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23fcc9c-f4f6-47c4-857c-df64eb287632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:48:09.337175 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23fcc9c-f4f6-47c4-857c-df64eb287632 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:09.337462 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23fcc9c-f4f6-47c4-857c-df64eb287632 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:09.337741 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23fcc9c-f4f6-47c4-857c-df64eb287632 admin admin] PATH_INFO: `/v3/users/57ef1004647648dc94e4d91b5e82f74c` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:09.338947 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23fcc9c-f4f6-47c4-857c-df64eb287632 admin admin] RBAC: Authorizing `identity:delete_user(user_id=57ef1004647648dc94e4d91b5e82f74c)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:48:09.340923 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23fcc9c-f4f6-47c4-857c-df64eb287632 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:48:09.394014 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-f23fcc9c-f4f6-47c4-857c-df64eb287632 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57ef1004647648dc94e4d91b5e82f74c'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:48:09.402036 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-f23fcc9c-f4f6-47c4-857c-df64eb287632 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57ef1004647648dc94e4d91b5e82f74c'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:48:09.410169 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-f23fcc9c-f4f6-47c4-857c-df64eb287632 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57ef1004647648dc94e4d91b5e82f74c'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:48:09.410833 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-f23fcc9c-f4f6-47c4-857c-df64eb287632 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57ef1004647648dc94e4d91b5e82f74c'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:48:09.411502 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-f23fcc9c-f4f6-47c4-857c-df64eb287632 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57ef1004647648dc94e4d91b5e82f74c'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:48:09.431254 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1297/2589] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jul 11 14:48:09 2022] DELETE /identity/v3/users/57ef1004647648dc94e4d91b5e82f74c => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:48:09.436365 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb9cace-5b64-44a7-a874-b3d6fce9a15a None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:09.436673 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb9cace-5b64-44a7-a874-b3d6fce9a15a None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:09.436958 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb9cace-5b64-44a7-a874-b3d6fce9a15a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:09.456296 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-7fb9cace-5b64-44a7-a874-b3d6fce9a15a None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:48:09.457532 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-7fb9cace-5b64-44a7-a874-b3d6fce9a15a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:48:09.520539 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1293/2590] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:48:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:48:09.531606 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23fcc9c-f4f6-47c4-857c-df64eb287632 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:48:09.533211 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-f23fcc9c-f4f6-47c4-857c-df64eb287632 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:48:09.594702 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23fcc9c-f4f6-47c4-857c-df64eb287632 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:48:09.598487 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee8090a-2b1b-406f-85bb-02bcfda85aff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20eede5ccd834862b00123310b5c3975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:48:09.599197 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee8090a-2b1b-406f-85bb-02bcfda85aff service neutron] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:09.599596 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee8090a-2b1b-406f-85bb-02bcfda85aff service neutron] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:09.599958 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee8090a-2b1b-406f-85bb-02bcfda85aff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:09.609639 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee8090a-2b1b-406f-85bb-02bcfda85aff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:48:09.611125 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee8090a-2b1b-406f-85bb-02bcfda85aff service neutron] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:48:09.621441 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1298/2591] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:48:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:48:09.908522 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb9cace-5b64-44a7-a874-b3d6fce9a15a None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:48:09.910195 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-7fb9cace-5b64-44a7-a874-b3d6fce9a15a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:48:09.924749 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb9cace-5b64-44a7-a874-b3d6fce9a15a None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:48:09.932073 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f880f0f8-a58b-4ef3-950f-67256dc8ec87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:48:09.933113 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f880f0f8-a58b-4ef3-950f-67256dc8ec87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:09.933503 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f880f0f8-a58b-4ef3-950f-67256dc8ec87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:09.933904 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f880f0f8-a58b-4ef3-950f-67256dc8ec87 admin admin] PATH_INFO: `/v3/projects/0ae898a732b6441a8d105a877d6e8565` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:09.935763 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f880f0f8-a58b-4ef3-950f-67256dc8ec87 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ae898a732b6441a8d105a877d6e8565)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:48:09.938012 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f880f0f8-a58b-4ef3-950f-67256dc8ec87 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:48:09.987916 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-f880f0f8-a58b-4ef3-950f-67256dc8ec87 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ae898a732b6441a8d105a877d6e8565', 'request_id': 'req-f880f0f8-a58b-4ef3-950f-67256dc8ec87'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:48:09.994366 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-f880f0f8-a58b-4ef3-950f-67256dc8ec87 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ae898a732b6441a8d105a877d6e8565', 'request_id': 'req-f880f0f8-a58b-4ef3-950f-67256dc8ec87'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:48:10.001638 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-f880f0f8-a58b-4ef3-950f-67256dc8ec87 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ae898a732b6441a8d105a877d6e8565', 'request_id': 'req-f880f0f8-a58b-4ef3-950f-67256dc8ec87'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:48:10.012693 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-f880f0f8-a58b-4ef3-950f-67256dc8ec87 admin admin] The token cache is being invalidate because project 0ae898a732b6441a8d105a877d6e8565 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80534) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:48:10.012983 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-f880f0f8-a58b-4ef3-950f-67256dc8ec87 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:48:10.013622 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-f880f0f8-a58b-4ef3-950f-67256dc8ec87 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:48:10.015161 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1294/2592] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jul 11 14:48:09 2022] DELETE /identity/v3/projects/0ae898a732b6441a8d105a877d6e8565 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:48:10.020144 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eede4096-5665-4774-be77-13e76c9bbd0d None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:10.020472 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eede4096-5665-4774-be77-13e76c9bbd0d None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:10.020815 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eede4096-5665-4774-be77-13e76c9bbd0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:10.039849 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-eede4096-5665-4774-be77-13e76c9bbd0d None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:48:10.041091 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-eede4096-5665-4774-be77-13e76c9bbd0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:48:10.058520 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:48:10.104443 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1299/2593] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:48:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:48:10.111968 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3165c1-3036-4d3a-9d1a-999420c259c4 None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:10.112281 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3165c1-3036-4d3a-9d1a-999420c259c4 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:10.112560 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3165c1-3036-4d3a-9d1a-999420c259c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:10.132703 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-0d3165c1-3036-4d3a-9d1a-999420c259c4 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:48:10.133895 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-0d3165c1-3036-4d3a-9d1a-999420c259c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:48:10.141721 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1295/2594] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:48:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:48:10.145978 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eede4096-5665-4774-be77-13e76c9bbd0d None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:48:10.156843 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eede4096-5665-4774-be77-13e76c9bbd0d None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:48:10.161623 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa14030-7403-4cae-b0e6-e2bc79a7ab69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:48:10.162931 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa14030-7403-4cae-b0e6-e2bc79a7ab69 admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:10.163213 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa14030-7403-4cae-b0e6-e2bc79a7ab69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:10.163491 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa14030-7403-4cae-b0e6-e2bc79a7ab69 admin admin] PATH_INFO: `/v3/domains` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:10.164249 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa14030-7403-4cae-b0e6-e2bc79a7ab69 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:48:10.164561 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa14030-7403-4cae-b0e6-e2bc79a7ab69 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:48:10.166155 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa14030-7403-4cae-b0e6-e2bc79a7ab69 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:48:10.178448 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1300/2595] 10.222.0.70 () {58 vars in 1152 bytes} [Mon Jul 11 14:48:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:48:10.183114 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3165c1-3036-4d3a-9d1a-999420c259c4 None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:48:10.192382 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3165c1-3036-4d3a-9d1a-999420c259c4 None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:48:10.198206 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa381ee7-05af-426d-a5be-7f6eba880e10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:48:10.198861 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa381ee7-05af-426d-a5be-7f6eba880e10 admin admin] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:10.199145 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa381ee7-05af-426d-a5be-7f6eba880e10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:10.199416 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa381ee7-05af-426d-a5be-7f6eba880e10 admin admin] PATH_INFO: `/v3/projects` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:10.200101 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa381ee7-05af-426d-a5be-7f6eba880e10 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:48:10.202022 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa381ee7-05af-426d-a5be-7f6eba880e10 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:48:10.228511 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1296/2596] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jul 11 14:48:10 2022] POST /identity/v3/projects => generated 383 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:48:10.232867 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa14030-7403-4cae-b0e6-e2bc79a7ab69 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:48:10.244059 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa14030-7403-4cae-b0e6-e2bc79a7ab69 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:48:10.302268 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd95c9b-12d1-4d6b-9630-f8cffb5799ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:48:10.304001 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd95c9b-12d1-4d6b-9630-f8cffb5799ea admin admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:10.304316 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd95c9b-12d1-4d6b-9630-f8cffb5799ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:10.304592 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd95c9b-12d1-4d6b-9630-f8cffb5799ea admin admin] PATH_INFO: `/v3/users` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:10.305331 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd95c9b-12d1-4d6b-9630-f8cffb5799ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:48:10.307575 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd95c9b-12d1-4d6b-9630-f8cffb5799ea admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:48:10.331836 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1301/2597] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jul 11 14:48:10 2022] POST /identity/v3/users => generated 292 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:48:10.336165 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa381ee7-05af-426d-a5be-7f6eba880e10 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:48:10.346784 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa381ee7-05af-426d-a5be-7f6eba880e10 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:48:10.351463 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ab3e4e-1874-4bfa-bd67-771d2bdcc1c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:48:10.352134 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ab3e4e-1874-4bfa-bd67-771d2bdcc1c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:10.352530 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ab3e4e-1874-4bfa-bd67-771d2bdcc1c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:10.352730 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ab3e4e-1874-4bfa-bd67-771d2bdcc1c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:10.353458 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ab3e4e-1874-4bfa-bd67-771d2bdcc1c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:48:10.355104 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ab3e4e-1874-4bfa-bd67-771d2bdcc1c7 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:48:10.366540 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1297/2598] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:48:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:48:10.370507 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd95c9b-12d1-4d6b-9630-f8cffb5799ea admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:48:10.380546 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd95c9b-12d1-4d6b-9630-f8cffb5799ea admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:48:10.385918 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47f53fc-a9cb-4364-b78b-ea54e5918162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:48:10.386572 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47f53fc-a9cb-4364-b78b-ea54e5918162 admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:10.386853 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47f53fc-a9cb-4364-b78b-ea54e5918162 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:10.387127 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47f53fc-a9cb-4364-b78b-ea54e5918162 admin admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:10.388009 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47f53fc-a9cb-4364-b78b-ea54e5918162 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:48:10.389632 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47f53fc-a9cb-4364-b78b-ea54e5918162 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:48:10.400029 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1302/2599] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:48:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:48:10.404216 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ab3e4e-1874-4bfa-bd67-771d2bdcc1c7 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:48:10.414373 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ab3e4e-1874-4bfa-bd67-771d2bdcc1c7 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:48:10.419081 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10de7387-e2be-40be-b6ca-444778f221df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:48:10.419958 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10de7387-e2be-40be-b6ca-444778f221df admin admin] REQUEST_METHOD: `PUT` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:10.420290 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10de7387-e2be-40be-b6ca-444778f221df admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:10.420575 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10de7387-e2be-40be-b6ca-444778f221df admin admin] PATH_INFO: `/v3/projects/65a199ee30984747990dd7236d90fb6d/users/45cc9b4c6d0343b09a21c10721b4d95b/roles/8eff41f243c843ed95505a488ca6eada` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:10.436347 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10de7387-e2be-40be-b6ca-444778f221df admin admin] RBAC: Authorizing `identity:create_grant(project_id=65a199ee30984747990dd7236d90fb6d, user_id=45cc9b4c6d0343b09a21c10721b4d95b, role_id=8eff41f243c843ed95505a488ca6eada)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:48:10.439014 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10de7387-e2be-40be-b6ca-444778f221df admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:48:10.452518 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1298/2600] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jul 11 14:48:10 2022] PUT /identity/v3/projects/65a199ee30984747990dd7236d90fb6d/users/45cc9b4c6d0343b09a21c10721b4d95b/roles/8eff41f243c843ed95505a488ca6eada => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:48:10.457909 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6563fe88-43c4-4319-8f0a-921781049502 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:10.458421 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6563fe88-43c4-4319-8f0a-921781049502 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:10.459648 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6563fe88-43c4-4319-8f0a-921781049502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:10.478184 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-6563fe88-43c4-4319-8f0a-921781049502 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:48:10.479393 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-6563fe88-43c4-4319-8f0a-921781049502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:48:10.543708 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1303/2601] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:48:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:48:10.556366 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10de7387-e2be-40be-b6ca-444778f221df admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:48:10.558511 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-10de7387-e2be-40be-b6ca-444778f221df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:48:10.582796 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:48:10.623266 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10de7387-e2be-40be-b6ca-444778f221df admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:48:10.626867 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a6d444-cdec-4972-bb17-fb29d32449a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20eede5ccd834862b00123310b5c3975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:48:10.627514 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a6d444-cdec-4972-bb17-fb29d32449a5 service neutron] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:10.627797 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a6d444-cdec-4972-bb17-fb29d32449a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:10.628072 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a6d444-cdec-4972-bb17-fb29d32449a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:10.637346 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a6d444-cdec-4972-bb17-fb29d32449a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:48:10.638762 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a6d444-cdec-4972-bb17-fb29d32449a5 service neutron] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:48:10.648171 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1299/2602] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:48:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:48:14.426069 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e96170-21e1-4ee2-9ad0-0dc7aae2e6fd None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:14.426546 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e96170-21e1-4ee2-9ad0-0dc7aae2e6fd None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:14.426647 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e96170-21e1-4ee2-9ad0-0dc7aae2e6fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:14.459269 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-02e96170-21e1-4ee2-9ad0-0dc7aae2e6fd None None] MFA Rules not processed for user `45cc9b4c6d0343b09a21c10721b4d95b`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:48:14.460831 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-02e96170-21e1-4ee2-9ad0-0dc7aae2e6fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:48:14.480428 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:48:14.545550 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1304/2603] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:48:14 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:48:14.550127 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a6d444-cdec-4972-bb17-fb29d32449a5 service neutron] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:48:14.561460 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a6d444-cdec-4972-bb17-fb29d32449a5 service neutron] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:48:14.566262 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972fc2b5-2f9a-4196-a16f-a9e51c6dea2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:48:14.567070 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972fc2b5-2f9a-4196-a16f-a9e51c6dea2e admin admin] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:14.567453 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972fc2b5-2f9a-4196-a16f-a9e51c6dea2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:14.568493 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972fc2b5-2f9a-4196-a16f-a9e51c6dea2e admin admin] PATH_INFO: `/v3/projects` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:14.569646 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972fc2b5-2f9a-4196-a16f-a9e51c6dea2e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:48:14.573075 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972fc2b5-2f9a-4196-a16f-a9e51c6dea2e admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:48:14.605024 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1300/2604] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jul 11 14:48:14 2022] POST /identity/v3/projects => generated 385 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:48:14.609251 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e96170-21e1-4ee2-9ad0-0dc7aae2e6fd None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:48:14.622001 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e96170-21e1-4ee2-9ad0-0dc7aae2e6fd None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:48:14.734085 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae455e92-6ffd-4a3f-8545-9e0555691a51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:48:14.734801 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae455e92-6ffd-4a3f-8545-9e0555691a51 admin admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:14.735074 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae455e92-6ffd-4a3f-8545-9e0555691a51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:14.735383 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae455e92-6ffd-4a3f-8545-9e0555691a51 admin admin] PATH_INFO: `/v3/users` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:14.736128 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae455e92-6ffd-4a3f-8545-9e0555691a51 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:48:14.739083 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae455e92-6ffd-4a3f-8545-9e0555691a51 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:48:14.767786 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1305/2605] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jul 11 14:48:14 2022] POST /identity/v3/users => generated 299 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:48:14.769747 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972fc2b5-2f9a-4196-a16f-a9e51c6dea2e admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:48:14.782674 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972fc2b5-2f9a-4196-a16f-a9e51c6dea2e admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:48:14.789636 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646c4911-b75e-48c3-9fbe-6de0567019d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:48:14.790360 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646c4911-b75e-48c3-9fbe-6de0567019d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:14.790656 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646c4911-b75e-48c3-9fbe-6de0567019d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:14.791142 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646c4911-b75e-48c3-9fbe-6de0567019d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:14.792464 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646c4911-b75e-48c3-9fbe-6de0567019d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:48:14.796710 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646c4911-b75e-48c3-9fbe-6de0567019d0 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:48:14.810572 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1301/2606] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:48:14 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:48:14.822392 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae455e92-6ffd-4a3f-8545-9e0555691a51 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:48:14.826750 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae455e92-6ffd-4a3f-8545-9e0555691a51 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:48:14.832239 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c060066-0511-4bf9-bb92-f21e8129c980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:48:14.833395 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c060066-0511-4bf9-bb92-f21e8129c980 admin admin] REQUEST_METHOD: `PUT` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:14.833974 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c060066-0511-4bf9-bb92-f21e8129c980 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:14.834435 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c060066-0511-4bf9-bb92-f21e8129c980 admin admin] PATH_INFO: `/v3/projects/df5a95228d3e483586a8cae44fe1bac0/users/076a2349f5794994942421f61b3dd756/roles/b46df176b0fe479da63c318db225bed4` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:14.855366 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c060066-0511-4bf9-bb92-f21e8129c980 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df5a95228d3e483586a8cae44fe1bac0, user_id=076a2349f5794994942421f61b3dd756, role_id=b46df176b0fe479da63c318db225bed4)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:48:14.858234 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c060066-0511-4bf9-bb92-f21e8129c980 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:48:14.875304 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1306/2607] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jul 11 14:48:14 2022] PUT /identity/v3/projects/df5a95228d3e483586a8cae44fe1bac0/users/076a2349f5794994942421f61b3dd756/roles/b46df176b0fe479da63c318db225bed4 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:48:14.881432 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646c4911-b75e-48c3-9fbe-6de0567019d0 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:48:14.892267 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646c4911-b75e-48c3-9fbe-6de0567019d0 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:48:14.954833 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc9e911-b3b8-42dc-8415-184e7611999a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:48:14.955517 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc9e911-b3b8-42dc-8415-184e7611999a admin admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:14.955817 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc9e911-b3b8-42dc-8415-184e7611999a admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:14.956146 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc9e911-b3b8-42dc-8415-184e7611999a admin admin] PATH_INFO: `/v3/roles` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:14.956962 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc9e911-b3b8-42dc-8415-184e7611999a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:48:14.959503 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc9e911-b3b8-42dc-8415-184e7611999a admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:48:14.971969 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1302/2608] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:48:14 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:48:14.977764 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c060066-0511-4bf9-bb92-f21e8129c980 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:48:14.989211 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c060066-0511-4bf9-bb92-f21e8129c980 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:48:14.994396 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb51074-1ee4-485d-b844-64b6f2a3684e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:48:14.995304 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb51074-1ee4-485d-b844-64b6f2a3684e admin admin] REQUEST_METHOD: `PUT` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:14.995595 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb51074-1ee4-485d-b844-64b6f2a3684e admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:14.995884 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb51074-1ee4-485d-b844-64b6f2a3684e admin admin] PATH_INFO: `/v3/projects/df5a95228d3e483586a8cae44fe1bac0/users/076a2349f5794994942421f61b3dd756/roles/b46df176b0fe479da63c318db225bed4` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:14.998003 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb51074-1ee4-485d-b844-64b6f2a3684e admin admin] RBAC: Authorizing `identity:create_grant(project_id=df5a95228d3e483586a8cae44fe1bac0, user_id=076a2349f5794994942421f61b3dd756, role_id=b46df176b0fe479da63c318db225bed4)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:48:15.000776 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb51074-1ee4-485d-b844-64b6f2a3684e admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:48:15.013076 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1307/2609] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jul 11 14:48:14 2022] PUT /identity/v3/projects/df5a95228d3e483586a8cae44fe1bac0/users/076a2349f5794994942421f61b3dd756/roles/b46df176b0fe479da63c318db225bed4 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:48:19.876427 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9676592b-2489-435d-a995-4b68c026ce61 None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:19.877264 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9676592b-2489-435d-a995-4b68c026ce61 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:19.877628 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9676592b-2489-435d-a995-4b68c026ce61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:19.906560 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-9676592b-2489-435d-a995-4b68c026ce61 None None] MFA Rules not processed for user `076a2349f5794994942421f61b3dd756`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:48:19.907952 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-9676592b-2489-435d-a995-4b68c026ce61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:48:19.984476 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1303/2610] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:48:19 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:48:19.997564 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb51074-1ee4-485d-b844-64b6f2a3684e admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:48:19.999512 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-fdb51074-1ee4-485d-b844-64b6f2a3684e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:48:20.059198 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb51074-1ee4-485d-b844-64b6f2a3684e admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:48:20.063124 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e079430-0ec8-4b29-b092-c39e3b8850eb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa21b44163d84534b9ca1ffe5b5a6071', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:48:20.063985 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e079430-0ec8-4b29-b092-c39e3b8850eb service glance] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:20.064474 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e079430-0ec8-4b29-b092-c39e3b8850eb service glance] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:20.064753 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e079430-0ec8-4b29-b092-c39e3b8850eb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:20.091570 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:48:20.128039 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e079430-0ec8-4b29-b092-c39e3b8850eb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:48:20.129657 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e079430-0ec8-4b29-b092-c39e3b8850eb service glance] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:48:20.139583 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1308/2611] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:48:19 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:48:20.243486 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9bef24-48e9-471b-889f-35adb5d914c8 None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:20.243774 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9bef24-48e9-471b-889f-35adb5d914c8 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:20.244054 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9bef24-48e9-471b-889f-35adb5d914c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:20.264176 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-6e9bef24-48e9-471b-889f-35adb5d914c8 None None] MFA Rules not processed for user `2ef7b195b623456aa0b12dac0a4bf4d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:48:20.265483 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-6e9bef24-48e9-471b-889f-35adb5d914c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:48:20.272918 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:48:20.330609 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1304/2612] 10.222.0.70 () {58 vars in 1009 bytes} [Mon Jul 11 14:48:20 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:48:20.383358 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e079430-0ec8-4b29-b092-c39e3b8850eb service glance] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:48:20.384864 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-0e079430-0ec8-4b29-b092-c39e3b8850eb service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:48:20.466022 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e079430-0ec8-4b29-b092-c39e3b8850eb service glance] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:48:20.472586 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea2b8d5-5330-4c73-8725-8dc6c091139d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0217add2f5e74a80a1a33b160cc57a2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:48:20.473283 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea2b8d5-5330-4c73-8725-8dc6c091139d service swift] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:20.473570 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea2b8d5-5330-4c73-8725-8dc6c091139d service swift] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:20.474381 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea2b8d5-5330-4c73-8725-8dc6c091139d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:20.483888 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea2b8d5-5330-4c73-8725-8dc6c091139d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:48:20.485636 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea2b8d5-5330-4c73-8725-8dc6c091139d service swift] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:48:20.500603 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1309/2613] 10.222.0.70 () {60 vars in 1384 bytes} [Mon Jul 11 14:48:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 14:48:29.669911 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b76298-0241-476d-805e-445f7b5905f7 None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:29.670443 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b76298-0241-476d-805e-445f7b5905f7 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:29.670552 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b76298-0241-476d-805e-445f7b5905f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:29.688460 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-24b76298-0241-476d-805e-445f7b5905f7 None None] MFA Rules not processed for user `45cc9b4c6d0343b09a21c10721b4d95b`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:48:29.689671 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-24b76298-0241-476d-805e-445f7b5905f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:48:29.697825 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1305/2614] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:48:29 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:48:30.493087 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=48 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:48:31.499148 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942dc355-1c49-4ead-a5fc-00f98d929ca2 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:31.499846 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942dc355-1c49-4ead-a5fc-00f98d929ca2 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:31.499846 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942dc355-1c49-4ead-a5fc-00f98d929ca2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:31.521429 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-942dc355-1c49-4ead-a5fc-00f98d929ca2 None None] MFA Rules not processed for user `2ef7b195b623456aa0b12dac0a4bf4d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:48:31.522714 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-942dc355-1c49-4ead-a5fc-00f98d929ca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:48:31.530511 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1310/2615] 10.222.0.70 () {58 vars in 1009 bytes} [Mon Jul 11 14:48:31 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:48:31.547515 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b76298-0241-476d-805e-445f7b5905f7 None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:48:31.576218 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b76298-0241-476d-805e-445f7b5905f7 None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:48:31.586716 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ac636a-6cb7-4e8b-b933-d65d27de901d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0217add2f5e74a80a1a33b160cc57a2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:48:31.587423 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ac636a-6cb7-4e8b-b933-d65d27de901d service swift] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:31.587719 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ac636a-6cb7-4e8b-b933-d65d27de901d service swift] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:31.588025 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ac636a-6cb7-4e8b-b933-d65d27de901d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:31.597987 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ac636a-6cb7-4e8b-b933-d65d27de901d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:48:31.600704 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ac636a-6cb7-4e8b-b933-d65d27de901d service swift] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:48:31.617567 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1306/2616] 10.222.0.70 () {60 vars in 1384 bytes} [Mon Jul 11 14:48:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 14:48:41.513035 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=3 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:48:41.606410 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=29 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:48:55.553723 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1514d54-d2a0-4df4-9671-102d7346f2ca None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:55.554230 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1514d54-d2a0-4df4-9671-102d7346f2ca None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:55.554323 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1514d54-d2a0-4df4-9671-102d7346f2ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:55.600444 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-c1514d54-d2a0-4df4-9671-102d7346f2ca None None] MFA Rules not processed for user `2ef7b195b623456aa0b12dac0a4bf4d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:48:55.601684 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-c1514d54-d2a0-4df4-9671-102d7346f2ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:48:55.639310 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1311/2617] 10.222.0.70 () {58 vars in 1009 bytes} [Mon Jul 11 14:48:55 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:48:55.652851 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ac636a-6cb7-4e8b-b933-d65d27de901d service swift] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:48:55.701067 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ac636a-6cb7-4e8b-b933-d65d27de901d service swift] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:48:55.707791 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3375891c-0ee5-4825-8b52-cc3d76a59b1e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0217add2f5e74a80a1a33b160cc57a2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:48:55.708685 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3375891c-0ee5-4825-8b52-cc3d76a59b1e service swift] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:55.709130 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3375891c-0ee5-4825-8b52-cc3d76a59b1e service swift] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:55.709734 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3375891c-0ee5-4825-8b52-cc3d76a59b1e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:55.720040 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3375891c-0ee5-4825-8b52-cc3d76a59b1e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:48:55.723297 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3375891c-0ee5-4825-8b52-cc3d76a59b1e service swift] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:48:55.736256 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1307/2618] 10.222.0.70 () {60 vars in 1384 bytes} [Mon Jul 11 14:48:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 11 14:49:00.179077 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1514d54-d2a0-4df4-9671-102d7346f2ca None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:49:00.181022 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-c1514d54-d2a0-4df4-9671-102d7346f2ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:49:00.301574 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1514d54-d2a0-4df4-9671-102d7346f2ca None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:49:00.307284 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8484f296-b943-4b05-9e44-b824668d82b0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bf25c7951dc4182996335ca1f0e56ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:00.308182 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8484f296-b943-4b05-9e44-b824668d82b0 service placement] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:00.308402 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8484f296-b943-4b05-9e44-b824668d82b0 service placement] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:00.308568 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8484f296-b943-4b05-9e44-b824668d82b0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:00.311108 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-8484f296-b943-4b05-9e44-b824668d82b0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:49:00.327497 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3375891c-0ee5-4825-8b52-cc3d76a59b1e service swift] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:49:00.329538 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-3375891c-0ee5-4825-8b52-cc3d76a59b1e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:49:00.331618 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8484f296-b943-4b05-9e44-b824668d82b0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:00.333866 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8484f296-b943-4b05-9e44-b824668d82b0 service placement] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:00.361722 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1312/2619] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:49:00 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:49:00.421327 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3375891c-0ee5-4825-8b52-cc3d76a59b1e service swift] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:49:00.425679 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d4a0e4-e029-4e43-af98-6a37eb81ff55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20eede5ccd834862b00123310b5c3975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:00.426457 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d4a0e4-e029-4e43-af98-6a37eb81ff55 service neutron] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:00.426804 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d4a0e4-e029-4e43-af98-6a37eb81ff55 service neutron] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:00.427141 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d4a0e4-e029-4e43-af98-6a37eb81ff55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:00.438421 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d4a0e4-e029-4e43-af98-6a37eb81ff55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:00.440495 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d4a0e4-e029-4e43-af98-6a37eb81ff55 service neutron] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:00.453123 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1308/2620] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:49:00 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:49:10.346052 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=64 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:49:10.446953 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=46 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:49:11.598016 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e992943-bf33-4f0d-b507-6243bff4476f None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:11.598613 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e992943-bf33-4f0d-b507-6243bff4476f None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:11.598722 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e992943-bf33-4f0d-b507-6243bff4476f None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:11.600243 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1313/2621] 10.222.0.70 () {54 vars in 921 bytes} [Mon Jul 11 14:49:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:49:11.606541 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a19f75-241d-4839-b43e-0f415459a031 None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:11.607059 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a19f75-241d-4839-b43e-0f415459a031 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:11.607163 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a19f75-241d-4839-b43e-0f415459a031 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:11.653139 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-76a19f75-241d-4839-b43e-0f415459a031 None None] MFA Rules not processed for user `f4f8c0d696af4bd5a205ca8e9110b8cc`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:49:11.654859 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-76a19f75-241d-4839-b43e-0f415459a031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:49:11.739092 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1309/2622] 10.222.0.70 () {58 vars in 1018 bytes} [Mon Jul 11 14:49:11 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:49:11.750751 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e992943-bf33-4f0d-b507-6243bff4476f None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:49:11.763531 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e992943-bf33-4f0d-b507-6243bff4476f None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:49:11.767264 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7690be65-7f63-4f68-bb69-0fa08a9f68a5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa21b44163d84534b9ca1ffe5b5a6071', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:11.768809 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7690be65-7f63-4f68-bb69-0fa08a9f68a5 service glance] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:11.769318 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7690be65-7f63-4f68-bb69-0fa08a9f68a5 service glance] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:11.769318 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7690be65-7f63-4f68-bb69-0fa08a9f68a5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:11.781715 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7690be65-7f63-4f68-bb69-0fa08a9f68a5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:11.783202 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7690be65-7f63-4f68-bb69-0fa08a9f68a5 service glance] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:11.797707 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1314/2623] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:49:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:49:11.866540 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb474437-5650-462e-849f-01c192312714 None None] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:11.866901 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb474437-5650-462e-849f-01c192312714 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:11.867211 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb474437-5650-462e-849f-01c192312714 None None] PATH_INFO: `/` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:11.868634 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1310/2624] 10.222.0.70 () {54 vars in 921 bytes} [Mon Jul 11 14:49:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:49:11.873542 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18119105-26cb-4ba7-bad5-02865c9b5021 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:11.873979 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18119105-26cb-4ba7-bad5-02865c9b5021 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:11.874160 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18119105-26cb-4ba7-bad5-02865c9b5021 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:11.906217 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-18119105-26cb-4ba7-bad5-02865c9b5021 None None] MFA Rules not processed for user `20eede5ccd834862b00123310b5c3975`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:49:11.907434 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-18119105-26cb-4ba7-bad5-02865c9b5021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:49:11.925667 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1315/2625] 10.222.0.70 () {58 vars in 1018 bytes} [Mon Jul 11 14:49:11 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:49:11.937491 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb474437-5650-462e-849f-01c192312714 None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:49:11.948921 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb474437-5650-462e-849f-01c192312714 None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:49:11.953251 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f26eac4-022f-497c-8dc6-afe472e76b25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20eede5ccd834862b00123310b5c3975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:11.953903 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f26eac4-022f-497c-8dc6-afe472e76b25 service neutron] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:11.954188 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f26eac4-022f-497c-8dc6-afe472e76b25 service neutron] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:11.954467 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f26eac4-022f-497c-8dc6-afe472e76b25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:11.963195 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f26eac4-022f-497c-8dc6-afe472e76b25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:11.964619 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f26eac4-022f-497c-8dc6-afe472e76b25 service neutron] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:11.974057 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1311/2626] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:49:11 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:49:12.055023 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f4a6a0-9816-4b76-a20a-4d0c2122bef9 None None] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:12.055284 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f4a6a0-9816-4b76-a20a-4d0c2122bef9 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:12.055564 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f4a6a0-9816-4b76-a20a-4d0c2122bef9 None None] PATH_INFO: `/` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:12.057249 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1316/2627] 10.222.0.70 () {54 vars in 921 bytes} [Mon Jul 11 14:49:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:49:12.062157 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1670e1c1-191e-4f0e-adcf-38193e2e2fa9 None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:12.062449 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1670e1c1-191e-4f0e-adcf-38193e2e2fa9 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:12.062729 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1670e1c1-191e-4f0e-adcf-38193e2e2fa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:12.084456 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-1670e1c1-191e-4f0e-adcf-38193e2e2fa9 None None] MFA Rules not processed for user `f4f8c0d696af4bd5a205ca8e9110b8cc`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:49:12.085723 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-1670e1c1-191e-4f0e-adcf-38193e2e2fa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:49:12.099352 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1312/2628] 10.222.0.70 () {58 vars in 1018 bytes} [Mon Jul 11 14:49:12 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:49:12.109785 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f4a6a0-9816-4b76-a20a-4d0c2122bef9 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:49:12.121033 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f4a6a0-9816-4b76-a20a-4d0c2122bef9 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:49:12.124830 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ccc0b6-9a32-4350-a321-09e60eede13f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20eede5ccd834862b00123310b5c3975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:12.125465 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ccc0b6-9a32-4350-a321-09e60eede13f service neutron] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:12.125750 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ccc0b6-9a32-4350-a321-09e60eede13f service neutron] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:12.126026 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ccc0b6-9a32-4350-a321-09e60eede13f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:12.137420 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ccc0b6-9a32-4350-a321-09e60eede13f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:12.138939 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ccc0b6-9a32-4350-a321-09e60eede13f service neutron] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:12.150990 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1317/2629] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:49:12 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:49:13.745725 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7560637b-0c3d-435a-acd8-b21d4e11ef55 None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:13.746243 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7560637b-0c3d-435a-acd8-b21d4e11ef55 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:13.746348 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7560637b-0c3d-435a-acd8-b21d4e11ef55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:13.765835 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-7560637b-0c3d-435a-acd8-b21d4e11ef55 None None] MFA Rules not processed for user `2ef7b195b623456aa0b12dac0a4bf4d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:49:13.767052 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-7560637b-0c3d-435a-acd8-b21d4e11ef55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:49:13.775068 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1313/2630] 10.222.0.70 () {58 vars in 1009 bytes} [Mon Jul 11 14:49:13 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:49:13.788052 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ccc0b6-9a32-4350-a321-09e60eede13f service neutron] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:49:13.800544 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ccc0b6-9a32-4350-a321-09e60eede13f service neutron] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:49:13.805644 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42732ad-9efd-4a8f-86d2-e35ff5a6d6a9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0217add2f5e74a80a1a33b160cc57a2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:13.806552 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42732ad-9efd-4a8f-86d2-e35ff5a6d6a9 service swift] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:13.806838 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42732ad-9efd-4a8f-86d2-e35ff5a6d6a9 service swift] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:13.807114 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42732ad-9efd-4a8f-86d2-e35ff5a6d6a9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:13.815465 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42732ad-9efd-4a8f-86d2-e35ff5a6d6a9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:13.817089 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42732ad-9efd-4a8f-86d2-e35ff5a6d6a9 service swift] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:13.825535 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1318/2631] 10.222.0.70 () {60 vars in 1384 bytes} [Mon Jul 11 14:49:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 14:49:23.760096 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=56 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:49:23.822054 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=30 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:49:33.220831 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad0f229-1bd2-4999-80b7-b59f99b970dc None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:33.221546 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad0f229-1bd2-4999-80b7-b59f99b970dc None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:33.221546 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad0f229-1bd2-4999-80b7-b59f99b970dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:33.239862 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-cad0f229-1bd2-4999-80b7-b59f99b970dc None None] MFA Rules not processed for user `2ef7b195b623456aa0b12dac0a4bf4d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:49:33.240658 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-cad0f229-1bd2-4999-80b7-b59f99b970dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:49:33.248030 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1314/2632] 10.222.0.70 () {58 vars in 967 bytes} [Mon Jul 11 14:49:33 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:49:33.271248 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42732ad-9efd-4a8f-86d2-e35ff5a6d6a9 service swift] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:49:33.282091 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42732ad-9efd-4a8f-86d2-e35ff5a6d6a9 service swift] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:49:33.287944 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ec6956-0c07-419f-b7f8-870167148696 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0217add2f5e74a80a1a33b160cc57a2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:33.288633 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ec6956-0c07-419f-b7f8-870167148696 service swift] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:33.288920 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ec6956-0c07-419f-b7f8-870167148696 service swift] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:33.293391 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ec6956-0c07-419f-b7f8-870167148696 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:33.298458 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ec6956-0c07-419f-b7f8-870167148696 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:33.300782 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ec6956-0c07-419f-b7f8-870167148696 service swift] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:33.310073 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1319/2633] 10.222.0.70 () {60 vars in 1384 bytes} [Mon Jul 11 14:49:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 14:49:43.233923 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=3 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:49:43.306097 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=6 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:49:52.356978 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad0f229-1bd2-4999-80b7-b59f99b970dc None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:49:52.369729 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad0f229-1bd2-4999-80b7-b59f99b970dc None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:49:52.373318 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a355cf-9e96-4e69-9308-cde4918da15d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20eede5ccd834862b00123310b5c3975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:52.373958 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a355cf-9e96-4e69-9308-cde4918da15d service neutron] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:52.374236 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a355cf-9e96-4e69-9308-cde4918da15d service neutron] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:52.374510 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a355cf-9e96-4e69-9308-cde4918da15d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:52.376384 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-b0a355cf-9e96-4e69-9308-cde4918da15d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:49:52.460791 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a355cf-9e96-4e69-9308-cde4918da15d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:52.462225 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a355cf-9e96-4e69-9308-cde4918da15d service neutron] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:52.482086 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1315/2634] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:49:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:49:55.756417 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ec6956-0c07-419f-b7f8-870167148696 service swift] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:49:55.757914 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-c0ec6956-0c07-419f-b7f8-870167148696 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:49:55.773169 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ec6956-0c07-419f-b7f8-870167148696 service swift] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:49:55.778192 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50596a7-19cb-4304-872a-8e7e21c16b28 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bf25c7951dc4182996335ca1f0e56ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:55.778852 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50596a7-19cb-4304-872a-8e7e21c16b28 service placement] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:55.779140 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50596a7-19cb-4304-872a-8e7e21c16b28 service placement] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:55.779417 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50596a7-19cb-4304-872a-8e7e21c16b28 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:55.781243 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-f50596a7-19cb-4304-872a-8e7e21c16b28 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:49:55.798529 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50596a7-19cb-4304-872a-8e7e21c16b28 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:55.800956 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50596a7-19cb-4304-872a-8e7e21c16b28 service placement] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:55.817155 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1320/2635] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:49:55 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:49:55.818402 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a355cf-9e96-4e69-9308-cde4918da15d service neutron] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:49:55.819903 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-b0a355cf-9e96-4e69-9308-cde4918da15d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:49:55.833466 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a355cf-9e96-4e69-9308-cde4918da15d service neutron] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:49:55.838695 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc9bda8-2e71-4a78-9e81-a086c0766866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:55.839765 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc9bda8-2e71-4a78-9e81-a086c0766866 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:55.840277 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc9bda8-2e71-4a78-9e81-a086c0766866 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:55.840736 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc9bda8-2e71-4a78-9e81-a086c0766866 admin admin] PATH_INFO: `/v3/users/caa770e36e624905b2e23610e901e22d` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:55.842813 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc9bda8-2e71-4a78-9e81-a086c0766866 admin admin] RBAC: Authorizing `identity:delete_user(user_id=caa770e36e624905b2e23610e901e22d)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:55.844334 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc9bda8-2e71-4a78-9e81-a086c0766866 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:55.892616 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-2fc9bda8-2e71-4a78-9e81-a086c0766866 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'caa770e36e624905b2e23610e901e22d'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:49:55.899768 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-2fc9bda8-2e71-4a78-9e81-a086c0766866 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'caa770e36e624905b2e23610e901e22d'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:49:55.906781 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-2fc9bda8-2e71-4a78-9e81-a086c0766866 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'caa770e36e624905b2e23610e901e22d'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:49:55.907510 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-2fc9bda8-2e71-4a78-9e81-a086c0766866 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'caa770e36e624905b2e23610e901e22d'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:49:55.908144 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-2fc9bda8-2e71-4a78-9e81-a086c0766866 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'caa770e36e624905b2e23610e901e22d'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:49:55.926379 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1316/2636] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jul 11 14:49:55 2022] DELETE /identity/v3/users/caa770e36e624905b2e23610e901e22d => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:49:56.106042 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50596a7-19cb-4304-872a-8e7e21c16b28 service placement] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:49:56.119730 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50596a7-19cb-4304-872a-8e7e21c16b28 service placement] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:49:56.177840 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bd11fc-3281-44ed-aa35-284e7991ed3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:56.178709 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bd11fc-3281-44ed-aa35-284e7991ed3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:56.178993 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bd11fc-3281-44ed-aa35-284e7991ed3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:56.179272 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bd11fc-3281-44ed-aa35-284e7991ed3b admin admin] PATH_INFO: `/v3/projects/d3ad620e82564c96a6466a45abcbdab5` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:56.180511 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bd11fc-3281-44ed-aa35-284e7991ed3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3ad620e82564c96a6466a45abcbdab5)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:56.182439 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bd11fc-3281-44ed-aa35-284e7991ed3b admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:56.229764 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-54bd11fc-3281-44ed-aa35-284e7991ed3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3ad620e82564c96a6466a45abcbdab5', 'request_id': 'req-54bd11fc-3281-44ed-aa35-284e7991ed3b'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:49:56.235108 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-54bd11fc-3281-44ed-aa35-284e7991ed3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3ad620e82564c96a6466a45abcbdab5', 'request_id': 'req-54bd11fc-3281-44ed-aa35-284e7991ed3b'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:49:56.242178 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-54bd11fc-3281-44ed-aa35-284e7991ed3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3ad620e82564c96a6466a45abcbdab5', 'request_id': 'req-54bd11fc-3281-44ed-aa35-284e7991ed3b'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:49:56.254558 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-54bd11fc-3281-44ed-aa35-284e7991ed3b admin admin] The token cache is being invalidate because project d3ad620e82564c96a6466a45abcbdab5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:49:56.255063 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-54bd11fc-3281-44ed-aa35-284e7991ed3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:49:56.255696 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-54bd11fc-3281-44ed-aa35-284e7991ed3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:49:56.257312 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1321/2637] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jul 11 14:49:56 2022] DELETE /identity/v3/projects/d3ad620e82564c96a6466a45abcbdab5 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:49:56.262421 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddd4107-366f-4740-a9ba-707ffbfb1ea6 None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:56.262712 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddd4107-366f-4740-a9ba-707ffbfb1ea6 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:56.262987 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddd4107-366f-4740-a9ba-707ffbfb1ea6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:56.312370 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-8ddd4107-366f-4740-a9ba-707ffbfb1ea6 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:49:56.313457 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-8ddd4107-366f-4740-a9ba-707ffbfb1ea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:49:56.322870 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:49:56.378551 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1317/2638] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:49:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:49:56.386641 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005bf61c-c758-42a6-b937-fdf86d322c94 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:56.386927 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005bf61c-c758-42a6-b937-fdf86d322c94 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:56.387229 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005bf61c-c758-42a6-b937-fdf86d322c94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:56.407188 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-005bf61c-c758-42a6-b937-fdf86d322c94 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:49:56.408458 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-005bf61c-c758-42a6-b937-fdf86d322c94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:49:56.417006 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1322/2639] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:49:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:49:56.421179 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddd4107-366f-4740-a9ba-707ffbfb1ea6 None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:49:56.431805 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddd4107-366f-4740-a9ba-707ffbfb1ea6 None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:49:56.436638 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66fa178-20f5-4086-8159-e4bff78b6461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:56.437265 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66fa178-20f5-4086-8159-e4bff78b6461 admin admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:56.437546 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66fa178-20f5-4086-8159-e4bff78b6461 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:56.437820 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66fa178-20f5-4086-8159-e4bff78b6461 admin admin] PATH_INFO: `/v3/domains` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:56.438535 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66fa178-20f5-4086-8159-e4bff78b6461 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:49:56.438839 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66fa178-20f5-4086-8159-e4bff78b6461 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:56.440476 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66fa178-20f5-4086-8159-e4bff78b6461 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:56.451880 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1318/2640] 10.222.0.70 () {58 vars in 1152 bytes} [Mon Jul 11 14:49:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:49:56.456831 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005bf61c-c758-42a6-b937-fdf86d322c94 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:49:56.466245 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005bf61c-c758-42a6-b937-fdf86d322c94 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:49:56.471998 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdac13b2-0d6b-4336-a050-5444249a404d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:56.472981 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdac13b2-0d6b-4336-a050-5444249a404d admin admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:56.473401 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdac13b2-0d6b-4336-a050-5444249a404d admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:56.473684 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdac13b2-0d6b-4336-a050-5444249a404d admin admin] PATH_INFO: `/v3/projects` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:56.474387 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdac13b2-0d6b-4336-a050-5444249a404d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:56.476329 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdac13b2-0d6b-4336-a050-5444249a404d admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:56.502579 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1323/2641] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jul 11 14:49:56 2022] POST /identity/v3/projects => generated 381 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:49:56.507174 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66fa178-20f5-4086-8159-e4bff78b6461 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:49:56.517149 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66fa178-20f5-4086-8159-e4bff78b6461 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:49:56.575743 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cb9cfb-a3c7-44d8-97f0-2651f00ba04d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:56.576506 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cb9cfb-a3c7-44d8-97f0-2651f00ba04d admin admin] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:56.576876 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cb9cfb-a3c7-44d8-97f0-2651f00ba04d admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:56.577159 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cb9cfb-a3c7-44d8-97f0-2651f00ba04d admin admin] PATH_INFO: `/v3/users` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:56.577859 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cb9cfb-a3c7-44d8-97f0-2651f00ba04d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:56.579936 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cb9cfb-a3c7-44d8-97f0-2651f00ba04d admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:56.603463 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1319/2642] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jul 11 14:49:56 2022] POST /identity/v3/users => generated 291 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:49:56.607737 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdac13b2-0d6b-4336-a050-5444249a404d admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:49:56.618953 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdac13b2-0d6b-4336-a050-5444249a404d admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:49:56.623793 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a819e0b5-a501-4d6c-8429-a3c36f6002fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:56.624541 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a819e0b5-a501-4d6c-8429-a3c36f6002fa admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:56.624851 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a819e0b5-a501-4d6c-8429-a3c36f6002fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:56.625135 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a819e0b5-a501-4d6c-8429-a3c36f6002fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:56.625847 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a819e0b5-a501-4d6c-8429-a3c36f6002fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:56.627656 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a819e0b5-a501-4d6c-8429-a3c36f6002fa admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:56.639964 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1324/2643] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:49:56 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:49:56.644637 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cb9cfb-a3c7-44d8-97f0-2651f00ba04d admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:49:56.654961 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cb9cfb-a3c7-44d8-97f0-2651f00ba04d admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:49:56.660015 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcfb44e-3248-4aba-bd7a-ea26d35acbc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:56.660798 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcfb44e-3248-4aba-bd7a-ea26d35acbc3 admin admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:56.661087 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcfb44e-3248-4aba-bd7a-ea26d35acbc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:56.661373 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcfb44e-3248-4aba-bd7a-ea26d35acbc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:56.662192 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcfb44e-3248-4aba-bd7a-ea26d35acbc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:56.663872 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcfb44e-3248-4aba-bd7a-ea26d35acbc3 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:56.675097 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1320/2644] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:49:56 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:49:56.680125 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a819e0b5-a501-4d6c-8429-a3c36f6002fa admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:49:56.692528 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a819e0b5-a501-4d6c-8429-a3c36f6002fa admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:49:56.697546 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a57e539-0ac0-4697-8827-fe2e400bd7ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:56.698543 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a57e539-0ac0-4697-8827-fe2e400bd7ec admin admin] REQUEST_METHOD: `PUT` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:56.698927 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a57e539-0ac0-4697-8827-fe2e400bd7ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:56.699309 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a57e539-0ac0-4697-8827-fe2e400bd7ec admin admin] PATH_INFO: `/v3/projects/1c375aa0777643638971141233568d9a/users/fde717a0ef87418eb6b6c3cd37fb9ebb/roles/8eff41f243c843ed95505a488ca6eada` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:56.715887 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a57e539-0ac0-4697-8827-fe2e400bd7ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c375aa0777643638971141233568d9a, user_id=fde717a0ef87418eb6b6c3cd37fb9ebb, role_id=8eff41f243c843ed95505a488ca6eada)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:56.718616 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a57e539-0ac0-4697-8827-fe2e400bd7ec admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:56.738482 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1325/2645] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jul 11 14:49:56 2022] PUT /identity/v3/projects/1c375aa0777643638971141233568d9a/users/fde717a0ef87418eb6b6c3cd37fb9ebb/roles/8eff41f243c843ed95505a488ca6eada => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:49:56.749440 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c9459e-5147-4bba-a19e-fb09a6c7958f None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:56.749735 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c9459e-5147-4bba-a19e-fb09a6c7958f None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:56.750016 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c9459e-5147-4bba-a19e-fb09a6c7958f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:56.778498 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-d0c9459e-5147-4bba-a19e-fb09a6c7958f None None] MFA Rules not processed for user `fde717a0ef87418eb6b6c3cd37fb9ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:49:56.779716 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-d0c9459e-5147-4bba-a19e-fb09a6c7958f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:49:56.855161 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1321/2646] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:49:56 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:49:56.859645 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a57e539-0ac0-4697-8827-fe2e400bd7ec admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:49:56.874133 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:49:56.925247 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a57e539-0ac0-4697-8827-fe2e400bd7ec admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:49:56.929960 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e537ee7d-9eaa-4bcb-a4b7-7c63884ce9b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:56.930618 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e537ee7d-9eaa-4bcb-a4b7-7c63884ce9b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:56.930904 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e537ee7d-9eaa-4bcb-a4b7-7c63884ce9b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:56.931183 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e537ee7d-9eaa-4bcb-a4b7-7c63884ce9b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:56.931884 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e537ee7d-9eaa-4bcb-a4b7-7c63884ce9b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:56.934086 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e537ee7d-9eaa-4bcb-a4b7-7c63884ce9b5 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:56.967786 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1326/2647] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jul 11 14:49:56 2022] POST /identity/v3/projects => generated 379 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:49:56.972495 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c9459e-5147-4bba-a19e-fb09a6c7958f None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:49:56.984525 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c9459e-5147-4bba-a19e-fb09a6c7958f None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:49:56.994001 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:49:57.044705 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb799fe-e5e8-4167-86ae-7ef4e966378a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:57.045399 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb799fe-e5e8-4167-86ae-7ef4e966378a admin admin] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:57.045680 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb799fe-e5e8-4167-86ae-7ef4e966378a admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:57.045954 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb799fe-e5e8-4167-86ae-7ef4e966378a admin admin] PATH_INFO: `/v3/users` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:57.046639 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb799fe-e5e8-4167-86ae-7ef4e966378a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:57.048562 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb799fe-e5e8-4167-86ae-7ef4e966378a admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:57.069039 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1322/2648] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jul 11 14:49:56 2022] POST /identity/v3/users => generated 296 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:49:57.073075 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e537ee7d-9eaa-4bcb-a4b7-7c63884ce9b5 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:49:57.084073 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e537ee7d-9eaa-4bcb-a4b7-7c63884ce9b5 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:49:57.088640 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f538a17-b91c-45a6-86bc-ddfac1815e47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:57.089291 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f538a17-b91c-45a6-86bc-ddfac1815e47 admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:57.089574 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f538a17-b91c-45a6-86bc-ddfac1815e47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:57.089848 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f538a17-b91c-45a6-86bc-ddfac1815e47 admin admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:57.090566 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f538a17-b91c-45a6-86bc-ddfac1815e47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:57.092139 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f538a17-b91c-45a6-86bc-ddfac1815e47 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:57.103210 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1327/2649] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:49:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:49:57.107684 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb799fe-e5e8-4167-86ae-7ef4e966378a admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:49:57.119966 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb799fe-e5e8-4167-86ae-7ef4e966378a admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:49:57.125728 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ad1141-a597-4dd3-9b5a-b748a6277e88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:57.126992 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ad1141-a597-4dd3-9b5a-b748a6277e88 admin admin] REQUEST_METHOD: `PUT` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:57.127279 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ad1141-a597-4dd3-9b5a-b748a6277e88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:57.127772 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ad1141-a597-4dd3-9b5a-b748a6277e88 admin admin] PATH_INFO: `/v3/projects/bbb9823252104fd6bb39c51d16a049db/users/721a1e5f62a14be6b29532abea5bcc02/roles/b46df176b0fe479da63c318db225bed4` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:57.144572 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ad1141-a597-4dd3-9b5a-b748a6277e88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbb9823252104fd6bb39c51d16a049db, user_id=721a1e5f62a14be6b29532abea5bcc02, role_id=b46df176b0fe479da63c318db225bed4)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:57.147344 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ad1141-a597-4dd3-9b5a-b748a6277e88 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:57.161499 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1323/2650] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jul 11 14:49:57 2022] PUT /identity/v3/projects/bbb9823252104fd6bb39c51d16a049db/users/721a1e5f62a14be6b29532abea5bcc02/roles/b46df176b0fe479da63c318db225bed4 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:49:57.165471 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f538a17-b91c-45a6-86bc-ddfac1815e47 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:49:57.176161 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f538a17-b91c-45a6-86bc-ddfac1815e47 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:49:57.234975 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f16b7f-07b6-48cf-b93e-1a089a273d03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:57.235646 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f16b7f-07b6-48cf-b93e-1a089a273d03 admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:57.235932 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f16b7f-07b6-48cf-b93e-1a089a273d03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:57.236234 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f16b7f-07b6-48cf-b93e-1a089a273d03 admin admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:57.237104 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f16b7f-07b6-48cf-b93e-1a089a273d03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:57.238891 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f16b7f-07b6-48cf-b93e-1a089a273d03 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:57.248869 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1328/2651] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:49:57 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:49:57.253078 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ad1141-a597-4dd3-9b5a-b748a6277e88 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:49:57.263482 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ad1141-a597-4dd3-9b5a-b748a6277e88 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:49:57.268018 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f56aef-74e9-4d9f-a76e-8d7addc645f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:57.269530 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f56aef-74e9-4d9f-a76e-8d7addc645f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:57.269808 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f56aef-74e9-4d9f-a76e-8d7addc645f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:57.270079 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f56aef-74e9-4d9f-a76e-8d7addc645f4 admin admin] PATH_INFO: `/v3/projects/bbb9823252104fd6bb39c51d16a049db/users/721a1e5f62a14be6b29532abea5bcc02/roles/b46df176b0fe479da63c318db225bed4` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:57.272046 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f56aef-74e9-4d9f-a76e-8d7addc645f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbb9823252104fd6bb39c51d16a049db, user_id=721a1e5f62a14be6b29532abea5bcc02, role_id=b46df176b0fe479da63c318db225bed4)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:57.274761 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f56aef-74e9-4d9f-a76e-8d7addc645f4 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:57.285479 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1324/2652] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jul 11 14:49:57 2022] PUT /identity/v3/projects/bbb9823252104fd6bb39c51d16a049db/users/721a1e5f62a14be6b29532abea5bcc02/roles/b46df176b0fe479da63c318db225bed4 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:49:57.295411 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5ab86a-832f-46f3-ba28-9436c51b1690 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:57.295710 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5ab86a-832f-46f3-ba28-9436c51b1690 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:57.295994 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5ab86a-832f-46f3-ba28-9436c51b1690 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:57.325027 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-fb5ab86a-832f-46f3-ba28-9436c51b1690 None None] MFA Rules not processed for user `721a1e5f62a14be6b29532abea5bcc02`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:49:57.326236 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-fb5ab86a-832f-46f3-ba28-9436c51b1690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:49:57.394770 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1329/2653] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:49:57 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:49:57.406226 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f56aef-74e9-4d9f-a76e-8d7addc645f4 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:49:57.407942 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-49f56aef-74e9-4d9f-a76e-8d7addc645f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:49:57.491928 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f56aef-74e9-4d9f-a76e-8d7addc645f4 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:49:57.496286 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8556eaa-5093-45f0-9253-eb5e3f46655a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '868e7c2dec264512b972c8736d659c34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:57.496945 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8556eaa-5093-45f0-9253-eb5e3f46655a service cinder] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:57.497227 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8556eaa-5093-45f0-9253-eb5e3f46655a service cinder] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:57.497503 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8556eaa-5093-45f0-9253-eb5e3f46655a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:57.508336 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8556eaa-5093-45f0-9253-eb5e3f46655a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:57.509768 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8556eaa-5093-45f0-9253-eb5e3f46655a service cinder] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:57.519837 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1325/2654] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:49:57 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:49:57.592844 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5ab86a-832f-46f3-ba28-9436c51b1690 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:49:57.603912 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5ab86a-832f-46f3-ba28-9436c51b1690 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:49:57.607580 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36848c8-97c0-4602-864f-e4a122923497 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '868e7c2dec264512b972c8736d659c34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:57.608258 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36848c8-97c0-4602-864f-e4a122923497 service cinder] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:57.608545 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36848c8-97c0-4602-864f-e4a122923497 service cinder] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:57.608820 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36848c8-97c0-4602-864f-e4a122923497 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:57.615246 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:49:57.669610 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36848c8-97c0-4602-864f-e4a122923497 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:57.671082 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36848c8-97c0-4602-864f-e4a122923497 service cinder] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:57.680835 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1330/2655] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:49:57 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:50:04.427872 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8556eaa-5093-45f0-9253-eb5e3f46655a service cinder] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:50:04.475443 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:50:04.490976 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8556eaa-5093-45f0-9253-eb5e3f46655a service cinder] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:50:04.495695 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b8c28f-f0c4-47a8-b079-e43cb630a1b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:50:04.496588 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b8c28f-f0c4-47a8-b079-e43cb630a1b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:04.496869 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b8c28f-f0c4-47a8-b079-e43cb630a1b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:04.497173 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b8c28f-f0c4-47a8-b079-e43cb630a1b6 admin admin] PATH_INFO: `/v3/users/fde717a0ef87418eb6b6c3cd37fb9ebb` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:04.498354 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b8c28f-f0c4-47a8-b079-e43cb630a1b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fde717a0ef87418eb6b6c3cd37fb9ebb)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:50:04.500307 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b8c28f-f0c4-47a8-b079-e43cb630a1b6 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:50:04.549899 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-34b8c28f-f0c4-47a8-b079-e43cb630a1b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fde717a0ef87418eb6b6c3cd37fb9ebb'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:50:04.557211 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-34b8c28f-f0c4-47a8-b079-e43cb630a1b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fde717a0ef87418eb6b6c3cd37fb9ebb'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:50:04.566399 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-34b8c28f-f0c4-47a8-b079-e43cb630a1b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fde717a0ef87418eb6b6c3cd37fb9ebb'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:50:04.567078 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-34b8c28f-f0c4-47a8-b079-e43cb630a1b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fde717a0ef87418eb6b6c3cd37fb9ebb'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:50:04.567691 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-34b8c28f-f0c4-47a8-b079-e43cb630a1b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fde717a0ef87418eb6b6c3cd37fb9ebb'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:50:04.586881 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1326/2656] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jul 11 14:50:04 2022] DELETE /identity/v3/users/fde717a0ef87418eb6b6c3cd37fb9ebb => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:50:04.591391 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f492bb2d-47c6-47cd-b363-5e6678140124 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:04.591902 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f492bb2d-47c6-47cd-b363-5e6678140124 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:04.592027 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f492bb2d-47c6-47cd-b363-5e6678140124 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:04.610245 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-f492bb2d-47c6-47cd-b363-5e6678140124 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:50:04.611466 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-f492bb2d-47c6-47cd-b363-5e6678140124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:50:04.676858 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1331/2657] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:50:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:50:04.686683 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b8c28f-f0c4-47a8-b079-e43cb630a1b6 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:50:04.688113 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-34b8c28f-f0c4-47a8-b079-e43cb630a1b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:50:04.746865 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b8c28f-f0c4-47a8-b079-e43cb630a1b6 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:50:04.750481 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201872ed-a450-4712-8ad4-8332cc9f3756 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20eede5ccd834862b00123310b5c3975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:50:04.751151 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201872ed-a450-4712-8ad4-8332cc9f3756 service neutron] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:04.751431 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201872ed-a450-4712-8ad4-8332cc9f3756 service neutron] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:04.751709 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201872ed-a450-4712-8ad4-8332cc9f3756 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:04.762022 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201872ed-a450-4712-8ad4-8332cc9f3756 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:50:04.763456 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201872ed-a450-4712-8ad4-8332cc9f3756 service neutron] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:50:04.773249 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1327/2658] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:50:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:50:05.080511 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f492bb2d-47c6-47cd-b363-5e6678140124 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:50:05.082118 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-f492bb2d-47c6-47cd-b363-5e6678140124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:50:05.102658 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f492bb2d-47c6-47cd-b363-5e6678140124 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:50:05.107887 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abfe9f8-17d4-4eff-900c-5818fd819750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:50:05.108815 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abfe9f8-17d4-4eff-900c-5818fd819750 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:05.109229 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abfe9f8-17d4-4eff-900c-5818fd819750 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:05.109514 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abfe9f8-17d4-4eff-900c-5818fd819750 admin admin] PATH_INFO: `/v3/projects/1c375aa0777643638971141233568d9a` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:05.110739 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abfe9f8-17d4-4eff-900c-5818fd819750 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c375aa0777643638971141233568d9a)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:50:05.113541 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abfe9f8-17d4-4eff-900c-5818fd819750 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:50:05.161325 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-6abfe9f8-17d4-4eff-900c-5818fd819750 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c375aa0777643638971141233568d9a', 'request_id': 'req-6abfe9f8-17d4-4eff-900c-5818fd819750'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:50:05.167711 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-6abfe9f8-17d4-4eff-900c-5818fd819750 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c375aa0777643638971141233568d9a', 'request_id': 'req-6abfe9f8-17d4-4eff-900c-5818fd819750'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:50:05.173955 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-6abfe9f8-17d4-4eff-900c-5818fd819750 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c375aa0777643638971141233568d9a', 'request_id': 'req-6abfe9f8-17d4-4eff-900c-5818fd819750'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:50:05.187389 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-6abfe9f8-17d4-4eff-900c-5818fd819750 admin admin] The token cache is being invalidate because project 1c375aa0777643638971141233568d9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:50:05.187680 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-6abfe9f8-17d4-4eff-900c-5818fd819750 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:50:05.188340 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-6abfe9f8-17d4-4eff-900c-5818fd819750 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:50:05.189943 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1332/2659] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jul 11 14:50:05 2022] DELETE /identity/v3/projects/1c375aa0777643638971141233568d9a => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:50:05.194537 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201872ed-a450-4712-8ad4-8332cc9f3756 service neutron] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:50:05.204294 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201872ed-a450-4712-8ad4-8332cc9f3756 service neutron] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:50:05.266927 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9eb441a-85ef-41b1-9748-27a591441c3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:50:05.267807 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eb441a-85ef-41b1-9748-27a591441c3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:05.268112 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eb441a-85ef-41b1-9748-27a591441c3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:05.268417 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eb441a-85ef-41b1-9748-27a591441c3d admin admin] PATH_INFO: `/v3/users/721a1e5f62a14be6b29532abea5bcc02` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:05.269627 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9eb441a-85ef-41b1-9748-27a591441c3d admin admin] RBAC: Authorizing `identity:delete_user(user_id=721a1e5f62a14be6b29532abea5bcc02)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:50:05.271548 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9eb441a-85ef-41b1-9748-27a591441c3d admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:50:05.281880 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:50:05.327460 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-c9eb441a-85ef-41b1-9748-27a591441c3d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '721a1e5f62a14be6b29532abea5bcc02'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:50:05.334859 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-c9eb441a-85ef-41b1-9748-27a591441c3d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '721a1e5f62a14be6b29532abea5bcc02'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:50:05.342442 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-c9eb441a-85ef-41b1-9748-27a591441c3d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '721a1e5f62a14be6b29532abea5bcc02'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:50:05.343097 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-c9eb441a-85ef-41b1-9748-27a591441c3d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '721a1e5f62a14be6b29532abea5bcc02'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:50:05.343804 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-c9eb441a-85ef-41b1-9748-27a591441c3d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '721a1e5f62a14be6b29532abea5bcc02'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:50:05.361947 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1328/2660] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jul 11 14:50:05 2022] DELETE /identity/v3/users/721a1e5f62a14be6b29532abea5bcc02 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:50:05.636588 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abfe9f8-17d4-4eff-900c-5818fd819750 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:50:05.638090 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-6abfe9f8-17d4-4eff-900c-5818fd819750 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:50:05.655242 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abfe9f8-17d4-4eff-900c-5818fd819750 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:50:05.686798 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:50:05.718121 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15aa3647-62d3-464c-863c-5138bf6db5b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:50:05.719315 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aa3647-62d3-464c-863c-5138bf6db5b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:05.719469 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aa3647-62d3-464c-863c-5138bf6db5b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:05.719742 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aa3647-62d3-464c-863c-5138bf6db5b0 admin admin] PATH_INFO: `/v3/projects/bbb9823252104fd6bb39c51d16a049db` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:05.721098 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15aa3647-62d3-464c-863c-5138bf6db5b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bbb9823252104fd6bb39c51d16a049db)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:50:05.723493 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15aa3647-62d3-464c-863c-5138bf6db5b0 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:50:05.775311 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-15aa3647-62d3-464c-863c-5138bf6db5b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bbb9823252104fd6bb39c51d16a049db', 'request_id': 'req-15aa3647-62d3-464c-863c-5138bf6db5b0'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:50:05.780912 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-15aa3647-62d3-464c-863c-5138bf6db5b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bbb9823252104fd6bb39c51d16a049db', 'request_id': 'req-15aa3647-62d3-464c-863c-5138bf6db5b0'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:50:05.787486 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-15aa3647-62d3-464c-863c-5138bf6db5b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bbb9823252104fd6bb39c51d16a049db', 'request_id': 'req-15aa3647-62d3-464c-863c-5138bf6db5b0'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:50:05.802223 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-15aa3647-62d3-464c-863c-5138bf6db5b0 admin admin] The token cache is being invalidate because project bbb9823252104fd6bb39c51d16a049db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:50:05.802593 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-15aa3647-62d3-464c-863c-5138bf6db5b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:50:05.803128 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-15aa3647-62d3-464c-863c-5138bf6db5b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:50:05.804711 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1333/2661] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jul 11 14:50:05 2022] DELETE /identity/v3/projects/bbb9823252104fd6bb39c51d16a049db => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:50:05.809814 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c7376a-e9ac-40fa-a40d-00519289eee2 None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:05.810275 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c7376a-e9ac-40fa-a40d-00519289eee2 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:05.810396 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c7376a-e9ac-40fa-a40d-00519289eee2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:05.829768 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-42c7376a-e9ac-40fa-a40d-00519289eee2 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:50:05.831173 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-42c7376a-e9ac-40fa-a40d-00519289eee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:50:05.893045 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1329/2662] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:50:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:50:05.901268 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e204b9f8-ade0-41d7-aecd-afe38cfbadff None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:05.901560 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e204b9f8-ade0-41d7-aecd-afe38cfbadff None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:05.901876 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e204b9f8-ade0-41d7-aecd-afe38cfbadff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:05.922836 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-e204b9f8-ade0-41d7-aecd-afe38cfbadff None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:50:05.924137 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-e204b9f8-ade0-41d7-aecd-afe38cfbadff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:50:05.933434 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1334/2663] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:50:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:50:05.937733 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c7376a-e9ac-40fa-a40d-00519289eee2 None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:50:05.948107 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c7376a-e9ac-40fa-a40d-00519289eee2 None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:50:05.952716 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1012f2d7-c31a-4bca-986a-8b198930e944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:50:05.953370 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1012f2d7-c31a-4bca-986a-8b198930e944 admin admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:05.953647 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1012f2d7-c31a-4bca-986a-8b198930e944 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:05.953925 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1012f2d7-c31a-4bca-986a-8b198930e944 admin admin] PATH_INFO: `/v3/domains` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:05.954651 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1012f2d7-c31a-4bca-986a-8b198930e944 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:50:05.954957 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1012f2d7-c31a-4bca-986a-8b198930e944 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:50:05.957117 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1012f2d7-c31a-4bca-986a-8b198930e944 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:50:05.968798 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1330/2664] 10.222.0.70 () {58 vars in 1152 bytes} [Mon Jul 11 14:50:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:50:05.973805 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e204b9f8-ade0-41d7-aecd-afe38cfbadff None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:50:05.984819 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e204b9f8-ade0-41d7-aecd-afe38cfbadff None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:50:05.990726 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb79c39-229c-4099-973d-9ea803e7bd5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:50:05.991449 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb79c39-229c-4099-973d-9ea803e7bd5f admin admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:05.991740 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb79c39-229c-4099-973d-9ea803e7bd5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:05.992040 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb79c39-229c-4099-973d-9ea803e7bd5f admin admin] PATH_INFO: `/v3/projects` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:05.992781 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb79c39-229c-4099-973d-9ea803e7bd5f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:50:05.994687 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb79c39-229c-4099-973d-9ea803e7bd5f admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:50:06.021463 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1335/2665] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jul 11 14:50:05 2022] POST /identity/v3/projects => generated 363 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:50:06.025657 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1012f2d7-c31a-4bca-986a-8b198930e944 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:50:06.037104 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1012f2d7-c31a-4bca-986a-8b198930e944 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:50:06.100598 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5eaadb-7c61-496d-a4fe-19c54406ddf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:50:06.101168 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5eaadb-7c61-496d-a4fe-19c54406ddf4 admin admin] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:06.101450 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5eaadb-7c61-496d-a4fe-19c54406ddf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:06.101721 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5eaadb-7c61-496d-a4fe-19c54406ddf4 admin admin] PATH_INFO: `/v3/users` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:06.102417 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5eaadb-7c61-496d-a4fe-19c54406ddf4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:50:06.104333 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5eaadb-7c61-496d-a4fe-19c54406ddf4 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:50:06.125553 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1331/2666] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jul 11 14:50:06 2022] POST /identity/v3/users => generated 282 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:50:06.129790 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb79c39-229c-4099-973d-9ea803e7bd5f admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:50:06.140254 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb79c39-229c-4099-973d-9ea803e7bd5f admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:50:06.145101 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e0598c-1469-4422-94a6-c0fc6828941c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:50:06.145771 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e0598c-1469-4422-94a6-c0fc6828941c admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:06.146062 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e0598c-1469-4422-94a6-c0fc6828941c admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:06.146340 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e0598c-1469-4422-94a6-c0fc6828941c admin admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:06.147071 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e0598c-1469-4422-94a6-c0fc6828941c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:50:06.148718 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e0598c-1469-4422-94a6-c0fc6828941c admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:50:06.160092 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1336/2667] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:50:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:50:06.163853 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5eaadb-7c61-496d-a4fe-19c54406ddf4 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:50:06.170279 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:50:06.174070 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5eaadb-7c61-496d-a4fe-19c54406ddf4 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:50:06.180801 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0350ae-efca-48b0-b1d3-2249c63e4e64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:50:06.181558 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0350ae-efca-48b0-b1d3-2249c63e4e64 admin admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:06.182013 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0350ae-efca-48b0-b1d3-2249c63e4e64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:06.182454 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0350ae-efca-48b0-b1d3-2249c63e4e64 admin admin] PATH_INFO: `/v3/roles` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:06.183680 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0350ae-efca-48b0-b1d3-2249c63e4e64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:50:06.185331 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0350ae-efca-48b0-b1d3-2249c63e4e64 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:50:06.195906 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1332/2668] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:50:06 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:50:06.200053 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e0598c-1469-4422-94a6-c0fc6828941c admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:50:06.210925 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e0598c-1469-4422-94a6-c0fc6828941c admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:50:06.215945 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e7f9da-0e92-4ea8-aa19-481becb3575d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:50:06.216866 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e7f9da-0e92-4ea8-aa19-481becb3575d admin admin] REQUEST_METHOD: `PUT` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:06.217147 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e7f9da-0e92-4ea8-aa19-481becb3575d admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:06.217419 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e7f9da-0e92-4ea8-aa19-481becb3575d admin admin] PATH_INFO: `/v3/projects/702478c6e10540bca0836ab0a4bab398/users/722c80ed78474f9498919a701bd64ae2/roles/8eff41f243c843ed95505a488ca6eada` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:06.233236 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e7f9da-0e92-4ea8-aa19-481becb3575d admin admin] RBAC: Authorizing `identity:create_grant(project_id=702478c6e10540bca0836ab0a4bab398, user_id=722c80ed78474f9498919a701bd64ae2, role_id=8eff41f243c843ed95505a488ca6eada)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:50:06.235876 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e7f9da-0e92-4ea8-aa19-481becb3575d admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:50:06.248930 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1337/2669] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jul 11 14:50:06 2022] PUT /identity/v3/projects/702478c6e10540bca0836ab0a4bab398/users/722c80ed78474f9498919a701bd64ae2/roles/8eff41f243c843ed95505a488ca6eada => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:50:06.260593 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a4d223-b553-4864-93ce-e2303a587202 None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:06.260888 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a4d223-b553-4864-93ce-e2303a587202 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:06.261167 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a4d223-b553-4864-93ce-e2303a587202 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:06.289146 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-63a4d223-b553-4864-93ce-e2303a587202 None None] MFA Rules not processed for user `722c80ed78474f9498919a701bd64ae2`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:50:06.290365 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-63a4d223-b553-4864-93ce-e2303a587202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:50:06.366523 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1333/2670] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:50:06 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:50:06.373050 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e7f9da-0e92-4ea8-aa19-481becb3575d admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:50:06.432549 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:50:06.437135 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e7f9da-0e92-4ea8-aa19-481becb3575d admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:50:06.443755 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661f7738-b346-44bc-99eb-640c82fbbadd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:50:06.444660 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661f7738-b346-44bc-99eb-640c82fbbadd admin admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:06.445207 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661f7738-b346-44bc-99eb-640c82fbbadd admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:06.445640 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661f7738-b346-44bc-99eb-640c82fbbadd admin admin] PATH_INFO: `/v3/projects` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:06.446543 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661f7738-b346-44bc-99eb-640c82fbbadd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:50:06.448571 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661f7738-b346-44bc-99eb-640c82fbbadd admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:50:06.474797 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1338/2671] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jul 11 14:50:06 2022] POST /identity/v3/projects => generated 361 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:50:06.479044 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a4d223-b553-4864-93ce-e2303a587202 None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:50:06.490509 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a4d223-b553-4864-93ce-e2303a587202 None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:50:06.552492 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2b476d-6006-455a-916c-d8586c6728a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:50:06.553172 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2b476d-6006-455a-916c-d8586c6728a7 admin admin] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:06.553458 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2b476d-6006-455a-916c-d8586c6728a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:06.553729 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2b476d-6006-455a-916c-d8586c6728a7 admin admin] PATH_INFO: `/v3/users` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:06.554439 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2b476d-6006-455a-916c-d8586c6728a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:50:06.557280 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2b476d-6006-455a-916c-d8586c6728a7 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:50:06.583551 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1334/2672] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jul 11 14:50:06 2022] POST /identity/v3/users => generated 287 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:50:06.588090 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661f7738-b346-44bc-99eb-640c82fbbadd admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:50:06.598866 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661f7738-b346-44bc-99eb-640c82fbbadd admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:50:06.603723 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b00145-c6f5-44e6-a258-43082c099afb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:50:06.604443 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b00145-c6f5-44e6-a258-43082c099afb admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:06.604735 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b00145-c6f5-44e6-a258-43082c099afb admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:06.605038 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b00145-c6f5-44e6-a258-43082c099afb admin admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:06.605878 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b00145-c6f5-44e6-a258-43082c099afb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:50:06.607525 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b00145-c6f5-44e6-a258-43082c099afb admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:50:06.618777 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1339/2673] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:50:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 14:50:06.623775 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2b476d-6006-455a-916c-d8586c6728a7 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:50:06.635769 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2b476d-6006-455a-916c-d8586c6728a7 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:50:06.640391 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50eba5eb-86ff-4cc8-84a8-b0561a6c9012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:50:06.641258 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eba5eb-86ff-4cc8-84a8-b0561a6c9012 admin admin] REQUEST_METHOD: `PUT` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:06.641539 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eba5eb-86ff-4cc8-84a8-b0561a6c9012 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:06.641812 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eba5eb-86ff-4cc8-84a8-b0561a6c9012 admin admin] PATH_INFO: `/v3/projects/7c6354f52a624a838990b0eb5149840f/users/9b9aa850a1294770b3f0323e7532bb33/roles/b46df176b0fe479da63c318db225bed4` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:06.656953 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50eba5eb-86ff-4cc8-84a8-b0561a6c9012 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c6354f52a624a838990b0eb5149840f, user_id=9b9aa850a1294770b3f0323e7532bb33, role_id=b46df176b0fe479da63c318db225bed4)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:50:06.660003 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50eba5eb-86ff-4cc8-84a8-b0561a6c9012 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:50:06.673472 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1335/2674] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jul 11 14:50:06 2022] PUT /identity/v3/projects/7c6354f52a624a838990b0eb5149840f/users/9b9aa850a1294770b3f0323e7532bb33/roles/b46df176b0fe479da63c318db225bed4 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:50:06.678588 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b00145-c6f5-44e6-a258-43082c099afb admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:50:06.690687 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b00145-c6f5-44e6-a258-43082c099afb admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:50:06.747167 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e62873-2b8e-4409-8d27-0fdafef194a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:50:06.747837 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e62873-2b8e-4409-8d27-0fdafef194a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:06.748114 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e62873-2b8e-4409-8d27-0fdafef194a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:06.748415 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e62873-2b8e-4409-8d27-0fdafef194a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:06.749140 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e62873-2b8e-4409-8d27-0fdafef194a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:50:06.750717 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e62873-2b8e-4409-8d27-0fdafef194a3 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:50:06.761140 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1340/2675] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:50:06 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:50:06.765590 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50eba5eb-86ff-4cc8-84a8-b0561a6c9012 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:50:06.776652 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50eba5eb-86ff-4cc8-84a8-b0561a6c9012 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:50:06.781261 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303fdec4-83e1-4aa8-b0bb-09e251ef1445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:50:06.782130 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303fdec4-83e1-4aa8-b0bb-09e251ef1445 admin admin] REQUEST_METHOD: `PUT` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:06.782410 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303fdec4-83e1-4aa8-b0bb-09e251ef1445 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:06.782683 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303fdec4-83e1-4aa8-b0bb-09e251ef1445 admin admin] PATH_INFO: `/v3/projects/7c6354f52a624a838990b0eb5149840f/users/9b9aa850a1294770b3f0323e7532bb33/roles/b46df176b0fe479da63c318db225bed4` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:06.784754 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303fdec4-83e1-4aa8-b0bb-09e251ef1445 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c6354f52a624a838990b0eb5149840f, user_id=9b9aa850a1294770b3f0323e7532bb33, role_id=b46df176b0fe479da63c318db225bed4)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:50:06.787458 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303fdec4-83e1-4aa8-b0bb-09e251ef1445 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:50:06.797673 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1336/2676] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jul 11 14:50:06 2022] PUT /identity/v3/projects/7c6354f52a624a838990b0eb5149840f/users/9b9aa850a1294770b3f0323e7532bb33/roles/b46df176b0fe479da63c318db225bed4 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:50:06.808523 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d54093-c153-4762-9ebc-0469b0c8bbea None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:06.808817 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d54093-c153-4762-9ebc-0469b0c8bbea None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:06.809092 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d54093-c153-4762-9ebc-0469b0c8bbea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:06.836020 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-67d54093-c153-4762-9ebc-0469b0c8bbea None None] MFA Rules not processed for user `9b9aa850a1294770b3f0323e7532bb33`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:50:06.837264 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-67d54093-c153-4762-9ebc-0469b0c8bbea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:50:06.904839 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1341/2677] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:50:06 2022] POST /identity/v3/auth/tokens => generated 3295 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:50:06.917524 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303fdec4-83e1-4aa8-b0bb-09e251ef1445 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:50:06.919263 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-303fdec4-83e1-4aa8-b0bb-09e251ef1445 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:50:06.968543 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:50:06.989941 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303fdec4-83e1-4aa8-b0bb-09e251ef1445 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:50:06.993763 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cc4f2d-ea8f-47aa-9717-4879dbf4c342 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '868e7c2dec264512b972c8736d659c34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:50:06.994466 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cc4f2d-ea8f-47aa-9717-4879dbf4c342 service cinder] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:06.994741 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cc4f2d-ea8f-47aa-9717-4879dbf4c342 service cinder] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:06.995016 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cc4f2d-ea8f-47aa-9717-4879dbf4c342 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:07.004745 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cc4f2d-ea8f-47aa-9717-4879dbf4c342 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:50:07.006170 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cc4f2d-ea8f-47aa-9717-4879dbf4c342 service cinder] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:50:07.015672 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1337/2678] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:50:06 2022] GET /identity/v3/auth/tokens => generated 3295 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:50:07.430105 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d54093-c153-4762-9ebc-0469b0c8bbea None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:50:07.481755 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:50:07.494722 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d54093-c153-4762-9ebc-0469b0c8bbea None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:50:07.499470 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb9eecd-304c-4e97-a17a-4768504ad34d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:50:07.500377 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb9eecd-304c-4e97-a17a-4768504ad34d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:07.500682 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb9eecd-304c-4e97-a17a-4768504ad34d admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:07.500952 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb9eecd-304c-4e97-a17a-4768504ad34d admin admin] PATH_INFO: `/v3/users/722c80ed78474f9498919a701bd64ae2` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:07.502131 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb9eecd-304c-4e97-a17a-4768504ad34d admin admin] RBAC: Authorizing `identity:delete_user(user_id=722c80ed78474f9498919a701bd64ae2)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:50:07.504276 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb9eecd-304c-4e97-a17a-4768504ad34d admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:50:07.551242 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-7cb9eecd-304c-4e97-a17a-4768504ad34d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '722c80ed78474f9498919a701bd64ae2'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:50:07.558569 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-7cb9eecd-304c-4e97-a17a-4768504ad34d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '722c80ed78474f9498919a701bd64ae2'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:50:07.566106 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-7cb9eecd-304c-4e97-a17a-4768504ad34d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '722c80ed78474f9498919a701bd64ae2'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:50:07.566712 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-7cb9eecd-304c-4e97-a17a-4768504ad34d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '722c80ed78474f9498919a701bd64ae2'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:50:07.567310 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-7cb9eecd-304c-4e97-a17a-4768504ad34d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '722c80ed78474f9498919a701bd64ae2'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:50:07.585263 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1342/2679] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jul 11 14:50:07 2022] DELETE /identity/v3/users/722c80ed78474f9498919a701bd64ae2 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:50:07.590063 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4c1626-4b17-4ca2-a28d-9315fd1bc272 None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:07.590458 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4c1626-4b17-4ca2-a28d-9315fd1bc272 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:07.590850 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4c1626-4b17-4ca2-a28d-9315fd1bc272 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:07.609267 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-8e4c1626-4b17-4ca2-a28d-9315fd1bc272 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:50:07.610472 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-8e4c1626-4b17-4ca2-a28d-9315fd1bc272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:50:07.671089 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1338/2680] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:50:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:50:07.681771 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb9eecd-304c-4e97-a17a-4768504ad34d admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:50:07.683476 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-7cb9eecd-304c-4e97-a17a-4768504ad34d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:50:07.740909 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb9eecd-304c-4e97-a17a-4768504ad34d admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:50:07.744641 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b74f97-6988-4720-9f0d-188c6d61d57f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20eede5ccd834862b00123310b5c3975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:50:07.745293 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b74f97-6988-4720-9f0d-188c6d61d57f service neutron] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:07.745575 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b74f97-6988-4720-9f0d-188c6d61d57f service neutron] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:07.745848 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b74f97-6988-4720-9f0d-188c6d61d57f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:07.757195 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b74f97-6988-4720-9f0d-188c6d61d57f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:50:07.758647 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b74f97-6988-4720-9f0d-188c6d61d57f service neutron] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:50:07.770196 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1343/2681] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:50:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:50:08.049334 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4c1626-4b17-4ca2-a28d-9315fd1bc272 None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:50:08.051112 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-8e4c1626-4b17-4ca2-a28d-9315fd1bc272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:50:08.066359 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4c1626-4b17-4ca2-a28d-9315fd1bc272 None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:50:08.071466 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5289d465-3b94-4cdc-bb5e-385b9e3df82a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:50:08.072541 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5289d465-3b94-4cdc-bb5e-385b9e3df82a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:08.072855 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5289d465-3b94-4cdc-bb5e-385b9e3df82a admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:08.073163 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5289d465-3b94-4cdc-bb5e-385b9e3df82a admin admin] PATH_INFO: `/v3/projects/702478c6e10540bca0836ab0a4bab398` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:08.074346 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5289d465-3b94-4cdc-bb5e-385b9e3df82a admin admin] RBAC: Authorizing `identity:delete_project(project_id=702478c6e10540bca0836ab0a4bab398)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:50:08.076305 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5289d465-3b94-4cdc-bb5e-385b9e3df82a admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:50:08.124189 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-5289d465-3b94-4cdc-bb5e-385b9e3df82a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '702478c6e10540bca0836ab0a4bab398', 'request_id': 'req-5289d465-3b94-4cdc-bb5e-385b9e3df82a'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:50:08.130895 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-5289d465-3b94-4cdc-bb5e-385b9e3df82a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '702478c6e10540bca0836ab0a4bab398', 'request_id': 'req-5289d465-3b94-4cdc-bb5e-385b9e3df82a'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:50:08.138219 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-5289d465-3b94-4cdc-bb5e-385b9e3df82a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '702478c6e10540bca0836ab0a4bab398', 'request_id': 'req-5289d465-3b94-4cdc-bb5e-385b9e3df82a'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:50:08.149500 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-5289d465-3b94-4cdc-bb5e-385b9e3df82a admin admin] The token cache is being invalidate because project 702478c6e10540bca0836ab0a4bab398 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80534) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:50:08.149795 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-5289d465-3b94-4cdc-bb5e-385b9e3df82a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:50:08.150469 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-5289d465-3b94-4cdc-bb5e-385b9e3df82a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:50:08.152033 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1339/2682] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jul 11 14:50:08 2022] DELETE /identity/v3/projects/702478c6e10540bca0836ab0a4bab398 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:50:08.156126 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b74f97-6988-4720-9f0d-188c6d61d57f service neutron] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:50:08.166237 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b74f97-6988-4720-9f0d-188c6d61d57f service neutron] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:50:08.223088 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfa9536-be6f-40c1-8f35-0cc82b52c4d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:50:08.223870 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfa9536-be6f-40c1-8f35-0cc82b52c4d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:08.224151 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfa9536-be6f-40c1-8f35-0cc82b52c4d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:08.224455 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfa9536-be6f-40c1-8f35-0cc82b52c4d1 admin admin] PATH_INFO: `/v3/users/9b9aa850a1294770b3f0323e7532bb33` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:08.225626 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfa9536-be6f-40c1-8f35-0cc82b52c4d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b9aa850a1294770b3f0323e7532bb33)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:50:08.227550 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfa9536-be6f-40c1-8f35-0cc82b52c4d1 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:50:08.243441 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:50:08.274667 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-4bfa9536-be6f-40c1-8f35-0cc82b52c4d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b9aa850a1294770b3f0323e7532bb33'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:50:08.281633 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-4bfa9536-be6f-40c1-8f35-0cc82b52c4d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b9aa850a1294770b3f0323e7532bb33'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:50:08.289486 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-4bfa9536-be6f-40c1-8f35-0cc82b52c4d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b9aa850a1294770b3f0323e7532bb33'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:50:08.290109 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-4bfa9536-be6f-40c1-8f35-0cc82b52c4d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b9aa850a1294770b3f0323e7532bb33'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:50:08.290730 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-4bfa9536-be6f-40c1-8f35-0cc82b52c4d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b9aa850a1294770b3f0323e7532bb33'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:50:08.308824 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1344/2683] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jul 11 14:50:08 2022] DELETE /identity/v3/users/9b9aa850a1294770b3f0323e7532bb33 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:50:08.587040 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5289d465-3b94-4cdc-bb5e-385b9e3df82a admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:50:08.588510 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-5289d465-3b94-4cdc-bb5e-385b9e3df82a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:50:08.601793 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5289d465-3b94-4cdc-bb5e-385b9e3df82a admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:50:08.660845 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f006b7d3-2a94-48d1-bd54-946ca4b8c402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:50:08.661711 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f006b7d3-2a94-48d1-bd54-946ca4b8c402 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:08.661995 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f006b7d3-2a94-48d1-bd54-946ca4b8c402 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:08.662275 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f006b7d3-2a94-48d1-bd54-946ca4b8c402 admin admin] PATH_INFO: `/v3/projects/7c6354f52a624a838990b0eb5149840f` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:08.663472 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f006b7d3-2a94-48d1-bd54-946ca4b8c402 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c6354f52a624a838990b0eb5149840f)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:50:08.665487 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f006b7d3-2a94-48d1-bd54-946ca4b8c402 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:50:08.667760 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:50:08.716434 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-f006b7d3-2a94-48d1-bd54-946ca4b8c402 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c6354f52a624a838990b0eb5149840f', 'request_id': 'req-f006b7d3-2a94-48d1-bd54-946ca4b8c402'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:50:08.723056 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-f006b7d3-2a94-48d1-bd54-946ca4b8c402 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c6354f52a624a838990b0eb5149840f', 'request_id': 'req-f006b7d3-2a94-48d1-bd54-946ca4b8c402'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:50:08.729971 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-f006b7d3-2a94-48d1-bd54-946ca4b8c402 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c6354f52a624a838990b0eb5149840f', 'request_id': 'req-f006b7d3-2a94-48d1-bd54-946ca4b8c402'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:50:08.740921 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-f006b7d3-2a94-48d1-bd54-946ca4b8c402 admin admin] The token cache is being invalidate because project 7c6354f52a624a838990b0eb5149840f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80534) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:50:08.741202 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-f006b7d3-2a94-48d1-bd54-946ca4b8c402 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:50:08.741831 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-f006b7d3-2a94-48d1-bd54-946ca4b8c402 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:50:08.743374 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1340/2684] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jul 11 14:50:08 2022] DELETE /identity/v3/projects/7c6354f52a624a838990b0eb5149840f => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:50:08.748389 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfc3c2f-4569-4384-97bc-8d8fee9d2bcd None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:08.748917 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfc3c2f-4569-4384-97bc-8d8fee9d2bcd None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:08.749026 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfc3c2f-4569-4384-97bc-8d8fee9d2bcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:08.769704 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-fbfc3c2f-4569-4384-97bc-8d8fee9d2bcd None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:50:08.770892 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-fbfc3c2f-4569-4384-97bc-8d8fee9d2bcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:50:08.834160 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1345/2685] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:50:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:50:08.841680 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f4e7f7-8845-43e6-aec8-ac81d9f60645 None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:08.841976 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f4e7f7-8845-43e6-aec8-ac81d9f60645 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:08.842262 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f4e7f7-8845-43e6-aec8-ac81d9f60645 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:08.863591 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-09f4e7f7-8845-43e6-aec8-ac81d9f60645 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:50:08.864409 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-09f4e7f7-8845-43e6-aec8-ac81d9f60645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:50:08.872247 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1341/2686] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:50:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:50:08.876484 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfc3c2f-4569-4384-97bc-8d8fee9d2bcd None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:50:08.886298 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfc3c2f-4569-4384-97bc-8d8fee9d2bcd None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:50:08.890886 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18aa7040-b83c-454a-9d60-3b14f96731aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:50:08.891538 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aa7040-b83c-454a-9d60-3b14f96731aa admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:08.891824 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aa7040-b83c-454a-9d60-3b14f96731aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:08.892095 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aa7040-b83c-454a-9d60-3b14f96731aa admin admin] PATH_INFO: `/v3/domains` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:08.892856 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18aa7040-b83c-454a-9d60-3b14f96731aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:50:08.893238 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18aa7040-b83c-454a-9d60-3b14f96731aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:50:08.894781 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18aa7040-b83c-454a-9d60-3b14f96731aa admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:50:08.906293 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1346/2687] 10.222.0.70 () {58 vars in 1152 bytes} [Mon Jul 11 14:50:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:50:08.911925 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f4e7f7-8845-43e6-aec8-ac81d9f60645 None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:50:08.921291 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f4e7f7-8845-43e6-aec8-ac81d9f60645 None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:50:08.927029 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a7256e-276a-4c61-8899-21ed1b515198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:50:08.927675 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a7256e-276a-4c61-8899-21ed1b515198 admin admin] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:08.927956 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a7256e-276a-4c61-8899-21ed1b515198 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:08.928255 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a7256e-276a-4c61-8899-21ed1b515198 admin admin] PATH_INFO: `/v3/projects` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:08.929060 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a7256e-276a-4c61-8899-21ed1b515198 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:50:08.930962 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a7256e-276a-4c61-8899-21ed1b515198 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:50:08.957690 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1342/2688] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jul 11 14:50:08 2022] POST /identity/v3/projects => generated 363 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:50:08.961955 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18aa7040-b83c-454a-9d60-3b14f96731aa admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:50:08.972650 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18aa7040-b83c-454a-9d60-3b14f96731aa admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:50:09.032383 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8162a2e-a288-4f83-aaef-6a92df665e19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:50:09.032959 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8162a2e-a288-4f83-aaef-6a92df665e19 admin admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:09.033245 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8162a2e-a288-4f83-aaef-6a92df665e19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:09.033529 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8162a2e-a288-4f83-aaef-6a92df665e19 admin admin] PATH_INFO: `/v3/users` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:09.034243 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8162a2e-a288-4f83-aaef-6a92df665e19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:50:09.036164 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8162a2e-a288-4f83-aaef-6a92df665e19 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:50:09.055687 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1347/2689] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jul 11 14:50:08 2022] POST /identity/v3/users => generated 282 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:50:09.060051 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a7256e-276a-4c61-8899-21ed1b515198 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:50:09.071302 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a7256e-276a-4c61-8899-21ed1b515198 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:50:09.075914 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03671513-c45d-4d42-b086-4ab91dc2b1d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:50:09.076712 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03671513-c45d-4d42-b086-4ab91dc2b1d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:09.076998 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03671513-c45d-4d42-b086-4ab91dc2b1d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:09.077273 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03671513-c45d-4d42-b086-4ab91dc2b1d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:09.078027 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03671513-c45d-4d42-b086-4ab91dc2b1d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:50:09.079610 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03671513-c45d-4d42-b086-4ab91dc2b1d1 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:50:09.091176 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1343/2690] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:50:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:50:09.095131 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8162a2e-a288-4f83-aaef-6a92df665e19 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:50:09.105208 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8162a2e-a288-4f83-aaef-6a92df665e19 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:50:09.109885 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8a1cea-ea5e-43a8-b794-ab958b3bed9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:50:09.110550 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8a1cea-ea5e-43a8-b794-ab958b3bed9a admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:09.110841 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8a1cea-ea5e-43a8-b794-ab958b3bed9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:09.111123 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8a1cea-ea5e-43a8-b794-ab958b3bed9a admin admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:09.111940 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8a1cea-ea5e-43a8-b794-ab958b3bed9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:50:09.113793 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8a1cea-ea5e-43a8-b794-ab958b3bed9a admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:50:09.119123 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:50:09.125561 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1348/2691] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:50:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:50:09.130436 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03671513-c45d-4d42-b086-4ab91dc2b1d1 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:50:09.140700 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03671513-c45d-4d42-b086-4ab91dc2b1d1 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:50:09.146176 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcb373d-d45c-4191-88c7-6a55057b18d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:50:09.147101 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcb373d-d45c-4191-88c7-6a55057b18d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:09.147404 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcb373d-d45c-4191-88c7-6a55057b18d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:09.147701 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcb373d-d45c-4191-88c7-6a55057b18d3 admin admin] PATH_INFO: `/v3/projects/5afee12b532140ab8b4f2688937319ae/users/d4ec56da5f114ecfac6ad96b20f99caf/roles/8eff41f243c843ed95505a488ca6eada` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:09.162773 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcb373d-d45c-4191-88c7-6a55057b18d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5afee12b532140ab8b4f2688937319ae, user_id=d4ec56da5f114ecfac6ad96b20f99caf, role_id=8eff41f243c843ed95505a488ca6eada)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:50:09.165491 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcb373d-d45c-4191-88c7-6a55057b18d3 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:50:09.179090 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1344/2692] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jul 11 14:50:09 2022] PUT /identity/v3/projects/5afee12b532140ab8b4f2688937319ae/users/d4ec56da5f114ecfac6ad96b20f99caf/roles/8eff41f243c843ed95505a488ca6eada => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:50:09.191349 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d11525-2a3c-4ef2-bc06-796ea83b8936 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:09.191636 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d11525-2a3c-4ef2-bc06-796ea83b8936 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:09.191939 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d11525-2a3c-4ef2-bc06-796ea83b8936 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:09.218383 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-c0d11525-2a3c-4ef2-bc06-796ea83b8936 None None] MFA Rules not processed for user `d4ec56da5f114ecfac6ad96b20f99caf`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:50:09.219614 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-c0d11525-2a3c-4ef2-bc06-796ea83b8936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:50:09.292156 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1349/2693] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:50:09 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:50:09.296663 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcb373d-d45c-4191-88c7-6a55057b18d3 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:50:09.359551 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcb373d-d45c-4191-88c7-6a55057b18d3 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:50:09.365034 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dabde95-042f-43f9-a3fc-9598bb50c7a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:50:09.365699 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dabde95-042f-43f9-a3fc-9598bb50c7a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:09.365983 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dabde95-042f-43f9-a3fc-9598bb50c7a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:09.366261 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dabde95-042f-43f9-a3fc-9598bb50c7a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:09.366958 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dabde95-042f-43f9-a3fc-9598bb50c7a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:50:09.368984 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dabde95-042f-43f9-a3fc-9598bb50c7a4 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:50:09.396131 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1345/2694] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jul 11 14:50:09 2022] POST /identity/v3/projects => generated 365 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:50:09.400368 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d11525-2a3c-4ef2-bc06-796ea83b8936 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:50:09.411093 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d11525-2a3c-4ef2-bc06-796ea83b8936 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:50:09.468515 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec793f7-4fb2-469f-9268-d90666ab32bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:50:09.469277 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec793f7-4fb2-469f-9268-d90666ab32bf admin admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:09.469561 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec793f7-4fb2-469f-9268-d90666ab32bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:09.469836 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec793f7-4fb2-469f-9268-d90666ab32bf admin admin] PATH_INFO: `/v3/users` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:09.470535 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec793f7-4fb2-469f-9268-d90666ab32bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:50:09.472635 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec793f7-4fb2-469f-9268-d90666ab32bf admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:50:09.493049 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1350/2695] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jul 11 14:50:09 2022] POST /identity/v3/users => generated 289 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:50:09.497198 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dabde95-042f-43f9-a3fc-9598bb50c7a4 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:50:09.508491 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dabde95-042f-43f9-a3fc-9598bb50c7a4 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:50:09.513165 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6621b343-9490-4f37-9d72-43cde2efce44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:50:09.513870 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6621b343-9490-4f37-9d72-43cde2efce44 admin admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:09.514156 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6621b343-9490-4f37-9d72-43cde2efce44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:09.514436 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6621b343-9490-4f37-9d72-43cde2efce44 admin admin] PATH_INFO: `/v3/roles` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:09.515179 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6621b343-9490-4f37-9d72-43cde2efce44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:50:09.516899 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6621b343-9490-4f37-9d72-43cde2efce44 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:50:09.532425 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1346/2696] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:50:09 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:50:09.537510 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec793f7-4fb2-469f-9268-d90666ab32bf admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:50:09.547763 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec793f7-4fb2-469f-9268-d90666ab32bf admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:50:09.553230 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef921e6-333a-4b84-9e0d-2ccfe8fb3812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:50:09.554124 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef921e6-333a-4b84-9e0d-2ccfe8fb3812 admin admin] REQUEST_METHOD: `PUT` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:09.554410 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef921e6-333a-4b84-9e0d-2ccfe8fb3812 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:09.554688 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef921e6-333a-4b84-9e0d-2ccfe8fb3812 admin admin] PATH_INFO: `/v3/projects/8733e40b327140308661997bd947a181/users/e90fa4459f7d439293694d4f54b9d651/roles/b46df176b0fe479da63c318db225bed4` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:09.571950 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef921e6-333a-4b84-9e0d-2ccfe8fb3812 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8733e40b327140308661997bd947a181, user_id=e90fa4459f7d439293694d4f54b9d651, role_id=b46df176b0fe479da63c318db225bed4)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:50:09.574739 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef921e6-333a-4b84-9e0d-2ccfe8fb3812 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:50:09.588472 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1351/2697] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jul 11 14:50:09 2022] PUT /identity/v3/projects/8733e40b327140308661997bd947a181/users/e90fa4459f7d439293694d4f54b9d651/roles/b46df176b0fe479da63c318db225bed4 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:50:09.592609 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6621b343-9490-4f37-9d72-43cde2efce44 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:50:09.598563 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:50:09.605411 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6621b343-9490-4f37-9d72-43cde2efce44 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:50:09.665267 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9faa950-67cb-4bd5-918e-1cd7f347f14e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:50:09.665936 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9faa950-67cb-4bd5-918e-1cd7f347f14e admin admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:09.666249 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9faa950-67cb-4bd5-918e-1cd7f347f14e admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:09.666526 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9faa950-67cb-4bd5-918e-1cd7f347f14e admin admin] PATH_INFO: `/v3/roles` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:09.667258 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9faa950-67cb-4bd5-918e-1cd7f347f14e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:50:09.668932 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9faa950-67cb-4bd5-918e-1cd7f347f14e admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:50:09.680102 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1347/2698] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:50:09 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:50:09.684538 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef921e6-333a-4b84-9e0d-2ccfe8fb3812 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:50:09.695658 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef921e6-333a-4b84-9e0d-2ccfe8fb3812 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:50:09.700440 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e338a60f-158d-4b03-afab-3142cf8f9286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:50:09.701331 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e338a60f-158d-4b03-afab-3142cf8f9286 admin admin] REQUEST_METHOD: `PUT` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:09.701647 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e338a60f-158d-4b03-afab-3142cf8f9286 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:09.701924 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e338a60f-158d-4b03-afab-3142cf8f9286 admin admin] PATH_INFO: `/v3/projects/8733e40b327140308661997bd947a181/users/e90fa4459f7d439293694d4f54b9d651/roles/b46df176b0fe479da63c318db225bed4` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:09.703928 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e338a60f-158d-4b03-afab-3142cf8f9286 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8733e40b327140308661997bd947a181, user_id=e90fa4459f7d439293694d4f54b9d651, role_id=b46df176b0fe479da63c318db225bed4)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:50:09.706905 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e338a60f-158d-4b03-afab-3142cf8f9286 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:50:09.717617 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1352/2699] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jul 11 14:50:09 2022] PUT /identity/v3/projects/8733e40b327140308661997bd947a181/users/e90fa4459f7d439293694d4f54b9d651/roles/b46df176b0fe479da63c318db225bed4 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:50:09.729107 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a333057b-db68-4ac8-a1a0-2d30453103d6 None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:09.729410 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a333057b-db68-4ac8-a1a0-2d30453103d6 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:09.729693 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a333057b-db68-4ac8-a1a0-2d30453103d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:09.759779 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-a333057b-db68-4ac8-a1a0-2d30453103d6 None None] MFA Rules not processed for user `e90fa4459f7d439293694d4f54b9d651`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:50:09.761031 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-a333057b-db68-4ac8-a1a0-2d30453103d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:50:09.833413 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1348/2700] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:50:09 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:50:09.844967 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e338a60f-158d-4b03-afab-3142cf8f9286 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:50:09.847302 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-e338a60f-158d-4b03-afab-3142cf8f9286 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:50:09.893802 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:50:09.905939 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e338a60f-158d-4b03-afab-3142cf8f9286 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:50:09.910552 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725c5cbe-62b3-47e0-b584-c023ee16e384 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '868e7c2dec264512b972c8736d659c34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:50:09.911127 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725c5cbe-62b3-47e0-b584-c023ee16e384 service cinder] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:09.911409 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725c5cbe-62b3-47e0-b584-c023ee16e384 service cinder] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:09.911680 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725c5cbe-62b3-47e0-b584-c023ee16e384 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:09.920708 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725c5cbe-62b3-47e0-b584-c023ee16e384 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:50:09.922127 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725c5cbe-62b3-47e0-b584-c023ee16e384 service cinder] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:50:09.932002 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1353/2701] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:50:09 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:50:10.005107 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a333057b-db68-4ac8-a1a0-2d30453103d6 None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:50:10.014910 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a333057b-db68-4ac8-a1a0-2d30453103d6 None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:50:10.019520 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd8401b-0b7a-47ca-b755-1cf2457f34f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '868e7c2dec264512b972c8736d659c34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:50:10.020165 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd8401b-0b7a-47ca-b755-1cf2457f34f8 service cinder] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:10.020485 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd8401b-0b7a-47ca-b755-1cf2457f34f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:10.020763 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd8401b-0b7a-47ca-b755-1cf2457f34f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:10.079412 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd8401b-0b7a-47ca-b755-1cf2457f34f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:50:10.081918 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd8401b-0b7a-47ca-b755-1cf2457f34f8 service cinder] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:50:10.091151 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1349/2702] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:50:10 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:50:17.118047 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725c5cbe-62b3-47e0-b584-c023ee16e384 service cinder] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:50:17.182999 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725c5cbe-62b3-47e0-b584-c023ee16e384 service cinder] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:50:17.188113 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058b4b1b-1fd7-44d0-9930-f3738608fc8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:50:17.189014 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058b4b1b-1fd7-44d0-9930-f3738608fc8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:17.189302 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058b4b1b-1fd7-44d0-9930-f3738608fc8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:17.189581 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058b4b1b-1fd7-44d0-9930-f3738608fc8a admin admin] PATH_INFO: `/v3/users/d4ec56da5f114ecfac6ad96b20f99caf` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:17.191478 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058b4b1b-1fd7-44d0-9930-f3738608fc8a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4ec56da5f114ecfac6ad96b20f99caf)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:50:17.193432 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058b4b1b-1fd7-44d0-9930-f3738608fc8a admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:50:17.242372 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-058b4b1b-1fd7-44d0-9930-f3738608fc8a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4ec56da5f114ecfac6ad96b20f99caf'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:50:17.249167 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-058b4b1b-1fd7-44d0-9930-f3738608fc8a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4ec56da5f114ecfac6ad96b20f99caf'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:50:17.257312 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-058b4b1b-1fd7-44d0-9930-f3738608fc8a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4ec56da5f114ecfac6ad96b20f99caf'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:50:17.257937 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-058b4b1b-1fd7-44d0-9930-f3738608fc8a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4ec56da5f114ecfac6ad96b20f99caf'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:50:17.259089 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-058b4b1b-1fd7-44d0-9930-f3738608fc8a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4ec56da5f114ecfac6ad96b20f99caf'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:50:17.277809 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1354/2703] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jul 11 14:50:17 2022] DELETE /identity/v3/users/d4ec56da5f114ecfac6ad96b20f99caf => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:50:17.282513 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0960e3b-1173-4047-beb2-989111f8bcf5 None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:17.283017 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0960e3b-1173-4047-beb2-989111f8bcf5 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:17.283118 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0960e3b-1173-4047-beb2-989111f8bcf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:17.301833 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-e0960e3b-1173-4047-beb2-989111f8bcf5 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:50:17.303057 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-e0960e3b-1173-4047-beb2-989111f8bcf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:50:17.321366 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:50:17.369434 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1350/2704] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:50:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:50:17.379942 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058b4b1b-1fd7-44d0-9930-f3738608fc8a admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:50:17.381374 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-058b4b1b-1fd7-44d0-9930-f3738608fc8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:50:17.439783 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058b4b1b-1fd7-44d0-9930-f3738608fc8a admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:50:17.444975 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6982e8b-bea5-48ce-b6df-8d6b6d81edc1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20eede5ccd834862b00123310b5c3975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:50:17.445623 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6982e8b-bea5-48ce-b6df-8d6b6d81edc1 service neutron] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:17.445902 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6982e8b-bea5-48ce-b6df-8d6b6d81edc1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:17.446176 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6982e8b-bea5-48ce-b6df-8d6b6d81edc1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:17.455282 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6982e8b-bea5-48ce-b6df-8d6b6d81edc1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:50:17.456913 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6982e8b-bea5-48ce-b6df-8d6b6d81edc1 service neutron] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:50:17.466484 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1355/2705] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:50:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:50:17.758421 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0960e3b-1173-4047-beb2-989111f8bcf5 None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:50:17.760530 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-e0960e3b-1173-4047-beb2-989111f8bcf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:50:17.778395 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0960e3b-1173-4047-beb2-989111f8bcf5 None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:50:17.783110 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f7c7d5-8f3b-421a-a89c-36b1aa50fe6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:50:17.783998 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f7c7d5-8f3b-421a-a89c-36b1aa50fe6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:17.784338 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f7c7d5-8f3b-421a-a89c-36b1aa50fe6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:17.784655 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f7c7d5-8f3b-421a-a89c-36b1aa50fe6f admin admin] PATH_INFO: `/v3/projects/5afee12b532140ab8b4f2688937319ae` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:17.785782 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f7c7d5-8f3b-421a-a89c-36b1aa50fe6f admin admin] RBAC: Authorizing `identity:delete_project(project_id=5afee12b532140ab8b4f2688937319ae)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:50:17.787932 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f7c7d5-8f3b-421a-a89c-36b1aa50fe6f admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:50:17.840625 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-c6f7c7d5-8f3b-421a-a89c-36b1aa50fe6f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5afee12b532140ab8b4f2688937319ae', 'request_id': 'req-c6f7c7d5-8f3b-421a-a89c-36b1aa50fe6f'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:50:17.847949 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-c6f7c7d5-8f3b-421a-a89c-36b1aa50fe6f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5afee12b532140ab8b4f2688937319ae', 'request_id': 'req-c6f7c7d5-8f3b-421a-a89c-36b1aa50fe6f'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:50:17.855477 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-c6f7c7d5-8f3b-421a-a89c-36b1aa50fe6f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5afee12b532140ab8b4f2688937319ae', 'request_id': 'req-c6f7c7d5-8f3b-421a-a89c-36b1aa50fe6f'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:50:17.867137 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-c6f7c7d5-8f3b-421a-a89c-36b1aa50fe6f admin admin] The token cache is being invalidate because project 5afee12b532140ab8b4f2688937319ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80534) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:50:17.867431 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-c6f7c7d5-8f3b-421a-a89c-36b1aa50fe6f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:50:17.868067 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-c6f7c7d5-8f3b-421a-a89c-36b1aa50fe6f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:50:17.869663 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1351/2706] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jul 11 14:50:17 2022] DELETE /identity/v3/projects/5afee12b532140ab8b4f2688937319ae => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:50:17.873735 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6982e8b-bea5-48ce-b6df-8d6b6d81edc1 service neutron] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:50:17.883799 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6982e8b-bea5-48ce-b6df-8d6b6d81edc1 service neutron] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:50:17.887916 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:50:17.946533 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad602a9-1d6d-43e9-87e4-bbe134f75a88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:50:17.947412 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad602a9-1d6d-43e9-87e4-bbe134f75a88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:17.947698 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad602a9-1d6d-43e9-87e4-bbe134f75a88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:17.947978 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad602a9-1d6d-43e9-87e4-bbe134f75a88 admin admin] PATH_INFO: `/v3/users/e90fa4459f7d439293694d4f54b9d651` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:17.949245 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad602a9-1d6d-43e9-87e4-bbe134f75a88 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e90fa4459f7d439293694d4f54b9d651)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:50:17.951206 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad602a9-1d6d-43e9-87e4-bbe134f75a88 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:50:18.000107 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-dad602a9-1d6d-43e9-87e4-bbe134f75a88 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e90fa4459f7d439293694d4f54b9d651'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:50:18.011560 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-dad602a9-1d6d-43e9-87e4-bbe134f75a88 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e90fa4459f7d439293694d4f54b9d651'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:50:18.020452 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-dad602a9-1d6d-43e9-87e4-bbe134f75a88 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e90fa4459f7d439293694d4f54b9d651'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:50:18.021155 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-dad602a9-1d6d-43e9-87e4-bbe134f75a88 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e90fa4459f7d439293694d4f54b9d651'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:50:18.021842 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-dad602a9-1d6d-43e9-87e4-bbe134f75a88 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e90fa4459f7d439293694d4f54b9d651'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:50:18.040914 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1356/2707] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jul 11 14:50:17 2022] DELETE /identity/v3/users/e90fa4459f7d439293694d4f54b9d651 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:50:18.329005 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f7c7d5-8f3b-421a-a89c-36b1aa50fe6f admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:50:18.331693 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-c6f7c7d5-8f3b-421a-a89c-36b1aa50fe6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:50:18.347676 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f7c7d5-8f3b-421a-a89c-36b1aa50fe6f admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:50:18.406596 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5504f2e-afea-4922-98dc-f0c67c6684ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:50:18.407451 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5504f2e-afea-4922-98dc-f0c67c6684ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:18.407728 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5504f2e-afea-4922-98dc-f0c67c6684ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:18.408000 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5504f2e-afea-4922-98dc-f0c67c6684ba admin admin] PATH_INFO: `/v3/projects/8733e40b327140308661997bd947a181` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:18.409873 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5504f2e-afea-4922-98dc-f0c67c6684ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=8733e40b327140308661997bd947a181)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:50:18.411895 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5504f2e-afea-4922-98dc-f0c67c6684ba admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:50:18.458078 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:50:18.459523 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-c5504f2e-afea-4922-98dc-f0c67c6684ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8733e40b327140308661997bd947a181', 'request_id': 'req-c5504f2e-afea-4922-98dc-f0c67c6684ba'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:50:18.468231 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-c5504f2e-afea-4922-98dc-f0c67c6684ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8733e40b327140308661997bd947a181', 'request_id': 'req-c5504f2e-afea-4922-98dc-f0c67c6684ba'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:50:18.478807 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-c5504f2e-afea-4922-98dc-f0c67c6684ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8733e40b327140308661997bd947a181', 'request_id': 'req-c5504f2e-afea-4922-98dc-f0c67c6684ba'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:50:18.490222 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-c5504f2e-afea-4922-98dc-f0c67c6684ba admin admin] The token cache is being invalidate because project 8733e40b327140308661997bd947a181 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80534) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:50:18.490513 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-c5504f2e-afea-4922-98dc-f0c67c6684ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:50:18.491150 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-c5504f2e-afea-4922-98dc-f0c67c6684ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:50:18.492743 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1352/2708] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jul 11 14:50:18 2022] DELETE /identity/v3/projects/8733e40b327140308661997bd947a181 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:50:18.497698 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e3d0c8-8a65-463e-bd90-47979a54bac6 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:18.498173 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e3d0c8-8a65-463e-bd90-47979a54bac6 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:18.498414 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e3d0c8-8a65-463e-bd90-47979a54bac6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:18.517763 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-09e3d0c8-8a65-463e-bd90-47979a54bac6 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:50:18.519487 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-09e3d0c8-8a65-463e-bd90-47979a54bac6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:50:18.580389 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1357/2709] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:50:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:50:18.590275 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcced1fd-da9a-4e32-960a-6340a64c3c90 None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:18.590565 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcced1fd-da9a-4e32-960a-6340a64c3c90 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:18.590842 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcced1fd-da9a-4e32-960a-6340a64c3c90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:18.609257 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-dcced1fd-da9a-4e32-960a-6340a64c3c90 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:50:18.610445 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-dcced1fd-da9a-4e32-960a-6340a64c3c90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:50:18.618680 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1353/2710] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:50:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:50:18.622890 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e3d0c8-8a65-463e-bd90-47979a54bac6 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:50:18.633486 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e3d0c8-8a65-463e-bd90-47979a54bac6 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:50:18.638167 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3905e8-ae72-4f0c-9056-9571a2d7d881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:50:18.638826 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3905e8-ae72-4f0c-9056-9571a2d7d881 admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:18.639126 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3905e8-ae72-4f0c-9056-9571a2d7d881 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:18.639384 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3905e8-ae72-4f0c-9056-9571a2d7d881 admin admin] PATH_INFO: `/v3/domains` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:18.640108 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3905e8-ae72-4f0c-9056-9571a2d7d881 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:50:18.640459 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3905e8-ae72-4f0c-9056-9571a2d7d881 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:50:18.642047 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3905e8-ae72-4f0c-9056-9571a2d7d881 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:50:18.654292 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1358/2711] 10.222.0.70 () {58 vars in 1152 bytes} [Mon Jul 11 14:50:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:50:18.658898 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcced1fd-da9a-4e32-960a-6340a64c3c90 None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:50:18.668194 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcced1fd-da9a-4e32-960a-6340a64c3c90 None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:50:18.673246 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea8ea19-bfff-423b-acc6-640f61eb5ffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:50:18.673907 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea8ea19-bfff-423b-acc6-640f61eb5ffc admin admin] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:18.674189 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea8ea19-bfff-423b-acc6-640f61eb5ffc admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:18.674523 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea8ea19-bfff-423b-acc6-640f61eb5ffc admin admin] PATH_INFO: `/v3/projects` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:18.675435 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea8ea19-bfff-423b-acc6-640f61eb5ffc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:50:18.677378 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea8ea19-bfff-423b-acc6-640f61eb5ffc admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:50:18.704061 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1354/2712] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jul 11 14:50:18 2022] POST /identity/v3/projects => generated 379 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:50:18.709454 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3905e8-ae72-4f0c-9056-9571a2d7d881 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:50:18.722265 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3905e8-ae72-4f0c-9056-9571a2d7d881 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:50:18.732667 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:50:18.785212 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58359bd3-6141-451d-999b-bd30e207db92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:50:18.785880 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58359bd3-6141-451d-999b-bd30e207db92 admin admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:18.786164 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58359bd3-6141-451d-999b-bd30e207db92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:18.786444 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58359bd3-6141-451d-999b-bd30e207db92 admin admin] PATH_INFO: `/v3/users` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:18.787133 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58359bd3-6141-451d-999b-bd30e207db92 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:50:18.789071 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58359bd3-6141-451d-999b-bd30e207db92 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:50:18.809287 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1359/2713] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jul 11 14:50:18 2022] POST /identity/v3/users => generated 290 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:50:18.813859 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea8ea19-bfff-423b-acc6-640f61eb5ffc admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:50:18.825395 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea8ea19-bfff-423b-acc6-640f61eb5ffc admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:50:18.830169 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cfe031-1fea-4c62-9608-30e1f2bbac49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:50:18.831497 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cfe031-1fea-4c62-9608-30e1f2bbac49 admin admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:18.831937 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cfe031-1fea-4c62-9608-30e1f2bbac49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:18.832334 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cfe031-1fea-4c62-9608-30e1f2bbac49 admin admin] PATH_INFO: `/v3/roles` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:18.833102 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cfe031-1fea-4c62-9608-30e1f2bbac49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:50:18.834675 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cfe031-1fea-4c62-9608-30e1f2bbac49 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:50:18.845774 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1355/2714] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:50:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 14:50:18.850199 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58359bd3-6141-451d-999b-bd30e207db92 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:50:18.860171 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58359bd3-6141-451d-999b-bd30e207db92 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:50:18.864988 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b23187-20dd-4286-afdd-4285a2eb54f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:50:18.865649 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b23187-20dd-4286-afdd-4285a2eb54f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:18.865935 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b23187-20dd-4286-afdd-4285a2eb54f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:18.866212 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b23187-20dd-4286-afdd-4285a2eb54f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:18.866932 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b23187-20dd-4286-afdd-4285a2eb54f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:50:18.868553 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b23187-20dd-4286-afdd-4285a2eb54f4 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:50:18.879802 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1360/2715] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:50:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:50:18.883945 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cfe031-1fea-4c62-9608-30e1f2bbac49 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:50:18.895295 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cfe031-1fea-4c62-9608-30e1f2bbac49 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:50:18.900485 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba243cc-f0ef-40d0-92bd-d052b3273916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:50:18.901372 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba243cc-f0ef-40d0-92bd-d052b3273916 admin admin] REQUEST_METHOD: `PUT` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:18.901660 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba243cc-f0ef-40d0-92bd-d052b3273916 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:18.901936 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba243cc-f0ef-40d0-92bd-d052b3273916 admin admin] PATH_INFO: `/v3/projects/025a272dc4a04f1799a4fe96790be7be/users/c72e7882466044d89ca030760b1ffb68/roles/8eff41f243c843ed95505a488ca6eada` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:18.917296 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba243cc-f0ef-40d0-92bd-d052b3273916 admin admin] RBAC: Authorizing `identity:create_grant(project_id=025a272dc4a04f1799a4fe96790be7be, user_id=c72e7882466044d89ca030760b1ffb68, role_id=8eff41f243c843ed95505a488ca6eada)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:50:18.920248 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba243cc-f0ef-40d0-92bd-d052b3273916 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:50:18.936947 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1356/2716] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jul 11 14:50:18 2022] PUT /identity/v3/projects/025a272dc4a04f1799a4fe96790be7be/users/c72e7882466044d89ca030760b1ffb68/roles/8eff41f243c843ed95505a488ca6eada => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:50:18.949833 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c286fde1-8df8-4249-b4ed-2342d4b633ed None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:18.950158 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c286fde1-8df8-4249-b4ed-2342d4b633ed None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:18.950460 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c286fde1-8df8-4249-b4ed-2342d4b633ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:18.976873 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-c286fde1-8df8-4249-b4ed-2342d4b633ed None None] MFA Rules not processed for user `c72e7882466044d89ca030760b1ffb68`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:50:18.978094 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-c286fde1-8df8-4249-b4ed-2342d4b633ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:50:19.043197 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1361/2717] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:50:18 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:50:19.047886 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba243cc-f0ef-40d0-92bd-d052b3273916 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:50:19.114135 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba243cc-f0ef-40d0-92bd-d052b3273916 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:50:19.120907 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f353b408-920b-45bb-af7a-293fb292d273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:50:19.121575 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f353b408-920b-45bb-af7a-293fb292d273 admin admin] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:19.121860 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f353b408-920b-45bb-af7a-293fb292d273 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:19.122138 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f353b408-920b-45bb-af7a-293fb292d273 admin admin] PATH_INFO: `/v3/projects` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:19.122833 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f353b408-920b-45bb-af7a-293fb292d273 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:50:19.124885 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f353b408-920b-45bb-af7a-293fb292d273 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:50:19.151683 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1357/2718] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jul 11 14:50:19 2022] POST /identity/v3/projects => generated 381 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:50:19.155875 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c286fde1-8df8-4249-b4ed-2342d4b633ed None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:50:19.166829 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c286fde1-8df8-4249-b4ed-2342d4b633ed None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:50:19.236098 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee46b27-a28d-4082-8ca0-5d3d407870fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:50:19.236709 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee46b27-a28d-4082-8ca0-5d3d407870fb admin admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:19.237982 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee46b27-a28d-4082-8ca0-5d3d407870fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:19.238239 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee46b27-a28d-4082-8ca0-5d3d407870fb admin admin] PATH_INFO: `/v3/users` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:19.238940 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee46b27-a28d-4082-8ca0-5d3d407870fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:50:19.240890 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee46b27-a28d-4082-8ca0-5d3d407870fb admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:50:19.261930 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1362/2719] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jul 11 14:50:19 2022] POST /identity/v3/users => generated 297 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:50:19.265969 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f353b408-920b-45bb-af7a-293fb292d273 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:50:19.276908 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f353b408-920b-45bb-af7a-293fb292d273 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:50:19.282155 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4566da1c-c225-46d1-90d3-913867206cac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:50:19.282809 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4566da1c-c225-46d1-90d3-913867206cac admin admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:19.283101 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4566da1c-c225-46d1-90d3-913867206cac admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:19.283375 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4566da1c-c225-46d1-90d3-913867206cac admin admin] PATH_INFO: `/v3/roles` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:19.284957 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4566da1c-c225-46d1-90d3-913867206cac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:50:19.286555 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4566da1c-c225-46d1-90d3-913867206cac admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:50:19.297278 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1358/2720] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:50:19 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 14:50:19.303287 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee46b27-a28d-4082-8ca0-5d3d407870fb admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:50:19.319845 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee46b27-a28d-4082-8ca0-5d3d407870fb admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:50:19.329002 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca8907b-3597-40e3-9432-2f3511c49d6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:50:19.329899 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca8907b-3597-40e3-9432-2f3511c49d6c admin admin] REQUEST_METHOD: `PUT` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:19.330184 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca8907b-3597-40e3-9432-2f3511c49d6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:19.330463 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca8907b-3597-40e3-9432-2f3511c49d6c admin admin] PATH_INFO: `/v3/projects/ae773921642c4288bad592cdfaf40118/users/8290760ae1384b98a802502c138b6e7f/roles/b46df176b0fe479da63c318db225bed4` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:19.339453 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:50:19.347942 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca8907b-3597-40e3-9432-2f3511c49d6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae773921642c4288bad592cdfaf40118, user_id=8290760ae1384b98a802502c138b6e7f, role_id=b46df176b0fe479da63c318db225bed4)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:50:19.350983 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca8907b-3597-40e3-9432-2f3511c49d6c admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:50:19.366875 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1363/2721] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jul 11 14:50:19 2022] PUT /identity/v3/projects/ae773921642c4288bad592cdfaf40118/users/8290760ae1384b98a802502c138b6e7f/roles/b46df176b0fe479da63c318db225bed4 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:50:19.371050 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4566da1c-c225-46d1-90d3-913867206cac admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:50:19.383419 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4566da1c-c225-46d1-90d3-913867206cac admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:50:19.435311 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:50:19.454735 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f427187-0d28-46e4-8734-5fa2273fa5fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:50:19.455487 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f427187-0d28-46e4-8734-5fa2273fa5fa admin admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:19.456037 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f427187-0d28-46e4-8734-5fa2273fa5fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:19.456410 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f427187-0d28-46e4-8734-5fa2273fa5fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:19.457389 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f427187-0d28-46e4-8734-5fa2273fa5fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:50:19.458849 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f427187-0d28-46e4-8734-5fa2273fa5fa admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:50:19.470281 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1359/2722] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:50:19 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:50:19.475121 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca8907b-3597-40e3-9432-2f3511c49d6c admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:50:19.486059 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca8907b-3597-40e3-9432-2f3511c49d6c admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:50:19.491808 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6a2191-0452-4caf-a4b2-45f465afa1d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:50:19.492813 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6a2191-0452-4caf-a4b2-45f465afa1d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:19.493106 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6a2191-0452-4caf-a4b2-45f465afa1d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:19.493388 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6a2191-0452-4caf-a4b2-45f465afa1d8 admin admin] PATH_INFO: `/v3/projects/ae773921642c4288bad592cdfaf40118/users/8290760ae1384b98a802502c138b6e7f/roles/b46df176b0fe479da63c318db225bed4` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:19.495449 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6a2191-0452-4caf-a4b2-45f465afa1d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae773921642c4288bad592cdfaf40118, user_id=8290760ae1384b98a802502c138b6e7f, role_id=b46df176b0fe479da63c318db225bed4)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:50:19.498151 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6a2191-0452-4caf-a4b2-45f465afa1d8 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:50:19.510177 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1364/2723] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jul 11 14:50:19 2022] PUT /identity/v3/projects/ae773921642c4288bad592cdfaf40118/users/8290760ae1384b98a802502c138b6e7f/roles/b46df176b0fe479da63c318db225bed4 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:50:19.521253 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96770506-0ecf-41fd-beee-5466b2e58444 None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:19.521566 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96770506-0ecf-41fd-beee-5466b2e58444 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:19.521838 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96770506-0ecf-41fd-beee-5466b2e58444 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:19.569727 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-96770506-0ecf-41fd-beee-5466b2e58444 None None] MFA Rules not processed for user `8290760ae1384b98a802502c138b6e7f`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:50:19.571109 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-96770506-0ecf-41fd-beee-5466b2e58444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:50:19.652519 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1360/2724] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:50:19 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:50:19.669763 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6a2191-0452-4caf-a4b2-45f465afa1d8 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:50:19.671596 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-7a6a2191-0452-4caf-a4b2-45f465afa1d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:50:19.735461 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6a2191-0452-4caf-a4b2-45f465afa1d8 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:50:19.739248 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7285b8-faf9-4c5a-94d3-747ade38e606 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '868e7c2dec264512b972c8736d659c34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:50:19.739904 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7285b8-faf9-4c5a-94d3-747ade38e606 service cinder] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:19.740213 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7285b8-faf9-4c5a-94d3-747ade38e606 service cinder] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:19.740505 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7285b8-faf9-4c5a-94d3-747ade38e606 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:19.750240 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7285b8-faf9-4c5a-94d3-747ade38e606 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:50:19.751614 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7285b8-faf9-4c5a-94d3-747ade38e606 service cinder] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:50:19.762220 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1365/2725] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:50:19 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:50:20.099601 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96770506-0ecf-41fd-beee-5466b2e58444 None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:50:20.108842 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96770506-0ecf-41fd-beee-5466b2e58444 None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:50:20.114557 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d8f8e0-ae09-4238-a341-6216712ce501 tempest-VolumeQuotaClassesTest-1832933261 tempest-VolumeQuotaClassesTest-1832933261-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8290760ae1384b98a802502c138b6e7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae773921642c4288bad592cdfaf40118', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:50:20.115271 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d8f8e0-ae09-4238-a341-6216712ce501 tempest-VolumeQuotaClassesTest-1832933261 tempest-VolumeQuotaClassesTest-1832933261-project-admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:20.115613 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d8f8e0-ae09-4238-a341-6216712ce501 tempest-VolumeQuotaClassesTest-1832933261 tempest-VolumeQuotaClassesTest-1832933261-project-admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:20.115897 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d8f8e0-ae09-4238-a341-6216712ce501 tempest-VolumeQuotaClassesTest-1832933261 tempest-VolumeQuotaClassesTest-1832933261-project-admin] PATH_INFO: `/v3/domains` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:20.116666 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d8f8e0-ae09-4238-a341-6216712ce501 tempest-VolumeQuotaClassesTest-1832933261 tempest-VolumeQuotaClassesTest-1832933261-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:50:20.117118 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d8f8e0-ae09-4238-a341-6216712ce501 tempest-VolumeQuotaClassesTest-1832933261 tempest-VolumeQuotaClassesTest-1832933261-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:50:20.119057 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d8f8e0-ae09-4238-a341-6216712ce501 tempest-VolumeQuotaClassesTest-1832933261 tempest-VolumeQuotaClassesTest-1832933261-project-admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:50:20.132300 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1361/2726] 10.222.0.70 () {58 vars in 1152 bytes} [Mon Jul 11 14:50:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:50:20.136386 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7285b8-faf9-4c5a-94d3-747ade38e606 service cinder] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:50:20.146393 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7285b8-faf9-4c5a-94d3-747ade38e606 service cinder] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:50:20.151095 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaa51e0-7bfe-477d-96af-017087d4eacd tempest-VolumeQuotaClassesTest-1832933261 tempest-VolumeQuotaClassesTest-1832933261-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8290760ae1384b98a802502c138b6e7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae773921642c4288bad592cdfaf40118', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:50:20.151789 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaa51e0-7bfe-477d-96af-017087d4eacd tempest-VolumeQuotaClassesTest-1832933261 tempest-VolumeQuotaClassesTest-1832933261-project-admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:20.152078 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaa51e0-7bfe-477d-96af-017087d4eacd tempest-VolumeQuotaClassesTest-1832933261 tempest-VolumeQuotaClassesTest-1832933261-project-admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:20.152391 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaa51e0-7bfe-477d-96af-017087d4eacd tempest-VolumeQuotaClassesTest-1832933261 tempest-VolumeQuotaClassesTest-1832933261-project-admin] PATH_INFO: `/v3/projects` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:20.153084 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeaa51e0-7bfe-477d-96af-017087d4eacd tempest-VolumeQuotaClassesTest-1832933261 tempest-VolumeQuotaClassesTest-1832933261-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:50:20.154989 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeaa51e0-7bfe-477d-96af-017087d4eacd tempest-VolumeQuotaClassesTest-1832933261 tempest-VolumeQuotaClassesTest-1832933261-project-admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:50:20.186950 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1366/2727] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jul 11 14:50:20 2022] POST /identity/v3/projects => generated 354 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:50:20.188934 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d8f8e0-ae09-4238-a341-6216712ce501 tempest-VolumeQuotaClassesTest-1832933261 tempest-VolumeQuotaClassesTest-1832933261-project-admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:50:20.201094 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d8f8e0-ae09-4238-a341-6216712ce501 tempest-VolumeQuotaClassesTest-1832933261 tempest-VolumeQuotaClassesTest-1832933261-project-admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:50:20.262852 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b8f808-b050-46bf-a8ea-f134191d7ccc tempest-VolumeQuotaClassesTest-1832933261 tempest-VolumeQuotaClassesTest-1832933261-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8290760ae1384b98a802502c138b6e7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae773921642c4288bad592cdfaf40118', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:50:20.263565 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b8f808-b050-46bf-a8ea-f134191d7ccc tempest-VolumeQuotaClassesTest-1832933261 tempest-VolumeQuotaClassesTest-1832933261-project-admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:20.263857 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b8f808-b050-46bf-a8ea-f134191d7ccc tempest-VolumeQuotaClassesTest-1832933261 tempest-VolumeQuotaClassesTest-1832933261-project-admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:20.264142 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b8f808-b050-46bf-a8ea-f134191d7ccc tempest-VolumeQuotaClassesTest-1832933261 tempest-VolumeQuotaClassesTest-1832933261-project-admin] PATH_INFO: `/v3/domains` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:20.264917 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b8f808-b050-46bf-a8ea-f134191d7ccc tempest-VolumeQuotaClassesTest-1832933261 tempest-VolumeQuotaClassesTest-1832933261-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:50:20.265231 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b8f808-b050-46bf-a8ea-f134191d7ccc tempest-VolumeQuotaClassesTest-1832933261 tempest-VolumeQuotaClassesTest-1832933261-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:50:20.266829 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b8f808-b050-46bf-a8ea-f134191d7ccc tempest-VolumeQuotaClassesTest-1832933261 tempest-VolumeQuotaClassesTest-1832933261-project-admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:50:20.280008 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1362/2728] 10.222.0.70 () {58 vars in 1152 bytes} [Mon Jul 11 14:50:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:50:20.317508 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaa51e0-7bfe-477d-96af-017087d4eacd tempest-VolumeQuotaClassesTest-1832933261 tempest-VolumeQuotaClassesTest-1832933261-project-admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:50:20.328499 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaa51e0-7bfe-477d-96af-017087d4eacd tempest-VolumeQuotaClassesTest-1832933261 tempest-VolumeQuotaClassesTest-1832933261-project-admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:50:20.334254 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc452f8-c09e-4a6d-bf1f-87098c0a213e tempest-VolumeQuotaClassesTest-1832933261 tempest-VolumeQuotaClassesTest-1832933261-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8290760ae1384b98a802502c138b6e7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae773921642c4288bad592cdfaf40118', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:50:20.335148 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc452f8-c09e-4a6d-bf1f-87098c0a213e tempest-VolumeQuotaClassesTest-1832933261 tempest-VolumeQuotaClassesTest-1832933261-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:20.335425 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc452f8-c09e-4a6d-bf1f-87098c0a213e tempest-VolumeQuotaClassesTest-1832933261 tempest-VolumeQuotaClassesTest-1832933261-project-admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:20.335710 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc452f8-c09e-4a6d-bf1f-87098c0a213e tempest-VolumeQuotaClassesTest-1832933261 tempest-VolumeQuotaClassesTest-1832933261-project-admin] PATH_INFO: `/v3/projects/b7e7d909b03a4d5ea1292579d44967fb` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:20.336943 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc452f8-c09e-4a6d-bf1f-87098c0a213e tempest-VolumeQuotaClassesTest-1832933261 tempest-VolumeQuotaClassesTest-1832933261-project-admin] RBAC: Authorizing `identity:delete_project(project_id=b7e7d909b03a4d5ea1292579d44967fb)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:50:20.338905 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc452f8-c09e-4a6d-bf1f-87098c0a213e tempest-VolumeQuotaClassesTest-1832933261 tempest-VolumeQuotaClassesTest-1832933261-project-admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:50:20.388099 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-7fc452f8-c09e-4a6d-bf1f-87098c0a213e tempest-VolumeQuotaClassesTest-1832933261 tempest-VolumeQuotaClassesTest-1832933261-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7e7d909b03a4d5ea1292579d44967fb', 'request_id': 'req-7fc452f8-c09e-4a6d-bf1f-87098c0a213e'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:50:20.394665 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-7fc452f8-c09e-4a6d-bf1f-87098c0a213e tempest-VolumeQuotaClassesTest-1832933261 tempest-VolumeQuotaClassesTest-1832933261-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7e7d909b03a4d5ea1292579d44967fb', 'request_id': 'req-7fc452f8-c09e-4a6d-bf1f-87098c0a213e'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:50:20.401484 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-7fc452f8-c09e-4a6d-bf1f-87098c0a213e tempest-VolumeQuotaClassesTest-1832933261 tempest-VolumeQuotaClassesTest-1832933261-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7e7d909b03a4d5ea1292579d44967fb', 'request_id': 'req-7fc452f8-c09e-4a6d-bf1f-87098c0a213e'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:50:20.413929 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-7fc452f8-c09e-4a6d-bf1f-87098c0a213e tempest-VolumeQuotaClassesTest-1832933261 tempest-VolumeQuotaClassesTest-1832933261-project-admin] The token cache is being invalidate because project b7e7d909b03a4d5ea1292579d44967fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:50:20.414281 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-7fc452f8-c09e-4a6d-bf1f-87098c0a213e tempest-VolumeQuotaClassesTest-1832933261 tempest-VolumeQuotaClassesTest-1832933261-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:50:20.415357 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-7fc452f8-c09e-4a6d-bf1f-87098c0a213e tempest-VolumeQuotaClassesTest-1832933261 tempest-VolumeQuotaClassesTest-1832933261-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:50:20.417236 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1367/2729] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jul 11 14:50:20 2022] DELETE /identity/v3/projects/b7e7d909b03a4d5ea1292579d44967fb => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:50:20.614641 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b8f808-b050-46bf-a8ea-f134191d7ccc tempest-VolumeQuotaClassesTest-1832933261 tempest-VolumeQuotaClassesTest-1832933261-project-admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:50:20.616501 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-44b8f808-b050-46bf-a8ea-f134191d7ccc tempest-VolumeQuotaClassesTest-1832933261 tempest-VolumeQuotaClassesTest-1832933261-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:50:20.673857 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:50:20.688514 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b8f808-b050-46bf-a8ea-f134191d7ccc tempest-VolumeQuotaClassesTest-1832933261 tempest-VolumeQuotaClassesTest-1832933261-project-admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:50:20.748114 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8528795-8294-4e3a-bcd5-8073a6776746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:50:20.749043 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8528795-8294-4e3a-bcd5-8073a6776746 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:20.749317 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8528795-8294-4e3a-bcd5-8073a6776746 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:20.749599 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8528795-8294-4e3a-bcd5-8073a6776746 admin admin] PATH_INFO: `/v3/users/c72e7882466044d89ca030760b1ffb68` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:20.750843 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8528795-8294-4e3a-bcd5-8073a6776746 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c72e7882466044d89ca030760b1ffb68)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:50:20.752973 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8528795-8294-4e3a-bcd5-8073a6776746 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:50:20.819930 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-f8528795-8294-4e3a-bcd5-8073a6776746 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c72e7882466044d89ca030760b1ffb68'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:50:20.828742 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-f8528795-8294-4e3a-bcd5-8073a6776746 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c72e7882466044d89ca030760b1ffb68'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:50:20.837187 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-f8528795-8294-4e3a-bcd5-8073a6776746 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c72e7882466044d89ca030760b1ffb68'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:50:20.837797 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-f8528795-8294-4e3a-bcd5-8073a6776746 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c72e7882466044d89ca030760b1ffb68'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:50:20.838402 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-f8528795-8294-4e3a-bcd5-8073a6776746 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c72e7882466044d89ca030760b1ffb68'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:50:20.857735 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1363/2730] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jul 11 14:50:20 2022] DELETE /identity/v3/users/c72e7882466044d89ca030760b1ffb68 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:50:20.862215 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f24dac8-a774-4e86-a755-71121fcc1e2b None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:20.863044 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f24dac8-a774-4e86-a755-71121fcc1e2b None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:20.863277 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f24dac8-a774-4e86-a755-71121fcc1e2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:20.882114 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-1f24dac8-a774-4e86-a755-71121fcc1e2b None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:50:20.883879 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-1f24dac8-a774-4e86-a755-71121fcc1e2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:50:20.917541 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:50:20.947581 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1368/2731] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:50:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:50:20.958379 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8528795-8294-4e3a-bcd5-8073a6776746 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:50:20.959823 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-f8528795-8294-4e3a-bcd5-8073a6776746 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:50:21.017833 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8528795-8294-4e3a-bcd5-8073a6776746 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:50:21.022304 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d317988-5be3-49e5-9210-f10c3a4d3678 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20eede5ccd834862b00123310b5c3975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:50:21.022947 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d317988-5be3-49e5-9210-f10c3a4d3678 service neutron] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:21.023233 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d317988-5be3-49e5-9210-f10c3a4d3678 service neutron] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:21.023510 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d317988-5be3-49e5-9210-f10c3a4d3678 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:21.032616 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d317988-5be3-49e5-9210-f10c3a4d3678 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:50:21.034079 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d317988-5be3-49e5-9210-f10c3a4d3678 service neutron] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:50:21.043607 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1364/2732] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:50:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:50:21.324660 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f24dac8-a774-4e86-a755-71121fcc1e2b None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:50:21.326388 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-1f24dac8-a774-4e86-a755-71121fcc1e2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:50:21.342531 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f24dac8-a774-4e86-a755-71121fcc1e2b None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:50:21.348374 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd05638-b6a2-45fb-a8b1-1bf3cfa51939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:50:21.349268 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd05638-b6a2-45fb-a8b1-1bf3cfa51939 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:21.349638 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd05638-b6a2-45fb-a8b1-1bf3cfa51939 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:21.349805 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd05638-b6a2-45fb-a8b1-1bf3cfa51939 admin admin] PATH_INFO: `/v3/projects/025a272dc4a04f1799a4fe96790be7be` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:21.351036 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd05638-b6a2-45fb-a8b1-1bf3cfa51939 admin admin] RBAC: Authorizing `identity:delete_project(project_id=025a272dc4a04f1799a4fe96790be7be)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:50:21.353328 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd05638-b6a2-45fb-a8b1-1bf3cfa51939 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:50:21.402041 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-1dd05638-b6a2-45fb-a8b1-1bf3cfa51939 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '025a272dc4a04f1799a4fe96790be7be', 'request_id': 'req-1dd05638-b6a2-45fb-a8b1-1bf3cfa51939'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:50:21.407468 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-1dd05638-b6a2-45fb-a8b1-1bf3cfa51939 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '025a272dc4a04f1799a4fe96790be7be', 'request_id': 'req-1dd05638-b6a2-45fb-a8b1-1bf3cfa51939'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:50:21.413648 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-1dd05638-b6a2-45fb-a8b1-1bf3cfa51939 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '025a272dc4a04f1799a4fe96790be7be', 'request_id': 'req-1dd05638-b6a2-45fb-a8b1-1bf3cfa51939'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:50:21.427830 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-1dd05638-b6a2-45fb-a8b1-1bf3cfa51939 admin admin] The token cache is being invalidate because project 025a272dc4a04f1799a4fe96790be7be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:50:21.428121 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-1dd05638-b6a2-45fb-a8b1-1bf3cfa51939 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:50:21.428785 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-1dd05638-b6a2-45fb-a8b1-1bf3cfa51939 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:50:21.430388 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1369/2733] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jul 11 14:50:21 2022] DELETE /identity/v3/projects/025a272dc4a04f1799a4fe96790be7be => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:50:21.435659 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d317988-5be3-49e5-9210-f10c3a4d3678 service neutron] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:50:21.447008 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d317988-5be3-49e5-9210-f10c3a4d3678 service neutron] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:50:21.459537 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:50:21.510851 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7ba384-3067-420d-97f3-ea0de5614b2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:50:21.511724 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7ba384-3067-420d-97f3-ea0de5614b2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:21.512012 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7ba384-3067-420d-97f3-ea0de5614b2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:21.512330 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7ba384-3067-420d-97f3-ea0de5614b2e admin admin] PATH_INFO: `/v3/users/8290760ae1384b98a802502c138b6e7f` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:21.513554 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7ba384-3067-420d-97f3-ea0de5614b2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=8290760ae1384b98a802502c138b6e7f)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:50:21.515482 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7ba384-3067-420d-97f3-ea0de5614b2e admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:50:21.561433 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-2d7ba384-3067-420d-97f3-ea0de5614b2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8290760ae1384b98a802502c138b6e7f'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:50:21.571695 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-2d7ba384-3067-420d-97f3-ea0de5614b2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8290760ae1384b98a802502c138b6e7f'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:50:21.578934 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-2d7ba384-3067-420d-97f3-ea0de5614b2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8290760ae1384b98a802502c138b6e7f'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:50:21.579623 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-2d7ba384-3067-420d-97f3-ea0de5614b2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8290760ae1384b98a802502c138b6e7f'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:50:21.580309 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-2d7ba384-3067-420d-97f3-ea0de5614b2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8290760ae1384b98a802502c138b6e7f'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:50:21.598613 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1365/2734] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jul 11 14:50:21 2022] DELETE /identity/v3/users/8290760ae1384b98a802502c138b6e7f => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:50:21.878651 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd05638-b6a2-45fb-a8b1-1bf3cfa51939 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:50:21.879734 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-1dd05638-b6a2-45fb-a8b1-1bf3cfa51939 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:50:21.893529 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd05638-b6a2-45fb-a8b1-1bf3cfa51939 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:50:21.964018 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf10b6b-7e40-4392-ba18-567ec6650aa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:50:21.964834 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf10b6b-7e40-4392-ba18-567ec6650aa7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:21.965124 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf10b6b-7e40-4392-ba18-567ec6650aa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:21.965407 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf10b6b-7e40-4392-ba18-567ec6650aa7 admin admin] PATH_INFO: `/v3/projects/ae773921642c4288bad592cdfaf40118` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:21.966615 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf10b6b-7e40-4392-ba18-567ec6650aa7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae773921642c4288bad592cdfaf40118)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:50:21.968576 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf10b6b-7e40-4392-ba18-567ec6650aa7 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:50:22.019468 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-2bf10b6b-7e40-4392-ba18-567ec6650aa7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae773921642c4288bad592cdfaf40118', 'request_id': 'req-2bf10b6b-7e40-4392-ba18-567ec6650aa7'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:50:22.025899 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-2bf10b6b-7e40-4392-ba18-567ec6650aa7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae773921642c4288bad592cdfaf40118', 'request_id': 'req-2bf10b6b-7e40-4392-ba18-567ec6650aa7'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:50:22.032306 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-2bf10b6b-7e40-4392-ba18-567ec6650aa7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae773921642c4288bad592cdfaf40118', 'request_id': 'req-2bf10b6b-7e40-4392-ba18-567ec6650aa7'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:50:22.034667 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:50:22.051577 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-2bf10b6b-7e40-4392-ba18-567ec6650aa7 admin admin] The token cache is being invalidate because project ae773921642c4288bad592cdfaf40118 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:50:22.051875 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-2bf10b6b-7e40-4392-ba18-567ec6650aa7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:50:22.052634 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-2bf10b6b-7e40-4392-ba18-567ec6650aa7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:50:22.054089 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1370/2735] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jul 11 14:50:21 2022] DELETE /identity/v3/projects/ae773921642c4288bad592cdfaf40118 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:50:22.059233 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4927e9e7-0871-400c-b4a7-13c8e8143323 None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:22.059719 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4927e9e7-0871-400c-b4a7-13c8e8143323 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:22.059814 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4927e9e7-0871-400c-b4a7-13c8e8143323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:22.078250 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-4927e9e7-0871-400c-b4a7-13c8e8143323 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:50:22.079463 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-4927e9e7-0871-400c-b4a7-13c8e8143323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:50:22.141579 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1366/2736] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:50:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:50:22.151682 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff30bc34-2d4b-4af0-96ea-47478a7c7f87 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:22.152048 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff30bc34-2d4b-4af0-96ea-47478a7c7f87 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:22.152429 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff30bc34-2d4b-4af0-96ea-47478a7c7f87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:22.171965 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-ff30bc34-2d4b-4af0-96ea-47478a7c7f87 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:50:22.173246 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-ff30bc34-2d4b-4af0-96ea-47478a7c7f87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:50:22.182096 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1371/2737] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:50:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:50:22.186652 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4927e9e7-0871-400c-b4a7-13c8e8143323 None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:50:22.197093 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4927e9e7-0871-400c-b4a7-13c8e8143323 None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:50:22.201901 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e99c6b7-c3c4-43aa-9169-57cf15e838cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:50:22.202596 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e99c6b7-c3c4-43aa-9169-57cf15e838cc admin admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:22.202880 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e99c6b7-c3c4-43aa-9169-57cf15e838cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:22.203158 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e99c6b7-c3c4-43aa-9169-57cf15e838cc admin admin] PATH_INFO: `/v3/domains` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:22.203890 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e99c6b7-c3c4-43aa-9169-57cf15e838cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:50:22.204196 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e99c6b7-c3c4-43aa-9169-57cf15e838cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:50:22.205825 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e99c6b7-c3c4-43aa-9169-57cf15e838cc admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:50:22.218179 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1367/2738] 10.222.0.70 () {58 vars in 1152 bytes} [Mon Jul 11 14:50:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:50:22.222669 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff30bc34-2d4b-4af0-96ea-47478a7c7f87 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:50:22.232030 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff30bc34-2d4b-4af0-96ea-47478a7c7f87 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:50:22.236808 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37dadf9-fc17-4a60-b257-7ceb43ccdf02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:50:22.238252 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37dadf9-fc17-4a60-b257-7ceb43ccdf02 admin admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:22.238568 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37dadf9-fc17-4a60-b257-7ceb43ccdf02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:22.238877 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37dadf9-fc17-4a60-b257-7ceb43ccdf02 admin admin] PATH_INFO: `/v3/projects` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:22.239624 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37dadf9-fc17-4a60-b257-7ceb43ccdf02 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:50:22.241805 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37dadf9-fc17-4a60-b257-7ceb43ccdf02 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:50:22.269579 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1372/2739] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jul 11 14:50:22 2022] POST /identity/v3/projects => generated 375 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:50:22.274015 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e99c6b7-c3c4-43aa-9169-57cf15e838cc admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:50:22.284076 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e99c6b7-c3c4-43aa-9169-57cf15e838cc admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:50:22.305820 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:50:22.347420 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ce7cf8-2d0f-4ba2-9648-3f13e34a9bc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:50:22.348027 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ce7cf8-2d0f-4ba2-9648-3f13e34a9bc7 admin admin] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:22.348345 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ce7cf8-2d0f-4ba2-9648-3f13e34a9bc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:22.348626 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ce7cf8-2d0f-4ba2-9648-3f13e34a9bc7 admin admin] PATH_INFO: `/v3/users` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:22.349341 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ce7cf8-2d0f-4ba2-9648-3f13e34a9bc7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:50:22.351372 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ce7cf8-2d0f-4ba2-9648-3f13e34a9bc7 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:50:22.371499 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1368/2740] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jul 11 14:50:22 2022] POST /identity/v3/users => generated 288 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:50:22.375740 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37dadf9-fc17-4a60-b257-7ceb43ccdf02 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:50:22.386719 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37dadf9-fc17-4a60-b257-7ceb43ccdf02 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:50:22.392369 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d78169-2b84-4a0e-8f84-bba01cf31345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:50:22.393077 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d78169-2b84-4a0e-8f84-bba01cf31345 admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:22.393498 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d78169-2b84-4a0e-8f84-bba01cf31345 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:22.394035 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d78169-2b84-4a0e-8f84-bba01cf31345 admin admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:22.394620 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d78169-2b84-4a0e-8f84-bba01cf31345 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:50:22.396505 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d78169-2b84-4a0e-8f84-bba01cf31345 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:50:22.407001 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1373/2741] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:50:22 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:50:22.411673 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ce7cf8-2d0f-4ba2-9648-3f13e34a9bc7 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:50:22.421832 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ce7cf8-2d0f-4ba2-9648-3f13e34a9bc7 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:50:22.427706 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8d8386-42e6-4675-8bfd-041af192a07b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:50:22.428401 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8d8386-42e6-4675-8bfd-041af192a07b admin admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:22.428686 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8d8386-42e6-4675-8bfd-041af192a07b admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:22.428967 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8d8386-42e6-4675-8bfd-041af192a07b admin admin] PATH_INFO: `/v3/roles` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:22.429690 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8d8386-42e6-4675-8bfd-041af192a07b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:50:22.431273 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8d8386-42e6-4675-8bfd-041af192a07b admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:50:22.442183 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1369/2742] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:50:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:50:22.446609 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d78169-2b84-4a0e-8f84-bba01cf31345 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:50:22.457077 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d78169-2b84-4a0e-8f84-bba01cf31345 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:50:22.461886 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a971a1cc-dfb5-4ce6-989d-f877ffc42ea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:50:22.462782 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a971a1cc-dfb5-4ce6-989d-f877ffc42ea1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:22.463070 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a971a1cc-dfb5-4ce6-989d-f877ffc42ea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:22.463345 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a971a1cc-dfb5-4ce6-989d-f877ffc42ea1 admin admin] PATH_INFO: `/v3/projects/be95717e124f4780a5f64e8176091b7c/users/ac96d95c92804e1b80c9b67e67b76fe4/roles/8eff41f243c843ed95505a488ca6eada` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:22.481948 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a971a1cc-dfb5-4ce6-989d-f877ffc42ea1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be95717e124f4780a5f64e8176091b7c, user_id=ac96d95c92804e1b80c9b67e67b76fe4, role_id=8eff41f243c843ed95505a488ca6eada)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:50:22.484600 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a971a1cc-dfb5-4ce6-989d-f877ffc42ea1 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:50:22.500314 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1374/2743] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jul 11 14:50:22 2022] PUT /identity/v3/projects/be95717e124f4780a5f64e8176091b7c/users/ac96d95c92804e1b80c9b67e67b76fe4/roles/8eff41f243c843ed95505a488ca6eada => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:50:22.512194 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac4ae53-0ed8-4a04-b831-607ef9d8fdd4 None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:22.512577 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac4ae53-0ed8-4a04-b831-607ef9d8fdd4 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:22.512805 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac4ae53-0ed8-4a04-b831-607ef9d8fdd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:22.540288 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-1ac4ae53-0ed8-4a04-b831-607ef9d8fdd4 None None] MFA Rules not processed for user `ac96d95c92804e1b80c9b67e67b76fe4`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:50:22.541518 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-1ac4ae53-0ed8-4a04-b831-607ef9d8fdd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:50:22.609849 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1370/2744] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:50:22 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:50:22.622195 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a971a1cc-dfb5-4ce6-989d-f877ffc42ea1 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:50:22.624054 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-a971a1cc-dfb5-4ce6-989d-f877ffc42ea1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:50:22.681946 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a971a1cc-dfb5-4ce6-989d-f877ffc42ea1 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:50:22.687008 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552ae06b-009f-4945-850a-38b5dcbfec4d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa21b44163d84534b9ca1ffe5b5a6071', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:50:22.687616 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552ae06b-009f-4945-850a-38b5dcbfec4d service glance] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:22.687900 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552ae06b-009f-4945-850a-38b5dcbfec4d service glance] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:22.688178 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552ae06b-009f-4945-850a-38b5dcbfec4d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:22.697239 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552ae06b-009f-4945-850a-38b5dcbfec4d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:50:22.698660 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552ae06b-009f-4945-850a-38b5dcbfec4d service glance] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:50:22.707983 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1375/2745] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:50:22 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:50:32.606891 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=55,keystone:INSERT=3 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:50:32.703395 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:INSERT=3,keystone:DELETE=1,keystone:SELECT=55 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:50:42.494002 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac4ae53-0ed8-4a04-b831-607ef9d8fdd4 None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:50:42.579447 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac4ae53-0ed8-4a04-b831-607ef9d8fdd4 None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:50:42.585320 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dd7dc9-2476-4a7f-a583-4319bd74c5a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:50:42.586079 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dd7dc9-2476-4a7f-a583-4319bd74c5a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:42.586452 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dd7dc9-2476-4a7f-a583-4319bd74c5a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:42.590086 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dd7dc9-2476-4a7f-a583-4319bd74c5a8 admin admin] PATH_INFO: `/v3/users/ac96d95c92804e1b80c9b67e67b76fe4` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:42.591510 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dd7dc9-2476-4a7f-a583-4319bd74c5a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac96d95c92804e1b80c9b67e67b76fe4)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:50:42.593832 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dd7dc9-2476-4a7f-a583-4319bd74c5a8 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:50:42.678371 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-84dd7dc9-2476-4a7f-a583-4319bd74c5a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac96d95c92804e1b80c9b67e67b76fe4'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:50:42.686272 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-84dd7dc9-2476-4a7f-a583-4319bd74c5a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac96d95c92804e1b80c9b67e67b76fe4'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:50:42.694384 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-84dd7dc9-2476-4a7f-a583-4319bd74c5a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac96d95c92804e1b80c9b67e67b76fe4'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:50:42.695012 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-84dd7dc9-2476-4a7f-a583-4319bd74c5a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac96d95c92804e1b80c9b67e67b76fe4'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:50:42.695660 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-84dd7dc9-2476-4a7f-a583-4319bd74c5a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac96d95c92804e1b80c9b67e67b76fe4'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:50:42.715111 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1371/2746] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jul 11 14:50:42 2022] DELETE /identity/v3/users/ac96d95c92804e1b80c9b67e67b76fe4 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:50:42.719784 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709ec0c7-eff2-4012-8c79-e03f3c851dee None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:42.720440 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709ec0c7-eff2-4012-8c79-e03f3c851dee None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:42.720440 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709ec0c7-eff2-4012-8c79-e03f3c851dee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:42.742200 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-709ec0c7-eff2-4012-8c79-e03f3c851dee None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:50:42.743400 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-709ec0c7-eff2-4012-8c79-e03f3c851dee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:50:42.807212 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1376/2747] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:50:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:50:42.819105 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dd7dc9-2476-4a7f-a583-4319bd74c5a8 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:50:42.820904 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-84dd7dc9-2476-4a7f-a583-4319bd74c5a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:50:42.883967 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dd7dc9-2476-4a7f-a583-4319bd74c5a8 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:50:42.888442 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761f1ed6-826a-4a58-a407-58e5aca6389a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20eede5ccd834862b00123310b5c3975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:50:42.889120 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761f1ed6-826a-4a58-a407-58e5aca6389a service neutron] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:42.889400 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761f1ed6-826a-4a58-a407-58e5aca6389a service neutron] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:42.889670 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761f1ed6-826a-4a58-a407-58e5aca6389a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:42.901419 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761f1ed6-826a-4a58-a407-58e5aca6389a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:50:42.902893 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761f1ed6-826a-4a58-a407-58e5aca6389a service neutron] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:50:42.916190 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1372/2748] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:50:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:50:43.218940 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709ec0c7-eff2-4012-8c79-e03f3c851dee None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:50:43.220518 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-709ec0c7-eff2-4012-8c79-e03f3c851dee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:50:43.233898 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709ec0c7-eff2-4012-8c79-e03f3c851dee None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:50:43.242170 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dcfc0f-d6ea-41fa-8b54-1541599b7c85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:50:43.243060 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dcfc0f-d6ea-41fa-8b54-1541599b7c85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:43.243346 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dcfc0f-d6ea-41fa-8b54-1541599b7c85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:43.243632 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dcfc0f-d6ea-41fa-8b54-1541599b7c85 admin admin] PATH_INFO: `/v3/projects/be95717e124f4780a5f64e8176091b7c` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:43.245090 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dcfc0f-d6ea-41fa-8b54-1541599b7c85 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be95717e124f4780a5f64e8176091b7c)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:50:43.247160 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dcfc0f-d6ea-41fa-8b54-1541599b7c85 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:50:43.299872 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-d1dcfc0f-d6ea-41fa-8b54-1541599b7c85 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be95717e124f4780a5f64e8176091b7c', 'request_id': 'req-d1dcfc0f-d6ea-41fa-8b54-1541599b7c85'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:50:43.305925 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-d1dcfc0f-d6ea-41fa-8b54-1541599b7c85 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be95717e124f4780a5f64e8176091b7c', 'request_id': 'req-d1dcfc0f-d6ea-41fa-8b54-1541599b7c85'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:50:43.313388 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-d1dcfc0f-d6ea-41fa-8b54-1541599b7c85 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be95717e124f4780a5f64e8176091b7c', 'request_id': 'req-d1dcfc0f-d6ea-41fa-8b54-1541599b7c85'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:50:43.330467 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-d1dcfc0f-d6ea-41fa-8b54-1541599b7c85 admin admin] The token cache is being invalidate because project be95717e124f4780a5f64e8176091b7c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:50:43.331346 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-d1dcfc0f-d6ea-41fa-8b54-1541599b7c85 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:50:43.332349 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-d1dcfc0f-d6ea-41fa-8b54-1541599b7c85 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:50:43.334093 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1377/2749] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jul 11 14:50:43 2022] DELETE /identity/v3/projects/be95717e124f4780a5f64e8176091b7c => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:50:43.338851 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905b8c12-fca7-4d6d-bc8a-10950014113c None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:43.339146 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905b8c12-fca7-4d6d-bc8a-10950014113c None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:43.339429 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905b8c12-fca7-4d6d-bc8a-10950014113c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:43.358025 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-905b8c12-fca7-4d6d-bc8a-10950014113c None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:50:43.359268 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-905b8c12-fca7-4d6d-bc8a-10950014113c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:50:43.379555 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:50:43.430413 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1373/2750] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:50:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:50:43.440340 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8f2f3a-6e43-441e-a55a-04520865abe3 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:43.440679 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8f2f3a-6e43-441e-a55a-04520865abe3 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:43.441002 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8f2f3a-6e43-441e-a55a-04520865abe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:43.459908 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-cc8f2f3a-6e43-441e-a55a-04520865abe3 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:50:43.461251 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-cc8f2f3a-6e43-441e-a55a-04520865abe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:50:43.475408 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1378/2751] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:50:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:50:43.480248 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905b8c12-fca7-4d6d-bc8a-10950014113c None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:50:43.491575 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905b8c12-fca7-4d6d-bc8a-10950014113c None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:50:43.496387 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9271e5-3f26-4b6a-bba9-81ced25e072f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:50:43.497061 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9271e5-3f26-4b6a-bba9-81ced25e072f admin admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:43.497337 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9271e5-3f26-4b6a-bba9-81ced25e072f admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:43.497609 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9271e5-3f26-4b6a-bba9-81ced25e072f admin admin] PATH_INFO: `/v3/domains` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:43.498360 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9271e5-3f26-4b6a-bba9-81ced25e072f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:50:43.498661 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9271e5-3f26-4b6a-bba9-81ced25e072f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:50:43.500298 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9271e5-3f26-4b6a-bba9-81ced25e072f admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:50:43.512726 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1374/2752] 10.222.0.70 () {58 vars in 1152 bytes} [Mon Jul 11 14:50:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:50:43.517255 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8f2f3a-6e43-441e-a55a-04520865abe3 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:50:43.535211 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8f2f3a-6e43-441e-a55a-04520865abe3 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:50:43.539975 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d91cd3-0fad-41e1-ade7-9ddea7f52250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:50:43.540676 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d91cd3-0fad-41e1-ade7-9ddea7f52250 admin admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:43.541641 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d91cd3-0fad-41e1-ade7-9ddea7f52250 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:43.541931 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d91cd3-0fad-41e1-ade7-9ddea7f52250 admin admin] PATH_INFO: `/v3/projects` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:43.542675 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d91cd3-0fad-41e1-ade7-9ddea7f52250 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:50:43.544770 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d91cd3-0fad-41e1-ade7-9ddea7f52250 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:50:43.580557 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1379/2753] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jul 11 14:50:43 2022] POST /identity/v3/projects => generated 373 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:50:43.585489 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9271e5-3f26-4b6a-bba9-81ced25e072f admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:50:43.595578 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9271e5-3f26-4b6a-bba9-81ced25e072f admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:50:43.651898 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2a0d27-414c-497e-80b7-700ffe9103a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:50:43.652602 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2a0d27-414c-497e-80b7-700ffe9103a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:43.652886 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2a0d27-414c-497e-80b7-700ffe9103a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:43.653164 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2a0d27-414c-497e-80b7-700ffe9103a2 admin admin] PATH_INFO: `/v3/users` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:43.653848 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2a0d27-414c-497e-80b7-700ffe9103a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:50:43.655782 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2a0d27-414c-497e-80b7-700ffe9103a2 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:50:43.674350 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1375/2754] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jul 11 14:50:43 2022] POST /identity/v3/users => generated 287 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:50:43.679108 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d91cd3-0fad-41e1-ade7-9ddea7f52250 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:50:43.689911 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d91cd3-0fad-41e1-ade7-9ddea7f52250 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:50:43.695483 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152ac266-d15f-440c-aaee-3fbf0d80d7a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:50:43.696146 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152ac266-d15f-440c-aaee-3fbf0d80d7a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:43.696485 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152ac266-d15f-440c-aaee-3fbf0d80d7a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:43.696763 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152ac266-d15f-440c-aaee-3fbf0d80d7a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:43.697491 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152ac266-d15f-440c-aaee-3fbf0d80d7a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:50:43.699106 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152ac266-d15f-440c-aaee-3fbf0d80d7a6 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:50:43.709580 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1380/2755] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:50:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:50:43.713738 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2a0d27-414c-497e-80b7-700ffe9103a2 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:50:43.723772 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2a0d27-414c-497e-80b7-700ffe9103a2 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:50:43.728569 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecb4b35-186a-4acf-8586-39f381419aae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:50:43.729225 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecb4b35-186a-4acf-8586-39f381419aae admin admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:43.729503 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecb4b35-186a-4acf-8586-39f381419aae admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:43.729776 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecb4b35-186a-4acf-8586-39f381419aae admin admin] PATH_INFO: `/v3/roles` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:43.730497 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecb4b35-186a-4acf-8586-39f381419aae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:50:43.732072 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecb4b35-186a-4acf-8586-39f381419aae admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:50:43.742676 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1376/2756] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:50:43 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:50:43.746824 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152ac266-d15f-440c-aaee-3fbf0d80d7a6 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:50:43.758003 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152ac266-d15f-440c-aaee-3fbf0d80d7a6 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:50:43.763014 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9d7557-99d6-4e55-abdb-3c554fb08bb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:50:43.763912 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9d7557-99d6-4e55-abdb-3c554fb08bb1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:43.764217 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9d7557-99d6-4e55-abdb-3c554fb08bb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:43.764516 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9d7557-99d6-4e55-abdb-3c554fb08bb1 admin admin] PATH_INFO: `/v3/projects/eb4b30652b6b4d9abebac0dc0fbf9f9c/users/68c7f714cc1e47d58595762ab5764d36/roles/8eff41f243c843ed95505a488ca6eada` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:43.779481 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9d7557-99d6-4e55-abdb-3c554fb08bb1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb4b30652b6b4d9abebac0dc0fbf9f9c, user_id=68c7f714cc1e47d58595762ab5764d36, role_id=8eff41f243c843ed95505a488ca6eada)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:50:43.782165 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9d7557-99d6-4e55-abdb-3c554fb08bb1 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:50:43.796123 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1381/2757] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jul 11 14:50:43 2022] PUT /identity/v3/projects/eb4b30652b6b4d9abebac0dc0fbf9f9c/users/68c7f714cc1e47d58595762ab5764d36/roles/8eff41f243c843ed95505a488ca6eada => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:50:43.863405 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad4fbd8-d677-4b85-8746-104626cecb8c None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:43.863653 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad4fbd8-d677-4b85-8746-104626cecb8c None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:43.863869 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad4fbd8-d677-4b85-8746-104626cecb8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:43.891205 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-6ad4fbd8-d677-4b85-8746-104626cecb8c None None] MFA Rules not processed for user `68c7f714cc1e47d58595762ab5764d36`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:50:43.892432 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-6ad4fbd8-d677-4b85-8746-104626cecb8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:50:43.956408 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1377/2758] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:50:43 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:50:43.967296 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9d7557-99d6-4e55-abdb-3c554fb08bb1 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:50:43.969015 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-bf9d7557-99d6-4e55-abdb-3c554fb08bb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:50:43.991877 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:50:44.028093 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9d7557-99d6-4e55-abdb-3c554fb08bb1 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:50:44.031733 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f24fda4-d0c3-40cf-b219-6e84c2d45bee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '868e7c2dec264512b972c8736d659c34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:50:44.032400 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f24fda4-d0c3-40cf-b219-6e84c2d45bee service cinder] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:44.032681 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f24fda4-d0c3-40cf-b219-6e84c2d45bee service cinder] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:44.032957 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f24fda4-d0c3-40cf-b219-6e84c2d45bee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:44.041250 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f24fda4-d0c3-40cf-b219-6e84c2d45bee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:50:44.042682 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f24fda4-d0c3-40cf-b219-6e84c2d45bee service cinder] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:50:44.051861 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1382/2759] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:50:43 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:50:45.416845 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8e4907-e97e-4fa3-ad47-59249200bb3a None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:45.417341 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8e4907-e97e-4fa3-ad47-59249200bb3a None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:45.417436 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8e4907-e97e-4fa3-ad47-59249200bb3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:45.435468 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-7e8e4907-e97e-4fa3-ad47-59249200bb3a None None] MFA Rules not processed for user `68c7f714cc1e47d58595762ab5764d36`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:50:45.436750 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-7e8e4907-e97e-4fa3-ad47-59249200bb3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:50:45.444131 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1378/2760] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:50:45 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:50:45.740360 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f24fda4-d0c3-40cf-b219-6e84c2d45bee service cinder] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:50:45.741774 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-7f24fda4-d0c3-40cf-b219-6e84c2d45bee service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:50:45.804336 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f24fda4-d0c3-40cf-b219-6e84c2d45bee service cinder] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:50:45.808175 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec053f41-3bb4-440e-be32-46a160f893f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20eede5ccd834862b00123310b5c3975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:50:45.808864 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec053f41-3bb4-440e-be32-46a160f893f7 service neutron] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:45.809146 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec053f41-3bb4-440e-be32-46a160f893f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:45.809421 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec053f41-3bb4-440e-be32-46a160f893f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:45.811464 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-ec053f41-3bb4-440e-be32-46a160f893f7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:50:45.887303 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec053f41-3bb4-440e-be32-46a160f893f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:50:45.888877 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec053f41-3bb4-440e-be32-46a160f893f7 service neutron] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:50:45.906805 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1383/2761] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:50:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:50:50.014579 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8e4907-e97e-4fa3-ad47-59249200bb3a None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:50:50.016279 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-7e8e4907-e97e-4fa3-ad47-59249200bb3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:50:50.031343 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8e4907-e97e-4fa3-ad47-59249200bb3a None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:50:50.036550 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d873e2e8-c86f-48ba-9c11-e8bedee83c2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:50:50.037432 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d873e2e8-c86f-48ba-9c11-e8bedee83c2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:50.037712 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d873e2e8-c86f-48ba-9c11-e8bedee83c2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:50.037990 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d873e2e8-c86f-48ba-9c11-e8bedee83c2b admin admin] PATH_INFO: `/v3/users/8d5ccf016a41426cb589005da57bbf6f` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:50.039195 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d873e2e8-c86f-48ba-9c11-e8bedee83c2b admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d5ccf016a41426cb589005da57bbf6f)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:50:50.041276 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d873e2e8-c86f-48ba-9c11-e8bedee83c2b admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:50:50.046254 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:50:50.093673 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-d873e2e8-c86f-48ba-9c11-e8bedee83c2b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d5ccf016a41426cb589005da57bbf6f'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:50:50.101864 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-d873e2e8-c86f-48ba-9c11-e8bedee83c2b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d5ccf016a41426cb589005da57bbf6f'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:50:50.110053 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-d873e2e8-c86f-48ba-9c11-e8bedee83c2b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d5ccf016a41426cb589005da57bbf6f'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:50:50.110806 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-d873e2e8-c86f-48ba-9c11-e8bedee83c2b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d5ccf016a41426cb589005da57bbf6f'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:50:50.111578 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-d873e2e8-c86f-48ba-9c11-e8bedee83c2b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d5ccf016a41426cb589005da57bbf6f'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:50:50.130531 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1379/2762] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jul 11 14:50:50 2022] DELETE /identity/v3/users/8d5ccf016a41426cb589005da57bbf6f => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:50:50.309369 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec053f41-3bb4-440e-be32-46a160f893f7 service neutron] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:50:50.321245 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec053f41-3bb4-440e-be32-46a160f893f7 service neutron] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:50:50.382095 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6c7d25-9983-42a8-afff-33a49232bf3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:50:50.382862 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6c7d25-9983-42a8-afff-33a49232bf3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:50.383160 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6c7d25-9983-42a8-afff-33a49232bf3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:50.383441 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6c7d25-9983-42a8-afff-33a49232bf3f admin admin] PATH_INFO: `/v3/projects/5a076f0bf242483497f1297c87240c2d` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:50.384674 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6c7d25-9983-42a8-afff-33a49232bf3f admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a076f0bf242483497f1297c87240c2d)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:50:50.386620 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6c7d25-9983-42a8-afff-33a49232bf3f admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:50:50.403009 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:50:50.435011 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-fa6c7d25-9983-42a8-afff-33a49232bf3f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a076f0bf242483497f1297c87240c2d', 'request_id': 'req-fa6c7d25-9983-42a8-afff-33a49232bf3f'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:50:50.440851 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-fa6c7d25-9983-42a8-afff-33a49232bf3f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a076f0bf242483497f1297c87240c2d', 'request_id': 'req-fa6c7d25-9983-42a8-afff-33a49232bf3f'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:50:50.447133 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-fa6c7d25-9983-42a8-afff-33a49232bf3f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a076f0bf242483497f1297c87240c2d', 'request_id': 'req-fa6c7d25-9983-42a8-afff-33a49232bf3f'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:50:50.460407 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-fa6c7d25-9983-42a8-afff-33a49232bf3f admin admin] The token cache is being invalidate because project 5a076f0bf242483497f1297c87240c2d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:50:50.460703 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-fa6c7d25-9983-42a8-afff-33a49232bf3f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:50:50.461353 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-fa6c7d25-9983-42a8-afff-33a49232bf3f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:50:50.462887 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1384/2763] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jul 11 14:50:50 2022] DELETE /identity/v3/projects/5a076f0bf242483497f1297c87240c2d => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:50:50.467855 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b999e9ce-a979-4037-ac60-d26e3af51d70 None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:50.468147 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b999e9ce-a979-4037-ac60-d26e3af51d70 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:50.468464 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b999e9ce-a979-4037-ac60-d26e3af51d70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:50.487245 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-b999e9ce-a979-4037-ac60-d26e3af51d70 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:50:50.488557 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-b999e9ce-a979-4037-ac60-d26e3af51d70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:50:50.547448 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1380/2764] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:50:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:50:50.555296 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86e19a5-9d8d-411d-ab82-583ba7da8367 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:50.555580 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86e19a5-9d8d-411d-ab82-583ba7da8367 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:50.556381 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86e19a5-9d8d-411d-ab82-583ba7da8367 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:50.574627 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-f86e19a5-9d8d-411d-ab82-583ba7da8367 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:50:50.575847 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-f86e19a5-9d8d-411d-ab82-583ba7da8367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:50:50.585107 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1385/2765] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:50:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:50:50.589341 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b999e9ce-a979-4037-ac60-d26e3af51d70 None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:50:50.600252 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b999e9ce-a979-4037-ac60-d26e3af51d70 None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:50:50.605034 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6040b63-afae-483a-b461-b8557d1178ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:50:50.605685 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6040b63-afae-483a-b461-b8557d1178ca admin admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:50.605963 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6040b63-afae-483a-b461-b8557d1178ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:50.606237 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6040b63-afae-483a-b461-b8557d1178ca admin admin] PATH_INFO: `/v3/domains` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:50.606954 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6040b63-afae-483a-b461-b8557d1178ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:50:50.607257 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6040b63-afae-483a-b461-b8557d1178ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:50:50.608884 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6040b63-afae-483a-b461-b8557d1178ca admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:50:50.620716 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1381/2766] 10.222.0.70 () {58 vars in 1152 bytes} [Mon Jul 11 14:50:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:50:50.625071 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86e19a5-9d8d-411d-ab82-583ba7da8367 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:50:50.634831 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86e19a5-9d8d-411d-ab82-583ba7da8367 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:50:50.639528 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04055771-2ba4-44a6-a799-55bd7c079a6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:50:50.640189 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04055771-2ba4-44a6-a799-55bd7c079a6a admin admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:50.640505 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04055771-2ba4-44a6-a799-55bd7c079a6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:50.640784 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04055771-2ba4-44a6-a799-55bd7c079a6a admin admin] PATH_INFO: `/v3/projects` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:50.641496 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04055771-2ba4-44a6-a799-55bd7c079a6a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:50:50.643953 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04055771-2ba4-44a6-a799-55bd7c079a6a admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:50:50.680028 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1386/2767] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jul 11 14:50:50 2022] POST /identity/v3/projects => generated 377 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:50:50.684126 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6040b63-afae-483a-b461-b8557d1178ca admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:50:50.694911 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6040b63-afae-483a-b461-b8557d1178ca admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:50:50.757384 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701c39f9-7089-4fee-8899-0ba6baa64036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:50:50.758101 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701c39f9-7089-4fee-8899-0ba6baa64036 admin admin] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:50.758391 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701c39f9-7089-4fee-8899-0ba6baa64036 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:50.758671 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701c39f9-7089-4fee-8899-0ba6baa64036 admin admin] PATH_INFO: `/v3/users` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:50.759380 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701c39f9-7089-4fee-8899-0ba6baa64036 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:50:50.761346 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701c39f9-7089-4fee-8899-0ba6baa64036 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:50:50.778823 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:50:50.787945 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1382/2768] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jul 11 14:50:50 2022] POST /identity/v3/users => generated 289 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:50:50.788989 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04055771-2ba4-44a6-a799-55bd7c079a6a admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:50:50.800267 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04055771-2ba4-44a6-a799-55bd7c079a6a admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:50:50.804934 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6365dca4-ccb6-4aa6-917f-eb363a21744b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:50:50.805601 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6365dca4-ccb6-4aa6-917f-eb363a21744b admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:50.805886 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6365dca4-ccb6-4aa6-917f-eb363a21744b admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:50.806161 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6365dca4-ccb6-4aa6-917f-eb363a21744b admin admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:50.806915 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6365dca4-ccb6-4aa6-917f-eb363a21744b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:50:50.808547 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6365dca4-ccb6-4aa6-917f-eb363a21744b admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:50:50.820814 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1387/2769] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:50:50 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 14:50:50.825184 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701c39f9-7089-4fee-8899-0ba6baa64036 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:50:50.837051 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701c39f9-7089-4fee-8899-0ba6baa64036 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:50:50.842000 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc153758-1b9d-4106-b6b1-218c8526804e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:50:50.842738 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc153758-1b9d-4106-b6b1-218c8526804e admin admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:50.843094 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc153758-1b9d-4106-b6b1-218c8526804e admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:50.843443 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc153758-1b9d-4106-b6b1-218c8526804e admin admin] PATH_INFO: `/v3/roles` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:50.844271 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc153758-1b9d-4106-b6b1-218c8526804e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:50:50.846016 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc153758-1b9d-4106-b6b1-218c8526804e admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:50:50.857304 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1383/2770] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:50:50 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:50:50.861636 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6365dca4-ccb6-4aa6-917f-eb363a21744b admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:50:50.872037 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6365dca4-ccb6-4aa6-917f-eb363a21744b admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:50:50.877049 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13573721-5ef5-4b4e-aa3b-a3475c646cde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:50:50.878661 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13573721-5ef5-4b4e-aa3b-a3475c646cde admin admin] REQUEST_METHOD: `PUT` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:50.878948 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13573721-5ef5-4b4e-aa3b-a3475c646cde admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:50.879228 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13573721-5ef5-4b4e-aa3b-a3475c646cde admin admin] PATH_INFO: `/v3/projects/62003c2ea3d548a1981a33e35cd63866/users/391b6d99bbf34fb48432424356ae9a03/roles/8eff41f243c843ed95505a488ca6eada` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:50.895487 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13573721-5ef5-4b4e-aa3b-a3475c646cde admin admin] RBAC: Authorizing `identity:create_grant(project_id=62003c2ea3d548a1981a33e35cd63866, user_id=391b6d99bbf34fb48432424356ae9a03, role_id=8eff41f243c843ed95505a488ca6eada)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:50:50.898430 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13573721-5ef5-4b4e-aa3b-a3475c646cde admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:50:50.912348 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1388/2771] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jul 11 14:50:50 2022] PUT /identity/v3/projects/62003c2ea3d548a1981a33e35cd63866/users/391b6d99bbf34fb48432424356ae9a03/roles/8eff41f243c843ed95505a488ca6eada => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:50:50.917334 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf6fe15-8888-4540-950a-7a155301f760 None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:50.917624 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf6fe15-8888-4540-950a-7a155301f760 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:50.917902 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf6fe15-8888-4540-950a-7a155301f760 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:50.936368 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-1cf6fe15-8888-4540-950a-7a155301f760 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:50:50.937578 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-1cf6fe15-8888-4540-950a-7a155301f760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:50:51.014586 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1384/2772] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:50:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:50:51.024999 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13573721-5ef5-4b4e-aa3b-a3475c646cde admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:50:51.026722 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-13573721-5ef5-4b4e-aa3b-a3475c646cde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:50:51.085635 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13573721-5ef5-4b4e-aa3b-a3475c646cde admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:50:51.089041 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2841249d-bc83-44ef-97f2-14c2463dd17a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20eede5ccd834862b00123310b5c3975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:50:51.089689 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2841249d-bc83-44ef-97f2-14c2463dd17a service neutron] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:51.089978 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2841249d-bc83-44ef-97f2-14c2463dd17a service neutron] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:51.090259 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2841249d-bc83-44ef-97f2-14c2463dd17a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:51.100419 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2841249d-bc83-44ef-97f2-14c2463dd17a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:50:51.101868 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2841249d-bc83-44ef-97f2-14c2463dd17a service neutron] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:50:51.111570 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1389/2773] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:50:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:50:55.377549 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b2164c-308a-4c41-8fd4-ddbd68691b2c None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:55.378192 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b2164c-308a-4c41-8fd4-ddbd68691b2c None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:55.378302 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b2164c-308a-4c41-8fd4-ddbd68691b2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:55.406793 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-12b2164c-308a-4c41-8fd4-ddbd68691b2c None None] MFA Rules not processed for user `391b6d99bbf34fb48432424356ae9a03`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:50:55.408025 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-12b2164c-308a-4c41-8fd4-ddbd68691b2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:50:55.478231 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1385/2774] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:50:55 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:50:55.493761 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2841249d-bc83-44ef-97f2-14c2463dd17a service neutron] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:50:55.495208 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-2841249d-bc83-44ef-97f2-14c2463dd17a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:50:55.544708 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:50:55.586470 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2841249d-bc83-44ef-97f2-14c2463dd17a service neutron] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:50:55.593879 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b1f6cf-a14e-4aa3-9788-6efe92d358e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4f8c0d696af4bd5a205ca8e9110b8cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:50:55.594548 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b1f6cf-a14e-4aa3-9788-6efe92d358e9 service nova] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:55.594841 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b1f6cf-a14e-4aa3-9788-6efe92d358e9 service nova] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:55.595126 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b1f6cf-a14e-4aa3-9788-6efe92d358e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:55.603543 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b1f6cf-a14e-4aa3-9788-6efe92d358e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:50:55.605179 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b1f6cf-a14e-4aa3-9788-6efe92d358e9 service nova] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:50:55.614973 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1390/2775] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:50:55 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:50:57.149035 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c73fdc-c250-4d19-98d4-b910f2c2b55c None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:57.149571 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c73fdc-c250-4d19-98d4-b910f2c2b55c None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:57.149669 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c73fdc-c250-4d19-98d4-b910f2c2b55c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:57.168552 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-e1c73fdc-c250-4d19-98d4-b910f2c2b55c None None] MFA Rules not processed for user `391b6d99bbf34fb48432424356ae9a03`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:50:57.169756 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-e1c73fdc-c250-4d19-98d4-b910f2c2b55c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:50:57.177474 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1386/2776] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:50:57 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:51:02.665348 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fa02f0-5d62-4e25-81a9-2da19545b394 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:02.665871 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fa02f0-5d62-4e25-81a9-2da19545b394 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:02.666031 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fa02f0-5d62-4e25-81a9-2da19545b394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:02.691278 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-96fa02f0-5d62-4e25-81a9-2da19545b394 None None] MFA Rules not processed for user `2ef7b195b623456aa0b12dac0a4bf4d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:51:02.692991 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-96fa02f0-5d62-4e25-81a9-2da19545b394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:51:02.772165 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1391/2777] 10.222.0.70 () {58 vars in 1009 bytes} [Mon Jul 11 14:51:02 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:51:02.825608 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c73fdc-c250-4d19-98d4-b910f2c2b55c None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:51:02.827266 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-e1c73fdc-c250-4d19-98d4-b910f2c2b55c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:51:02.914417 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c73fdc-c250-4d19-98d4-b910f2c2b55c None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:51:02.919474 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8251aed8-aead-4664-8eaa-b96790528fcf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0217add2f5e74a80a1a33b160cc57a2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:51:02.920137 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8251aed8-aead-4664-8eaa-b96790528fcf service swift] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:02.920452 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8251aed8-aead-4664-8eaa-b96790528fcf service swift] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:02.920789 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8251aed8-aead-4664-8eaa-b96790528fcf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:02.930709 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8251aed8-aead-4664-8eaa-b96790528fcf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:51:02.932247 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8251aed8-aead-4664-8eaa-b96790528fcf service swift] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:51:02.942545 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1387/2778] 10.222.0.70 () {60 vars in 1384 bytes} [Mon Jul 11 14:51:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 14:51:03.520222 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fa02f0-5d62-4e25-81a9-2da19545b394 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:51:03.530674 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fa02f0-5d62-4e25-81a9-2da19545b394 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:51:03.536520 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3929854-e331-4338-a6cf-4f744df76a66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20eede5ccd834862b00123310b5c3975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:51:03.537621 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3929854-e331-4338-a6cf-4f744df76a66 service neutron] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:03.538088 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3929854-e331-4338-a6cf-4f744df76a66 service neutron] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:03.538434 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3929854-e331-4338-a6cf-4f744df76a66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:03.540341 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-b3929854-e331-4338-a6cf-4f744df76a66 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:51:03.563300 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3929854-e331-4338-a6cf-4f744df76a66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:51:03.564854 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3929854-e331-4338-a6cf-4f744df76a66 service neutron] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:51:03.579000 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88ea326-fe4e-4bbc-8885-4d99f03c86a4 None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:03.579384 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88ea326-fe4e-4bbc-8885-4d99f03c86a4 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:03.579628 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1392/2779] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:51:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:51:03.579783 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88ea326-fe4e-4bbc-8885-4d99f03c86a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:03.587487 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=100 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:51:03.601562 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-b88ea326-fe4e-4bbc-8885-4d99f03c86a4 None None] MFA Rules not processed for user `2ef7b195b623456aa0b12dac0a4bf4d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:51:03.603099 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-b88ea326-fe4e-4bbc-8885-4d99f03c86a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:51:03.613206 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1388/2780] 10.222.0.70 () {58 vars in 967 bytes} [Mon Jul 11 14:51:03 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:51:03.631713 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3929854-e331-4338-a6cf-4f744df76a66 service neutron] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:51:03.644481 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3929854-e331-4338-a6cf-4f744df76a66 service neutron] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:51:03.654142 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186dfa31-b3d7-458f-82a1-4d656c0d7b1e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0217add2f5e74a80a1a33b160cc57a2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:51:03.654893 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186dfa31-b3d7-458f-82a1-4d656c0d7b1e service swift] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:03.655884 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186dfa31-b3d7-458f-82a1-4d656c0d7b1e service swift] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:03.656406 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186dfa31-b3d7-458f-82a1-4d656c0d7b1e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:03.669085 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186dfa31-b3d7-458f-82a1-4d656c0d7b1e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:51:03.671138 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186dfa31-b3d7-458f-82a1-4d656c0d7b1e service swift] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:51:03.684160 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1393/2781] 10.222.0.70 () {60 vars in 1384 bytes} [Mon Jul 11 14:51:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 14:51:03.922885 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec169de-9fe7-4eff-9d54-29088658a630 None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:03.923374 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec169de-9fe7-4eff-9d54-29088658a630 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:03.923495 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec169de-9fe7-4eff-9d54-29088658a630 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:03.943208 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-dec169de-9fe7-4eff-9d54-29088658a630 None None] MFA Rules not processed for user `2ef7b195b623456aa0b12dac0a4bf4d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:51:03.944423 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-dec169de-9fe7-4eff-9d54-29088658a630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:51:03.952082 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1389/2782] 10.222.0.70 () {58 vars in 1009 bytes} [Mon Jul 11 14:51:03 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:51:03.963864 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186dfa31-b3d7-458f-82a1-4d656c0d7b1e service swift] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:51:03.974615 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186dfa31-b3d7-458f-82a1-4d656c0d7b1e service swift] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:51:03.979606 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1200778-8a7e-4d35-b8d5-865351c1db92 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0217add2f5e74a80a1a33b160cc57a2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:51:03.980265 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1200778-8a7e-4d35-b8d5-865351c1db92 service swift] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:03.980548 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1200778-8a7e-4d35-b8d5-865351c1db92 service swift] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:03.980826 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1200778-8a7e-4d35-b8d5-865351c1db92 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:03.992063 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1200778-8a7e-4d35-b8d5-865351c1db92 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:51:03.994041 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1200778-8a7e-4d35-b8d5-865351c1db92 service swift] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:51:04.002592 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1394/2783] 10.222.0.70 () {60 vars in 1384 bytes} [Mon Jul 11 14:51:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 14:51:04.347331 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d6a8f3-b11a-40cd-8875-266a7017594f None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:04.347672 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d6a8f3-b11a-40cd-8875-266a7017594f None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:04.348042 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d6a8f3-b11a-40cd-8875-266a7017594f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:04.367570 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-a0d6a8f3-b11a-40cd-8875-266a7017594f None None] MFA Rules not processed for user `2ef7b195b623456aa0b12dac0a4bf4d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:51:04.368812 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-a0d6a8f3-b11a-40cd-8875-266a7017594f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:51:04.376050 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1390/2784] 10.222.0.70 () {58 vars in 967 bytes} [Mon Jul 11 14:51:04 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:51:04.388145 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1200778-8a7e-4d35-b8d5-865351c1db92 service swift] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:51:04.399522 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1200778-8a7e-4d35-b8d5-865351c1db92 service swift] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:51:04.404881 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310f6b52-d6c5-452b-9815-3af8422d4e59 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0217add2f5e74a80a1a33b160cc57a2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:51:04.405600 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310f6b52-d6c5-452b-9815-3af8422d4e59 service swift] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:04.405888 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310f6b52-d6c5-452b-9815-3af8422d4e59 service swift] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:04.406167 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310f6b52-d6c5-452b-9815-3af8422d4e59 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:04.415632 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310f6b52-d6c5-452b-9815-3af8422d4e59 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:51:04.417344 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310f6b52-d6c5-452b-9815-3af8422d4e59 service swift] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:51:04.426584 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1395/2785] 10.222.0.70 () {60 vars in 1384 bytes} [Mon Jul 11 14:51:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 14:51:04.785960 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d6a8f3-b11a-40cd-8875-266a7017594f None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:51:04.796575 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d6a8f3-b11a-40cd-8875-266a7017594f None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:51:04.801037 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc160f3-f070-49de-866e-6005df1ebf6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20eede5ccd834862b00123310b5c3975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:51:04.801697 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc160f3-f070-49de-866e-6005df1ebf6c service neutron] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:04.802451 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc160f3-f070-49de-866e-6005df1ebf6c service neutron] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:04.802451 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc160f3-f070-49de-866e-6005df1ebf6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:04.805047 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-adc160f3-f070-49de-866e-6005df1ebf6c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:51:04.820908 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc160f3-f070-49de-866e-6005df1ebf6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:51:04.822440 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc160f3-f070-49de-866e-6005df1ebf6c service neutron] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:51:04.834356 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1391/2786] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:51:04 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:51:06.506833 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310f6b52-d6c5-452b-9815-3af8422d4e59 service swift] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:51:06.508263 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-310f6b52-d6c5-452b-9815-3af8422d4e59 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:51:06.522986 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310f6b52-d6c5-452b-9815-3af8422d4e59 service swift] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:51:06.527517 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fceaec-1654-44ad-9757-72fc0438cc04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:51:06.528451 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fceaec-1654-44ad-9757-72fc0438cc04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:06.528735 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fceaec-1654-44ad-9757-72fc0438cc04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:06.529007 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fceaec-1654-44ad-9757-72fc0438cc04 admin admin] PATH_INFO: `/v3/users/68c7f714cc1e47d58595762ab5764d36` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:06.530192 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fceaec-1654-44ad-9757-72fc0438cc04 admin admin] RBAC: Authorizing `identity:delete_user(user_id=68c7f714cc1e47d58595762ab5764d36)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:51:06.532104 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fceaec-1654-44ad-9757-72fc0438cc04 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:51:06.592397 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-13fceaec-1654-44ad-9757-72fc0438cc04 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68c7f714cc1e47d58595762ab5764d36'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:51:06.600117 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-13fceaec-1654-44ad-9757-72fc0438cc04 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68c7f714cc1e47d58595762ab5764d36'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:51:06.607743 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-13fceaec-1654-44ad-9757-72fc0438cc04 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68c7f714cc1e47d58595762ab5764d36'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:51:06.608391 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-13fceaec-1654-44ad-9757-72fc0438cc04 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68c7f714cc1e47d58595762ab5764d36'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:51:06.609034 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-13fceaec-1654-44ad-9757-72fc0438cc04 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68c7f714cc1e47d58595762ab5764d36'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:51:06.617500 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:51:06.631055 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1396/2787] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jul 11 14:51:06 2022] DELETE /identity/v3/users/68c7f714cc1e47d58595762ab5764d36 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:51:06.635562 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cfac0e-8b77-4090-84a2-d84b07ba223d None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:06.636036 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cfac0e-8b77-4090-84a2-d84b07ba223d None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:06.636157 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cfac0e-8b77-4090-84a2-d84b07ba223d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:06.654721 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-e3cfac0e-8b77-4090-84a2-d84b07ba223d None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:51:06.655944 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-e3cfac0e-8b77-4090-84a2-d84b07ba223d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:51:06.716310 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1392/2788] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:51:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:51:06.726143 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fceaec-1654-44ad-9757-72fc0438cc04 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:51:06.727554 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-13fceaec-1654-44ad-9757-72fc0438cc04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:51:06.785902 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fceaec-1654-44ad-9757-72fc0438cc04 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:51:06.789593 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51df9fe1-6f29-49d5-92be-cb087b8c2cdc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20eede5ccd834862b00123310b5c3975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:51:06.790243 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51df9fe1-6f29-49d5-92be-cb087b8c2cdc service neutron] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:06.790526 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51df9fe1-6f29-49d5-92be-cb087b8c2cdc service neutron] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:06.790806 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51df9fe1-6f29-49d5-92be-cb087b8c2cdc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:06.800927 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51df9fe1-6f29-49d5-92be-cb087b8c2cdc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:51:06.802445 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51df9fe1-6f29-49d5-92be-cb087b8c2cdc service neutron] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:51:06.812492 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1397/2789] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:51:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:51:06.991302 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cfac0e-8b77-4090-84a2-d84b07ba223d None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:51:06.992809 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-e3cfac0e-8b77-4090-84a2-d84b07ba223d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:51:07.005349 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cfac0e-8b77-4090-84a2-d84b07ba223d None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:51:07.010430 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5265dc58-100a-4c0e-8202-65874465559b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:51:07.011334 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5265dc58-100a-4c0e-8202-65874465559b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:07.011618 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5265dc58-100a-4c0e-8202-65874465559b admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:07.011916 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5265dc58-100a-4c0e-8202-65874465559b admin admin] PATH_INFO: `/v3/projects/eb4b30652b6b4d9abebac0dc0fbf9f9c` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:07.013164 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5265dc58-100a-4c0e-8202-65874465559b admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb4b30652b6b4d9abebac0dc0fbf9f9c)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:51:07.015093 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5265dc58-100a-4c0e-8202-65874465559b admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:51:07.066530 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-5265dc58-100a-4c0e-8202-65874465559b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb4b30652b6b4d9abebac0dc0fbf9f9c', 'request_id': 'req-5265dc58-100a-4c0e-8202-65874465559b'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:51:07.072748 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-5265dc58-100a-4c0e-8202-65874465559b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb4b30652b6b4d9abebac0dc0fbf9f9c', 'request_id': 'req-5265dc58-100a-4c0e-8202-65874465559b'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:51:07.081573 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-5265dc58-100a-4c0e-8202-65874465559b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb4b30652b6b4d9abebac0dc0fbf9f9c', 'request_id': 'req-5265dc58-100a-4c0e-8202-65874465559b'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:51:07.092346 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-5265dc58-100a-4c0e-8202-65874465559b admin admin] The token cache is being invalidate because project eb4b30652b6b4d9abebac0dc0fbf9f9c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80534) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:51:07.092630 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-5265dc58-100a-4c0e-8202-65874465559b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:51:07.093300 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-5265dc58-100a-4c0e-8202-65874465559b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:51:07.094921 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1393/2790] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jul 11 14:51:06 2022] DELETE /identity/v3/projects/eb4b30652b6b4d9abebac0dc0fbf9f9c => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:51:07.101267 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b4c11c-e8f5-42ca-ad85-26ae6aec7e48 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:07.101552 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b4c11c-e8f5-42ca-ad85-26ae6aec7e48 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:07.101826 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b4c11c-e8f5-42ca-ad85-26ae6aec7e48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:07.119353 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-89b4c11c-e8f5-42ca-ad85-26ae6aec7e48 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:51:07.121156 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-89b4c11c-e8f5-42ca-ad85-26ae6aec7e48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:51:07.187302 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1398/2791] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:51:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:51:07.193569 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2388e79-e342-46d4-a96e-f80c456791a9 None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:07.194111 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2388e79-e342-46d4-a96e-f80c456791a9 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:07.194309 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2388e79-e342-46d4-a96e-f80c456791a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:07.213747 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-c2388e79-e342-46d4-a96e-f80c456791a9 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:51:07.214965 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-c2388e79-e342-46d4-a96e-f80c456791a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:51:07.224227 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1394/2792] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:51:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:51:07.228643 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b4c11c-e8f5-42ca-ad85-26ae6aec7e48 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:51:07.239169 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b4c11c-e8f5-42ca-ad85-26ae6aec7e48 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:51:07.243945 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894d204c-f8ff-4cf0-b19a-1815f8d41a52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:51:07.244730 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894d204c-f8ff-4cf0-b19a-1815f8d41a52 admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:07.245081 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894d204c-f8ff-4cf0-b19a-1815f8d41a52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:07.245429 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894d204c-f8ff-4cf0-b19a-1815f8d41a52 admin admin] PATH_INFO: `/v3/domains` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:07.246234 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894d204c-f8ff-4cf0-b19a-1815f8d41a52 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:51:07.246634 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894d204c-f8ff-4cf0-b19a-1815f8d41a52 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:51:07.248482 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894d204c-f8ff-4cf0-b19a-1815f8d41a52 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:51:07.262734 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1399/2793] 10.222.0.70 () {58 vars in 1152 bytes} [Mon Jul 11 14:51:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:51:07.266910 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2388e79-e342-46d4-a96e-f80c456791a9 None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:51:07.277083 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2388e79-e342-46d4-a96e-f80c456791a9 None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:51:07.281964 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9e64bc-9665-4184-84b0-ba1cae75e2d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:51:07.282631 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9e64bc-9665-4184-84b0-ba1cae75e2d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:07.282913 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9e64bc-9665-4184-84b0-ba1cae75e2d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:07.283192 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9e64bc-9665-4184-84b0-ba1cae75e2d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:07.284048 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9e64bc-9665-4184-84b0-ba1cae75e2d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:51:07.286611 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9e64bc-9665-4184-84b0-ba1cae75e2d5 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:51:07.326572 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1395/2794] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jul 11 14:51:07 2022] POST /identity/v3/projects => generated 399 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:51:07.330828 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894d204c-f8ff-4cf0-b19a-1815f8d41a52 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:51:07.341412 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894d204c-f8ff-4cf0-b19a-1815f8d41a52 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:51:07.399937 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9540224-7bce-4156-90a9-c3545a082481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:51:07.400632 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9540224-7bce-4156-90a9-c3545a082481 admin admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:07.400915 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9540224-7bce-4156-90a9-c3545a082481 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:07.401221 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9540224-7bce-4156-90a9-c3545a082481 admin admin] PATH_INFO: `/v3/users` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:07.401898 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9540224-7bce-4156-90a9-c3545a082481 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:51:07.403831 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9540224-7bce-4156-90a9-c3545a082481 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:51:07.427492 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1400/2795] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jul 11 14:51:07 2022] POST /identity/v3/users => generated 300 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:51:07.430173 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9e64bc-9665-4184-84b0-ba1cae75e2d5 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:51:07.442509 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9e64bc-9665-4184-84b0-ba1cae75e2d5 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:51:07.447244 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f86c45-cf6a-4ff9-a99b-0331df768c41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:51:07.447980 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f86c45-cf6a-4ff9-a99b-0331df768c41 admin admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:07.448190 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f86c45-cf6a-4ff9-a99b-0331df768c41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:07.448605 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f86c45-cf6a-4ff9-a99b-0331df768c41 admin admin] PATH_INFO: `/v3/roles` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:07.449282 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f86c45-cf6a-4ff9-a99b-0331df768c41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:51:07.451021 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f86c45-cf6a-4ff9-a99b-0331df768c41 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:51:07.462239 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1396/2796] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:51:07 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:51:07.466221 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9540224-7bce-4156-90a9-c3545a082481 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:51:07.476733 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9540224-7bce-4156-90a9-c3545a082481 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:51:07.481735 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb46e440-6c06-4bdc-90b8-5efe05235a1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:51:07.482406 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb46e440-6c06-4bdc-90b8-5efe05235a1e admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:07.482689 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb46e440-6c06-4bdc-90b8-5efe05235a1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:07.483076 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb46e440-6c06-4bdc-90b8-5efe05235a1e admin admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:07.483808 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb46e440-6c06-4bdc-90b8-5efe05235a1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:51:07.485443 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb46e440-6c06-4bdc-90b8-5efe05235a1e admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:51:07.492028 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:51:07.499079 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1401/2797] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:51:07 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:51:07.503454 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f86c45-cf6a-4ff9-a99b-0331df768c41 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:51:07.510500 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:51:07.514911 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f86c45-cf6a-4ff9-a99b-0331df768c41 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:51:07.521512 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de494e62-6284-4700-968e-0bf0e51b6fb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:51:07.522392 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de494e62-6284-4700-968e-0bf0e51b6fb4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:07.522985 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de494e62-6284-4700-968e-0bf0e51b6fb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:07.523624 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de494e62-6284-4700-968e-0bf0e51b6fb4 admin admin] PATH_INFO: `/v3/projects/aa77cb7872ec4aa189286eb19f1b8182/users/81aa8a46364446bb9de0a8a09eddf266/roles/8eff41f243c843ed95505a488ca6eada` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:07.540855 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de494e62-6284-4700-968e-0bf0e51b6fb4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa77cb7872ec4aa189286eb19f1b8182, user_id=81aa8a46364446bb9de0a8a09eddf266, role_id=8eff41f243c843ed95505a488ca6eada)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:51:07.543504 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de494e62-6284-4700-968e-0bf0e51b6fb4 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:51:07.563619 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1397/2798] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jul 11 14:51:07 2022] PUT /identity/v3/projects/aa77cb7872ec4aa189286eb19f1b8182/users/81aa8a46364446bb9de0a8a09eddf266/roles/8eff41f243c843ed95505a488ca6eada => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:51:07.574376 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69958c3-bd38-4bbc-8752-447c2a2b1cf8 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:07.574919 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69958c3-bd38-4bbc-8752-447c2a2b1cf8 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:07.574919 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69958c3-bd38-4bbc-8752-447c2a2b1cf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:07.603500 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-d69958c3-bd38-4bbc-8752-447c2a2b1cf8 None None] MFA Rules not processed for user `81aa8a46364446bb9de0a8a09eddf266`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:51:07.604815 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-d69958c3-bd38-4bbc-8752-447c2a2b1cf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:51:07.671654 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1402/2799] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:51:07 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:51:07.684037 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de494e62-6284-4700-968e-0bf0e51b6fb4 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:51:07.686158 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-de494e62-6284-4700-968e-0bf0e51b6fb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:51:07.747624 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de494e62-6284-4700-968e-0bf0e51b6fb4 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:51:07.751953 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8f2ca1-3d3d-4952-950a-2178175e6efd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '868e7c2dec264512b972c8736d659c34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:51:07.753788 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8f2ca1-3d3d-4952-950a-2178175e6efd service cinder] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:07.753788 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8f2ca1-3d3d-4952-950a-2178175e6efd service cinder] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:07.753788 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8f2ca1-3d3d-4952-950a-2178175e6efd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:07.762552 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8f2ca1-3d3d-4952-950a-2178175e6efd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:51:07.764003 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8f2ca1-3d3d-4952-950a-2178175e6efd service cinder] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:51:07.774615 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1398/2800] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:51:07 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:51:12.780913 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69958c3-bd38-4bbc-8752-447c2a2b1cf8 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:51:12.848681 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69958c3-bd38-4bbc-8752-447c2a2b1cf8 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:51:12.853389 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76d3b77-e4d0-469e-b35f-9de9594735d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:51:12.854276 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76d3b77-e4d0-469e-b35f-9de9594735d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:12.854558 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76d3b77-e4d0-469e-b35f-9de9594735d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:12.854837 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76d3b77-e4d0-469e-b35f-9de9594735d0 admin admin] PATH_INFO: `/v3/users/81aa8a46364446bb9de0a8a09eddf266` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:12.856041 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76d3b77-e4d0-469e-b35f-9de9594735d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=81aa8a46364446bb9de0a8a09eddf266)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:51:12.858063 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76d3b77-e4d0-469e-b35f-9de9594735d0 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:51:12.913115 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-b76d3b77-e4d0-469e-b35f-9de9594735d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81aa8a46364446bb9de0a8a09eddf266'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:51:12.922072 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-b76d3b77-e4d0-469e-b35f-9de9594735d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81aa8a46364446bb9de0a8a09eddf266'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:51:12.931883 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-b76d3b77-e4d0-469e-b35f-9de9594735d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81aa8a46364446bb9de0a8a09eddf266'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:51:12.932581 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-b76d3b77-e4d0-469e-b35f-9de9594735d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81aa8a46364446bb9de0a8a09eddf266'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:51:12.933227 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-b76d3b77-e4d0-469e-b35f-9de9594735d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81aa8a46364446bb9de0a8a09eddf266'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:51:12.957844 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1403/2801] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jul 11 14:51:12 2022] DELETE /identity/v3/users/81aa8a46364446bb9de0a8a09eddf266 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:51:12.962360 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82eeea9-2372-4e2a-a227-dcbc0456f8ca None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:12.962896 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82eeea9-2372-4e2a-a227-dcbc0456f8ca None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:12.962896 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82eeea9-2372-4e2a-a227-dcbc0456f8ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:12.982449 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-e82eeea9-2372-4e2a-a227-dcbc0456f8ca None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:51:12.983896 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-e82eeea9-2372-4e2a-a227-dcbc0456f8ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:51:13.065482 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1399/2802] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:51:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:51:13.075179 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76d3b77-e4d0-469e-b35f-9de9594735d0 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:51:13.076661 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-b76d3b77-e4d0-469e-b35f-9de9594735d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:51:13.089274 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:51:13.157191 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76d3b77-e4d0-469e-b35f-9de9594735d0 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:51:13.165902 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba14de7-6735-4965-911c-3bc1556910d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20eede5ccd834862b00123310b5c3975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:51:13.166614 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba14de7-6735-4965-911c-3bc1556910d2 service neutron] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:13.166901 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba14de7-6735-4965-911c-3bc1556910d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:13.167179 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba14de7-6735-4965-911c-3bc1556910d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:13.178119 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba14de7-6735-4965-911c-3bc1556910d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:51:13.180407 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba14de7-6735-4965-911c-3bc1556910d2 service neutron] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:51:13.193625 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1404/2803] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:51:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:51:13.507012 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82eeea9-2372-4e2a-a227-dcbc0456f8ca None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:51:13.508810 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-e82eeea9-2372-4e2a-a227-dcbc0456f8ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:51:13.525676 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82eeea9-2372-4e2a-a227-dcbc0456f8ca None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:51:13.531020 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4868fca2-565c-4141-9c6f-96c00aaa6e83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:51:13.532088 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4868fca2-565c-4141-9c6f-96c00aaa6e83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:13.532487 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4868fca2-565c-4141-9c6f-96c00aaa6e83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:13.533604 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4868fca2-565c-4141-9c6f-96c00aaa6e83 admin admin] PATH_INFO: `/v3/projects/aa77cb7872ec4aa189286eb19f1b8182` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:13.535065 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4868fca2-565c-4141-9c6f-96c00aaa6e83 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa77cb7872ec4aa189286eb19f1b8182)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:51:13.537490 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4868fca2-565c-4141-9c6f-96c00aaa6e83 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:51:13.603512 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-4868fca2-565c-4141-9c6f-96c00aaa6e83 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa77cb7872ec4aa189286eb19f1b8182', 'request_id': 'req-4868fca2-565c-4141-9c6f-96c00aaa6e83'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:51:13.611350 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-4868fca2-565c-4141-9c6f-96c00aaa6e83 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa77cb7872ec4aa189286eb19f1b8182', 'request_id': 'req-4868fca2-565c-4141-9c6f-96c00aaa6e83'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:51:13.621360 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-4868fca2-565c-4141-9c6f-96c00aaa6e83 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa77cb7872ec4aa189286eb19f1b8182', 'request_id': 'req-4868fca2-565c-4141-9c6f-96c00aaa6e83'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:51:13.635674 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-4868fca2-565c-4141-9c6f-96c00aaa6e83 admin admin] The token cache is being invalidate because project aa77cb7872ec4aa189286eb19f1b8182 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80534) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:51:13.636726 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-4868fca2-565c-4141-9c6f-96c00aaa6e83 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:51:13.637372 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-4868fca2-565c-4141-9c6f-96c00aaa6e83 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:51:13.638889 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1400/2804] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jul 11 14:51:13 2022] DELETE /identity/v3/projects/aa77cb7872ec4aa189286eb19f1b8182 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:51:23.187414 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=22 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:51:23.632584 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:51:48.013326 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba14de7-6735-4965-911c-3bc1556910d2 service neutron] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:51:48.015152 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-7ba14de7-6735-4965-911c-3bc1556910d2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:51:48.093602 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba14de7-6735-4965-911c-3bc1556910d2 service neutron] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:51:48.159406 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f87d746-f139-4af0-bd34-48bef29fd1cb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4f8c0d696af4bd5a205ca8e9110b8cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:51:48.160066 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f87d746-f139-4af0-bd34-48bef29fd1cb service nova] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:48.160391 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f87d746-f139-4af0-bd34-48bef29fd1cb service nova] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:48.160669 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f87d746-f139-4af0-bd34-48bef29fd1cb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:48.162446 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-2f87d746-f139-4af0-bd34-48bef29fd1cb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:51:48.174955 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f87d746-f139-4af0-bd34-48bef29fd1cb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:51:48.176581 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f87d746-f139-4af0-bd34-48bef29fd1cb service nova] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:51:48.187545 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1405/2805] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:51:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:51:48.983425 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d3e131-6ded-433b-ad24-935318b1919e None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:48.983925 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d3e131-6ded-433b-ad24-935318b1919e None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:48.984023 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d3e131-6ded-433b-ad24-935318b1919e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:49.034916 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-c6d3e131-6ded-433b-ad24-935318b1919e None None] MFA Rules not processed for user `2ef7b195b623456aa0b12dac0a4bf4d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:51:49.036133 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-c6d3e131-6ded-433b-ad24-935318b1919e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:51:49.099997 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1401/2806] 10.222.0.70 () {58 vars in 967 bytes} [Mon Jul 11 14:51:48 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:51:49.111788 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f87d746-f139-4af0-bd34-48bef29fd1cb service nova] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:51:49.113333 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-2f87d746-f139-4af0-bd34-48bef29fd1cb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:51:49.203372 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f87d746-f139-4af0-bd34-48bef29fd1cb service nova] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:51:49.209025 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c06c7b2-dda1-4162-9166-bb175f134a8d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0217add2f5e74a80a1a33b160cc57a2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:51:49.209670 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c06c7b2-dda1-4162-9166-bb175f134a8d service swift] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:49.209959 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c06c7b2-dda1-4162-9166-bb175f134a8d service swift] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:49.210236 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c06c7b2-dda1-4162-9166-bb175f134a8d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:49.215240 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=100 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:51:49.219775 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c06c7b2-dda1-4162-9166-bb175f134a8d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:51:49.222593 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c06c7b2-dda1-4162-9166-bb175f134a8d service swift] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:51:49.230828 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1406/2807] 10.222.0.70 () {60 vars in 1384 bytes} [Mon Jul 11 14:51:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 14:51:56.028122 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d3e131-6ded-433b-ad24-935318b1919e None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:51:56.029703 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-c6d3e131-6ded-433b-ad24-935318b1919e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:51:56.103299 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d3e131-6ded-433b-ad24-935318b1919e None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:51:56.107942 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8d23a6-c23f-4485-8759-7406d2ab1239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:51:56.108844 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8d23a6-c23f-4485-8759-7406d2ab1239 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:56.109133 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8d23a6-c23f-4485-8759-7406d2ab1239 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:56.109404 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8d23a6-c23f-4485-8759-7406d2ab1239 admin admin] PATH_INFO: `/v3/users/45cc9b4c6d0343b09a21c10721b4d95b` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:56.110608 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8d23a6-c23f-4485-8759-7406d2ab1239 admin admin] RBAC: Authorizing `identity:delete_user(user_id=45cc9b4c6d0343b09a21c10721b4d95b)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:51:56.113706 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8d23a6-c23f-4485-8759-7406d2ab1239 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:51:56.169660 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-7b8d23a6-c23f-4485-8759-7406d2ab1239 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45cc9b4c6d0343b09a21c10721b4d95b'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:51:56.177481 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-7b8d23a6-c23f-4485-8759-7406d2ab1239 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45cc9b4c6d0343b09a21c10721b4d95b'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:51:56.185511 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-7b8d23a6-c23f-4485-8759-7406d2ab1239 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45cc9b4c6d0343b09a21c10721b4d95b'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:51:56.186206 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-7b8d23a6-c23f-4485-8759-7406d2ab1239 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45cc9b4c6d0343b09a21c10721b4d95b'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:51:56.187107 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-7b8d23a6-c23f-4485-8759-7406d2ab1239 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45cc9b4c6d0343b09a21c10721b4d95b'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:51:56.195742 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:51:56.207354 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1402/2808] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jul 11 14:51:56 2022] DELETE /identity/v3/users/45cc9b4c6d0343b09a21c10721b4d95b => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:51:56.386479 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c06c7b2-dda1-4162-9166-bb175f134a8d service swift] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:51:56.399645 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c06c7b2-dda1-4162-9166-bb175f134a8d service swift] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:51:56.461168 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6da745c-dbf3-4a07-87ca-adcfda260d83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:51:56.462032 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6da745c-dbf3-4a07-87ca-adcfda260d83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:56.462314 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6da745c-dbf3-4a07-87ca-adcfda260d83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:56.462594 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6da745c-dbf3-4a07-87ca-adcfda260d83 admin admin] PATH_INFO: `/v3/projects/65a199ee30984747990dd7236d90fb6d` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:56.463837 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6da745c-dbf3-4a07-87ca-adcfda260d83 admin admin] RBAC: Authorizing `identity:delete_project(project_id=65a199ee30984747990dd7236d90fb6d)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:51:56.465829 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6da745c-dbf3-4a07-87ca-adcfda260d83 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:51:56.513526 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-b6da745c-dbf3-4a07-87ca-adcfda260d83 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65a199ee30984747990dd7236d90fb6d', 'request_id': 'req-b6da745c-dbf3-4a07-87ca-adcfda260d83'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:51:56.519903 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-b6da745c-dbf3-4a07-87ca-adcfda260d83 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65a199ee30984747990dd7236d90fb6d', 'request_id': 'req-b6da745c-dbf3-4a07-87ca-adcfda260d83'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:51:56.526116 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-b6da745c-dbf3-4a07-87ca-adcfda260d83 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65a199ee30984747990dd7236d90fb6d', 'request_id': 'req-b6da745c-dbf3-4a07-87ca-adcfda260d83'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:51:56.539255 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-b6da745c-dbf3-4a07-87ca-adcfda260d83 admin admin] The token cache is being invalidate because project 65a199ee30984747990dd7236d90fb6d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:51:56.539548 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-b6da745c-dbf3-4a07-87ca-adcfda260d83 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:51:56.540233 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-b6da745c-dbf3-4a07-87ca-adcfda260d83 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:51:56.541802 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1407/2809] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jul 11 14:51:56 2022] DELETE /identity/v3/projects/65a199ee30984747990dd7236d90fb6d => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:51:56.546101 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8d23a6-c23f-4485-8759-7406d2ab1239 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:51:56.547556 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-7b8d23a6-c23f-4485-8759-7406d2ab1239 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:51:56.561060 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8d23a6-c23f-4485-8759-7406d2ab1239 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:51:56.619728 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb3057e-3969-42f4-a415-2f69dd576e9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:51:56.620636 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb3057e-3969-42f4-a415-2f69dd576e9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:56.620926 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb3057e-3969-42f4-a415-2f69dd576e9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:56.621666 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb3057e-3969-42f4-a415-2f69dd576e9f admin admin] PATH_INFO: `/v3/users/076a2349f5794994942421f61b3dd756` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:56.622490 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb3057e-3969-42f4-a415-2f69dd576e9f admin admin] RBAC: Authorizing `identity:delete_user(user_id=076a2349f5794994942421f61b3dd756)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:51:56.624459 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb3057e-3969-42f4-a415-2f69dd576e9f admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:51:56.671378 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-9eb3057e-3969-42f4-a415-2f69dd576e9f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '076a2349f5794994942421f61b3dd756'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:51:56.678442 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-9eb3057e-3969-42f4-a415-2f69dd576e9f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '076a2349f5794994942421f61b3dd756'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:51:56.685798 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-9eb3057e-3969-42f4-a415-2f69dd576e9f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '076a2349f5794994942421f61b3dd756'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:51:56.686531 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-9eb3057e-3969-42f4-a415-2f69dd576e9f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '076a2349f5794994942421f61b3dd756'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:51:56.687269 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-9eb3057e-3969-42f4-a415-2f69dd576e9f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '076a2349f5794994942421f61b3dd756'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:51:56.707322 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1403/2810] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jul 11 14:51:56 2022] DELETE /identity/v3/users/076a2349f5794994942421f61b3dd756 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:51:56.885309 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6da745c-dbf3-4a07-87ca-adcfda260d83 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:51:56.886802 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-b6da745c-dbf3-4a07-87ca-adcfda260d83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:51:56.900240 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6da745c-dbf3-4a07-87ca-adcfda260d83 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:51:56.959058 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80d72d6-182d-4afd-8d60-185e67421b6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:51:56.959841 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80d72d6-182d-4afd-8d60-185e67421b6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:51:56.960126 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80d72d6-182d-4afd-8d60-185e67421b6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:51:56.960447 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80d72d6-182d-4afd-8d60-185e67421b6c admin admin] PATH_INFO: `/v3/projects/df5a95228d3e483586a8cae44fe1bac0` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:51:56.961619 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80d72d6-182d-4afd-8d60-185e67421b6c admin admin] RBAC: Authorizing `identity:delete_project(project_id=df5a95228d3e483586a8cae44fe1bac0)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:51:56.963694 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80d72d6-182d-4afd-8d60-185e67421b6c admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:51:56.995862 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:51:57.015522 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-e80d72d6-182d-4afd-8d60-185e67421b6c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df5a95228d3e483586a8cae44fe1bac0', 'request_id': 'req-e80d72d6-182d-4afd-8d60-185e67421b6c'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:51:57.021890 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-e80d72d6-182d-4afd-8d60-185e67421b6c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df5a95228d3e483586a8cae44fe1bac0', 'request_id': 'req-e80d72d6-182d-4afd-8d60-185e67421b6c'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:51:57.028271 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-e80d72d6-182d-4afd-8d60-185e67421b6c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df5a95228d3e483586a8cae44fe1bac0', 'request_id': 'req-e80d72d6-182d-4afd-8d60-185e67421b6c'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:51:57.041837 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-e80d72d6-182d-4afd-8d60-185e67421b6c admin admin] The token cache is being invalidate because project df5a95228d3e483586a8cae44fe1bac0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:51:57.042127 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-e80d72d6-182d-4afd-8d60-185e67421b6c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:51:57.042744 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-e80d72d6-182d-4afd-8d60-185e67421b6c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:51:57.044299 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1408/2811] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jul 11 14:51:56 2022] DELETE /identity/v3/projects/df5a95228d3e483586a8cae44fe1bac0 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:52:03.641953 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb3057e-3969-42f4-a415-2f69dd576e9f admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:52:03.644071 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-9eb3057e-3969-42f4-a415-2f69dd576e9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:52:03.701500 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb3057e-3969-42f4-a415-2f69dd576e9f admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:52:03.726788 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:52:03.754145 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15ec224-d6e2-4508-b6b9-420063c44ac5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20eede5ccd834862b00123310b5c3975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:52:03.754794 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15ec224-d6e2-4508-b6b9-420063c44ac5 service neutron] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:52:03.755078 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15ec224-d6e2-4508-b6b9-420063c44ac5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:52:03.755353 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15ec224-d6e2-4508-b6b9-420063c44ac5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:52:03.757216 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-d15ec224-d6e2-4508-b6b9-420063c44ac5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:52:03.769583 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15ec224-d6e2-4508-b6b9-420063c44ac5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:52:03.771050 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15ec224-d6e2-4508-b6b9-420063c44ac5 service neutron] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:52:03.779913 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1404/2812] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:52:03 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:52:07.038643 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:DELETE=6,keystone:SELECT=14,keystone:INSERT=1 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:52:13.775896 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=14 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:54:05.583442 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80d72d6-182d-4afd-8d60-185e67421b6c admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:54:05.585020 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-e80d72d6-182d-4afd-8d60-185e67421b6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:54:05.654639 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80d72d6-182d-4afd-8d60-185e67421b6c admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:54:05.660298 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abfa439-7531-4dbf-bbf1-3591b8b10c98 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bf25c7951dc4182996335ca1f0e56ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:54:05.660956 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abfa439-7531-4dbf-bbf1-3591b8b10c98 service placement] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:54:05.661245 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abfa439-7531-4dbf-bbf1-3591b8b10c98 service placement] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:54:05.661529 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abfa439-7531-4dbf-bbf1-3591b8b10c98 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:54:05.663332 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-9abfa439-7531-4dbf-bbf1-3591b8b10c98 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:54:05.675787 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abfa439-7531-4dbf-bbf1-3591b8b10c98 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:54:05.677598 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abfa439-7531-4dbf-bbf1-3591b8b10c98 service placement] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:54:05.687691 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1409/2813] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:54:05 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:54:15.683390 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=32 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:55:07.355399 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d4b871-8546-4fee-b324-adbcc130c3ff None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:55:07.356046 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d4b871-8546-4fee-b324-adbcc130c3ff None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:55:07.356046 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d4b871-8546-4fee-b324-adbcc130c3ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:55:07.373842 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-b9d4b871-8546-4fee-b324-adbcc130c3ff None None] MFA Rules not processed for user `391b6d99bbf34fb48432424356ae9a03`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:55:07.375073 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-b9d4b871-8546-4fee-b324-adbcc130c3ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:55:07.435677 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1405/2814] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:55:07 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:55:07.744893 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abfa439-7531-4dbf-bbf1-3591b8b10c98 service placement] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:55:07.746230 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-9abfa439-7531-4dbf-bbf1-3591b8b10c98 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:55:07.757978 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abfa439-7531-4dbf-bbf1-3591b8b10c98 service placement] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:55:07.761557 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2020be8-3775-41f8-b76f-63eda9f28ee0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20eede5ccd834862b00123310b5c3975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:55:07.762195 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2020be8-3775-41f8-b76f-63eda9f28ee0 service neutron] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:55:07.762482 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2020be8-3775-41f8-b76f-63eda9f28ee0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:55:07.762762 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2020be8-3775-41f8-b76f-63eda9f28ee0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:55:07.764602 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-d2020be8-3775-41f8-b76f-63eda9f28ee0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:55:07.774091 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2020be8-3775-41f8-b76f-63eda9f28ee0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:55:07.775532 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2020be8-3775-41f8-b76f-63eda9f28ee0 service neutron] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:55:07.784287 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1410/2815] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:55:07 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:55:08.104958 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d4b871-8546-4fee-b324-adbcc130c3ff None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:55:08.106467 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-b9d4b871-8546-4fee-b324-adbcc130c3ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:55:08.122016 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d4b871-8546-4fee-b324-adbcc130c3ff None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:55:08.127546 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9786d586-6482-4203-9fc9-06cd886f5d08 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bf25c7951dc4182996335ca1f0e56ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:55:08.128233 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9786d586-6482-4203-9fc9-06cd886f5d08 service placement] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:55:08.128515 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9786d586-6482-4203-9fc9-06cd886f5d08 service placement] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:55:08.128795 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9786d586-6482-4203-9fc9-06cd886f5d08 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:55:08.130564 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-9786d586-6482-4203-9fc9-06cd886f5d08 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:55:08.143075 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9786d586-6482-4203-9fc9-06cd886f5d08 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:55:08.144800 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9786d586-6482-4203-9fc9-06cd886f5d08 service placement] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:55:08.157688 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1406/2816] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:55:08 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:55:14.942200 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2020be8-3775-41f8-b76f-63eda9f28ee0 service neutron] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:55:14.943884 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-d2020be8-3775-41f8-b76f-63eda9f28ee0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:55:15.023960 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2020be8-3775-41f8-b76f-63eda9f28ee0 service neutron] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:55:15.029535 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6101fd95-7de0-4183-a67b-7edb17d54434 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4f8c0d696af4bd5a205ca8e9110b8cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:55:15.030360 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6101fd95-7de0-4183-a67b-7edb17d54434 service nova] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:55:15.030650 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6101fd95-7de0-4183-a67b-7edb17d54434 service nova] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:55:15.030940 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6101fd95-7de0-4183-a67b-7edb17d54434 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:55:15.032757 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-6101fd95-7de0-4183-a67b-7edb17d54434 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:55:15.045284 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6101fd95-7de0-4183-a67b-7edb17d54434 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:55:15.047028 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6101fd95-7de0-4183-a67b-7edb17d54434 service nova] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:55:15.057815 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1411/2817] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:55:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:55:18.150560 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=31 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:55:18.702625 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9786d586-6482-4203-9fc9-06cd886f5d08 service placement] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:55:18.715166 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9786d586-6482-4203-9fc9-06cd886f5d08 service placement] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:55:18.721378 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1d9ba8-f657-42ee-ba55-86a474845c33 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4f8c0d696af4bd5a205ca8e9110b8cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:55:18.722032 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1d9ba8-f657-42ee-ba55-86a474845c33 service nova] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:55:18.722319 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1d9ba8-f657-42ee-ba55-86a474845c33 service nova] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:55:18.722604 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1d9ba8-f657-42ee-ba55-86a474845c33 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:55:18.724440 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-2c1d9ba8-f657-42ee-ba55-86a474845c33 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:55:18.737611 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1d9ba8-f657-42ee-ba55-86a474845c33 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:55:18.739200 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1d9ba8-f657-42ee-ba55-86a474845c33 service nova] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:55:18.750511 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1407/2818] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:55:18 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:55:25.053457 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=40 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:55:28.745466 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=6 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:56:31.509754 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6101fd95-7de0-4183-a67b-7edb17d54434 service nova] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:31.511429 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-6101fd95-7de0-4183-a67b-7edb17d54434 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:31.526873 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6101fd95-7de0-4183-a67b-7edb17d54434 service nova] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:31.533748 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3f936a-6242-4c1a-b7e4-226cf87aadbd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4f8c0d696af4bd5a205ca8e9110b8cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:31.534387 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3f936a-6242-4c1a-b7e4-226cf87aadbd service nova] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:31.534671 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3f936a-6242-4c1a-b7e4-226cf87aadbd service nova] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:31.534947 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3f936a-6242-4c1a-b7e4-226cf87aadbd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:31.536757 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-1c3f936a-6242-4c1a-b7e4-226cf87aadbd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:31.548140 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3f936a-6242-4c1a-b7e4-226cf87aadbd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:31.549752 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3f936a-6242-4c1a-b7e4-226cf87aadbd service nova] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:31.559027 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1412/2819] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:56:31 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:56:32.976767 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1d9ba8-f657-42ee-ba55-86a474845c33 service nova] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:32.978173 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-2c1d9ba8-f657-42ee-ba55-86a474845c33 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:33.034213 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1d9ba8-f657-42ee-ba55-86a474845c33 service nova] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:33.037706 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb35a49c-15c7-489b-9974-0e1c7dce35ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '868e7c2dec264512b972c8736d659c34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:33.038345 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb35a49c-15c7-489b-9974-0e1c7dce35ac service cinder] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:33.038626 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb35a49c-15c7-489b-9974-0e1c7dce35ac service cinder] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:33.038904 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb35a49c-15c7-489b-9974-0e1c7dce35ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:33.040695 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-cb35a49c-15c7-489b-9974-0e1c7dce35ac service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:33.054374 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb35a49c-15c7-489b-9974-0e1c7dce35ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:33.055798 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb35a49c-15c7-489b-9974-0e1c7dce35ac service cinder] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:33.067714 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1408/2820] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:56:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:56:36.966967 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3f936a-6242-4c1a-b7e4-226cf87aadbd service nova] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:36.968395 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-1c3f936a-6242-4c1a-b7e4-226cf87aadbd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:36.979969 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3f936a-6242-4c1a-b7e4-226cf87aadbd service nova] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:36.984123 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31c7176-cba2-4d82-975c-e9b6fa4f575e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '868e7c2dec264512b972c8736d659c34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:36.984803 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31c7176-cba2-4d82-975c-e9b6fa4f575e service cinder] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:36.985087 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31c7176-cba2-4d82-975c-e9b6fa4f575e service cinder] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:36.985395 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31c7176-cba2-4d82-975c-e9b6fa4f575e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:36.987146 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-a31c7176-cba2-4d82-975c-e9b6fa4f575e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:37.001633 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31c7176-cba2-4d82-975c-e9b6fa4f575e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:37.003123 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31c7176-cba2-4d82-975c-e9b6fa4f575e service cinder] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:37.015416 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1413/2821] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:56:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:56:43.062589 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=26 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:56:47.009600 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=12 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:56:50.588666 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb35a49c-15c7-489b-9974-0e1c7dce35ac service cinder] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:50.590067 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-cb35a49c-15c7-489b-9974-0e1c7dce35ac service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:50.601426 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb35a49c-15c7-489b-9974-0e1c7dce35ac service cinder] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:50.604934 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcbc330-02e3-433e-abbd-3e587f0b50ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20eede5ccd834862b00123310b5c3975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:50.606082 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcbc330-02e3-433e-abbd-3e587f0b50ac service neutron] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:50.606431 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcbc330-02e3-433e-abbd-3e587f0b50ac service neutron] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:50.606699 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcbc330-02e3-433e-abbd-3e587f0b50ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:50.609756 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-adcbc330-02e3-433e-abbd-3e587f0b50ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:50.671838 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcbc330-02e3-433e-abbd-3e587f0b50ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:50.673297 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcbc330-02e3-433e-abbd-3e587f0b50ac service neutron] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:50.682718 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1409/2822] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:56:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:56:53.735350 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31c7176-cba2-4d82-975c-e9b6fa4f575e service cinder] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:53.753423 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31c7176-cba2-4d82-975c-e9b6fa4f575e service cinder] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:53.759019 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33d7aa7-8ee7-4104-83b9-433918cb0736 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bf25c7951dc4182996335ca1f0e56ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:53.759754 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33d7aa7-8ee7-4104-83b9-433918cb0736 service placement] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:53.760102 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33d7aa7-8ee7-4104-83b9-433918cb0736 service placement] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:53.760502 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33d7aa7-8ee7-4104-83b9-433918cb0736 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:53.763282 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-a33d7aa7-8ee7-4104-83b9-433918cb0736 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:53.776449 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33d7aa7-8ee7-4104-83b9-433918cb0736 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:53.779181 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33d7aa7-8ee7-4104-83b9-433918cb0736 service placement] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:53.790519 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1414/2823] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:56:53 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:56:53.805533 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcbc330-02e3-433e-abbd-3e587f0b50ac service neutron] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:53.808359 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-adcbc330-02e3-433e-abbd-3e587f0b50ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:53.825401 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcbc330-02e3-433e-abbd-3e587f0b50ac service neutron] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:53.833072 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db53ba59-328b-49b6-92b2-1f37935194e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:53.833961 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db53ba59-328b-49b6-92b2-1f37935194e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:53.834248 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db53ba59-328b-49b6-92b2-1f37935194e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:53.834521 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db53ba59-328b-49b6-92b2-1f37935194e7 admin admin] PATH_INFO: `/v3/users/391b6d99bbf34fb48432424356ae9a03` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:53.835737 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db53ba59-328b-49b6-92b2-1f37935194e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=391b6d99bbf34fb48432424356ae9a03)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:53.837877 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db53ba59-328b-49b6-92b2-1f37935194e7 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:53.887670 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-db53ba59-328b-49b6-92b2-1f37935194e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '391b6d99bbf34fb48432424356ae9a03'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:53.894817 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-db53ba59-328b-49b6-92b2-1f37935194e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '391b6d99bbf34fb48432424356ae9a03'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:53.902071 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-db53ba59-328b-49b6-92b2-1f37935194e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '391b6d99bbf34fb48432424356ae9a03'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:53.902870 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-db53ba59-328b-49b6-92b2-1f37935194e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '391b6d99bbf34fb48432424356ae9a03'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:53.903482 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-db53ba59-328b-49b6-92b2-1f37935194e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '391b6d99bbf34fb48432424356ae9a03'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:53.921445 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1410/2824] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jul 11 14:56:53 2022] DELETE /identity/v3/users/391b6d99bbf34fb48432424356ae9a03 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:56:54.095020 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33d7aa7-8ee7-4104-83b9-433918cb0736 service placement] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:54.106700 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33d7aa7-8ee7-4104-83b9-433918cb0736 service placement] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:54.168350 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1767f2-2e5e-4de9-8dd9-dbbd4bc1eec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:54.169211 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1767f2-2e5e-4de9-8dd9-dbbd4bc1eec8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:54.169492 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1767f2-2e5e-4de9-8dd9-dbbd4bc1eec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:54.169763 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1767f2-2e5e-4de9-8dd9-dbbd4bc1eec8 admin admin] PATH_INFO: `/v3/projects/62003c2ea3d548a1981a33e35cd63866` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:54.170948 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1767f2-2e5e-4de9-8dd9-dbbd4bc1eec8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=62003c2ea3d548a1981a33e35cd63866)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:54.172891 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1767f2-2e5e-4de9-8dd9-dbbd4bc1eec8 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:54.218112 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-4f1767f2-2e5e-4de9-8dd9-dbbd4bc1eec8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62003c2ea3d548a1981a33e35cd63866', 'request_id': 'req-4f1767f2-2e5e-4de9-8dd9-dbbd4bc1eec8'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:54.223475 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-4f1767f2-2e5e-4de9-8dd9-dbbd4bc1eec8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62003c2ea3d548a1981a33e35cd63866', 'request_id': 'req-4f1767f2-2e5e-4de9-8dd9-dbbd4bc1eec8'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:54.229487 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-4f1767f2-2e5e-4de9-8dd9-dbbd4bc1eec8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62003c2ea3d548a1981a33e35cd63866', 'request_id': 'req-4f1767f2-2e5e-4de9-8dd9-dbbd4bc1eec8'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:54.241468 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-4f1767f2-2e5e-4de9-8dd9-dbbd4bc1eec8 admin admin] The token cache is being invalidate because project 62003c2ea3d548a1981a33e35cd63866 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:56:54.241750 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-4f1767f2-2e5e-4de9-8dd9-dbbd4bc1eec8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:54.242361 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-4f1767f2-2e5e-4de9-8dd9-dbbd4bc1eec8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:56:54.243870 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1415/2825] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jul 11 14:56:54 2022] DELETE /identity/v3/projects/62003c2ea3d548a1981a33e35cd63866 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:56:54.250855 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da35aaf5-9300-4f43-93ba-6a1d5ea66154 None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:54.251152 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da35aaf5-9300-4f43-93ba-6a1d5ea66154 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:54.251437 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da35aaf5-9300-4f43-93ba-6a1d5ea66154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:54.270543 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-da35aaf5-9300-4f43-93ba-6a1d5ea66154 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:56:54.271744 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-da35aaf5-9300-4f43-93ba-6a1d5ea66154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:54.333227 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1411/2826] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:56:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:56:54.341143 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beea8a74-333d-413a-bba2-eefcc4a32acc None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:54.341453 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beea8a74-333d-413a-bba2-eefcc4a32acc None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:54.341736 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beea8a74-333d-413a-bba2-eefcc4a32acc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:54.359957 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-beea8a74-333d-413a-bba2-eefcc4a32acc None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:56:54.361204 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-beea8a74-333d-413a-bba2-eefcc4a32acc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:54.369170 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1416/2827] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:56:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:56:54.373766 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da35aaf5-9300-4f43-93ba-6a1d5ea66154 None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:54.383478 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da35aaf5-9300-4f43-93ba-6a1d5ea66154 None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:54.388272 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917f517a-a755-4422-8bcb-0945d296a6ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:54.388927 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917f517a-a755-4422-8bcb-0945d296a6ff admin admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:54.389211 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917f517a-a755-4422-8bcb-0945d296a6ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:54.389488 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917f517a-a755-4422-8bcb-0945d296a6ff admin admin] PATH_INFO: `/v3/domains` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:54.390217 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917f517a-a755-4422-8bcb-0945d296a6ff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:56:54.390525 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917f517a-a755-4422-8bcb-0945d296a6ff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:54.392112 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917f517a-a755-4422-8bcb-0945d296a6ff admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:54.393588 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:56:54.406168 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1412/2828] 10.222.0.70 () {58 vars in 1152 bytes} [Mon Jul 11 14:56:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:56:54.410235 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beea8a74-333d-413a-bba2-eefcc4a32acc None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:54.420041 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beea8a74-333d-413a-bba2-eefcc4a32acc None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:54.424692 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb317225-307e-48fb-88f6-67cf886eb8a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:54.425335 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb317225-307e-48fb-88f6-67cf886eb8a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:54.425618 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb317225-307e-48fb-88f6-67cf886eb8a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:54.425893 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb317225-307e-48fb-88f6-67cf886eb8a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:54.426584 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb317225-307e-48fb-88f6-67cf886eb8a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:54.428498 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb317225-307e-48fb-88f6-67cf886eb8a0 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:54.454389 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1417/2829] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jul 11 14:56:54 2022] POST /identity/v3/projects => generated 371 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:56:54.458447 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917f517a-a755-4422-8bcb-0945d296a6ff admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:54.468602 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917f517a-a755-4422-8bcb-0945d296a6ff admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:54.525104 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae6a700-e4af-428a-ab75-578a4ad6d3af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:54.525771 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae6a700-e4af-428a-ab75-578a4ad6d3af admin admin] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:54.526054 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae6a700-e4af-428a-ab75-578a4ad6d3af admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:54.526330 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae6a700-e4af-428a-ab75-578a4ad6d3af admin admin] PATH_INFO: `/v3/users` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:54.527023 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae6a700-e4af-428a-ab75-578a4ad6d3af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:54.529430 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae6a700-e4af-428a-ab75-578a4ad6d3af admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:54.549963 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1413/2830] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jul 11 14:56:54 2022] POST /identity/v3/users => generated 286 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:56:54.554080 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb317225-307e-48fb-88f6-67cf886eb8a0 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:54.565851 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb317225-307e-48fb-88f6-67cf886eb8a0 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:54.572420 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aceb324c-b51e-4ad5-9ee0-30b59ffd5e05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:54.573090 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceb324c-b51e-4ad5-9ee0-30b59ffd5e05 admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:54.573375 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceb324c-b51e-4ad5-9ee0-30b59ffd5e05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:54.573654 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceb324c-b51e-4ad5-9ee0-30b59ffd5e05 admin admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:54.575007 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aceb324c-b51e-4ad5-9ee0-30b59ffd5e05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:54.576305 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aceb324c-b51e-4ad5-9ee0-30b59ffd5e05 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:54.587051 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1418/2831] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:56:54 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:56:54.591881 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae6a700-e4af-428a-ab75-578a4ad6d3af admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:54.601948 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae6a700-e4af-428a-ab75-578a4ad6d3af admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:54.607187 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d413ce-5b51-4adf-89f9-9d2f6c0fd419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:54.607845 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d413ce-5b51-4adf-89f9-9d2f6c0fd419 admin admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:54.608128 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d413ce-5b51-4adf-89f9-9d2f6c0fd419 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:54.608444 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d413ce-5b51-4adf-89f9-9d2f6c0fd419 admin admin] PATH_INFO: `/v3/roles` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:54.609175 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d413ce-5b51-4adf-89f9-9d2f6c0fd419 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:54.610754 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d413ce-5b51-4adf-89f9-9d2f6c0fd419 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:54.620736 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1414/2832] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:56:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:56:54.625440 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aceb324c-b51e-4ad5-9ee0-30b59ffd5e05 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:54.640007 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aceb324c-b51e-4ad5-9ee0-30b59ffd5e05 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:54.646607 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473c9ccf-7506-4f24-8f5d-0a79eda703fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:54.647987 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473c9ccf-7506-4f24-8f5d-0a79eda703fd admin admin] REQUEST_METHOD: `PUT` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:54.648587 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473c9ccf-7506-4f24-8f5d-0a79eda703fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:54.649284 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473c9ccf-7506-4f24-8f5d-0a79eda703fd admin admin] PATH_INFO: `/v3/projects/8ddc2f4255204f2297ca28f458855406/users/224c6c17944943deab7027a71c48d902/roles/8eff41f243c843ed95505a488ca6eada` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:54.666807 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473c9ccf-7506-4f24-8f5d-0a79eda703fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ddc2f4255204f2297ca28f458855406, user_id=224c6c17944943deab7027a71c48d902, role_id=8eff41f243c843ed95505a488ca6eada)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:54.670146 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473c9ccf-7506-4f24-8f5d-0a79eda703fd admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:54.683160 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1419/2833] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jul 11 14:56:54 2022] PUT /identity/v3/projects/8ddc2f4255204f2297ca28f458855406/users/224c6c17944943deab7027a71c48d902/roles/8eff41f243c843ed95505a488ca6eada => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:56:54.688879 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee4caf5-d65f-4af7-8bf7-98b7b0033a01 None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:54.689166 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee4caf5-d65f-4af7-8bf7-98b7b0033a01 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:54.689442 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee4caf5-d65f-4af7-8bf7-98b7b0033a01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:54.707683 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-7ee4caf5-d65f-4af7-8bf7-98b7b0033a01 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:56:54.708938 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-7ee4caf5-d65f-4af7-8bf7-98b7b0033a01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:54.768219 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1415/2834] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:56:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:56:54.778350 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473c9ccf-7506-4f24-8f5d-0a79eda703fd admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:54.780185 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-473c9ccf-7506-4f24-8f5d-0a79eda703fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:54.795689 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:56:54.839180 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473c9ccf-7506-4f24-8f5d-0a79eda703fd admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:54.843824 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91144f5b-e653-4f4e-a9b5-13f9b145aaf6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20eede5ccd834862b00123310b5c3975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:54.844508 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91144f5b-e653-4f4e-a9b5-13f9b145aaf6 service neutron] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:54.844797 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91144f5b-e653-4f4e-a9b5-13f9b145aaf6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:54.845075 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91144f5b-e653-4f4e-a9b5-13f9b145aaf6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:54.855186 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91144f5b-e653-4f4e-a9b5-13f9b145aaf6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:54.857978 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91144f5b-e653-4f4e-a9b5-13f9b145aaf6 service neutron] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:54.868518 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1420/2835] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:56:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:56:55.502066 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cc6538-861a-427f-b7db-170c7705032b None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:55.502589 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cc6538-861a-427f-b7db-170c7705032b None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:55.502717 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cc6538-861a-427f-b7db-170c7705032b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:55.529611 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-a9cc6538-861a-427f-b7db-170c7705032b None None] MFA Rules not processed for user `224c6c17944943deab7027a71c48d902`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:56:55.530836 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-a9cc6538-861a-427f-b7db-170c7705032b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:55.600431 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1416/2836] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:56:55 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:56:55.605162 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91144f5b-e653-4f4e-a9b5-13f9b145aaf6 service neutron] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:55.616883 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91144f5b-e653-4f4e-a9b5-13f9b145aaf6 service neutron] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:55.622148 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e348d6d-464e-41e9-bd8e-13d895321d01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:55.622849 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e348d6d-464e-41e9-bd8e-13d895321d01 admin admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:55.623188 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e348d6d-464e-41e9-bd8e-13d895321d01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:55.623467 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e348d6d-464e-41e9-bd8e-13d895321d01 admin admin] PATH_INFO: `/v3/projects` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:55.624190 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e348d6d-464e-41e9-bd8e-13d895321d01 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:55.626152 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e348d6d-464e-41e9-bd8e-13d895321d01 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:55.655905 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1421/2837] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jul 11 14:56:55 2022] POST /identity/v3/projects => generated 371 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:56:55.660288 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cc6538-861a-427f-b7db-170c7705032b None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:55.666009 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:56:55.673975 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cc6538-861a-427f-b7db-170c7705032b None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:55.738059 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35301d80-fc19-49f9-9377-eb74c05aba29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:55.738861 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35301d80-fc19-49f9-9377-eb74c05aba29 admin admin] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:55.739198 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35301d80-fc19-49f9-9377-eb74c05aba29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:55.739476 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35301d80-fc19-49f9-9377-eb74c05aba29 admin admin] PATH_INFO: `/v3/users` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:55.740173 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35301d80-fc19-49f9-9377-eb74c05aba29 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:55.742150 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35301d80-fc19-49f9-9377-eb74c05aba29 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:55.766401 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e348d6d-464e-41e9-bd8e-13d895321d01 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:55.766815 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1417/2838] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jul 11 14:56:55 2022] POST /identity/v3/users => generated 292 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:56:55.776698 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e348d6d-464e-41e9-bd8e-13d895321d01 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:55.781947 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938cee55-2af5-4bba-aa5a-36f36b844df3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:55.782618 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938cee55-2af5-4bba-aa5a-36f36b844df3 admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:55.782902 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938cee55-2af5-4bba-aa5a-36f36b844df3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:55.783177 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938cee55-2af5-4bba-aa5a-36f36b844df3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:55.783903 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938cee55-2af5-4bba-aa5a-36f36b844df3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:55.785533 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938cee55-2af5-4bba-aa5a-36f36b844df3 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:55.796934 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1422/2839] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:56:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:56:55.801202 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35301d80-fc19-49f9-9377-eb74c05aba29 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:55.811714 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35301d80-fc19-49f9-9377-eb74c05aba29 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:55.817919 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3a105b-70a3-4847-86ff-08283ae9476a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:55.818806 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3a105b-70a3-4847-86ff-08283ae9476a admin admin] REQUEST_METHOD: `PUT` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:55.819090 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3a105b-70a3-4847-86ff-08283ae9476a admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:55.819370 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3a105b-70a3-4847-86ff-08283ae9476a admin admin] PATH_INFO: `/v3/projects/19af9178b4a041568bfaf826f00b5a2d/users/a1e684bdceac4204954840558a959258/roles/b46df176b0fe479da63c318db225bed4` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:55.835015 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3a105b-70a3-4847-86ff-08283ae9476a admin admin] RBAC: Authorizing `identity:create_grant(project_id=19af9178b4a041568bfaf826f00b5a2d, user_id=a1e684bdceac4204954840558a959258, role_id=b46df176b0fe479da63c318db225bed4)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:55.837712 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3a105b-70a3-4847-86ff-08283ae9476a admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:55.851111 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1418/2840] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jul 11 14:56:55 2022] PUT /identity/v3/projects/19af9178b4a041568bfaf826f00b5a2d/users/a1e684bdceac4204954840558a959258/roles/b46df176b0fe479da63c318db225bed4 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:56:55.855055 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938cee55-2af5-4bba-aa5a-36f36b844df3 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:55.866226 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938cee55-2af5-4bba-aa5a-36f36b844df3 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:55.921440 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef0f886-bfab-4b37-b23c-bf3f2b0fe1ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:55.922023 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef0f886-bfab-4b37-b23c-bf3f2b0fe1ed admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:55.922307 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef0f886-bfab-4b37-b23c-bf3f2b0fe1ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:55.922582 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef0f886-bfab-4b37-b23c-bf3f2b0fe1ed admin admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:55.923294 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef0f886-bfab-4b37-b23c-bf3f2b0fe1ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:55.924921 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef0f886-bfab-4b37-b23c-bf3f2b0fe1ed admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:55.935725 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1423/2841] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:56:55 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:56:55.939796 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3a105b-70a3-4847-86ff-08283ae9476a admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:55.950955 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3a105b-70a3-4847-86ff-08283ae9476a admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:55.955565 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb76f66-d522-4174-a35c-5a0553053242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:55.956471 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb76f66-d522-4174-a35c-5a0553053242 admin admin] REQUEST_METHOD: `PUT` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:55.956756 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb76f66-d522-4174-a35c-5a0553053242 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:55.957041 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb76f66-d522-4174-a35c-5a0553053242 admin admin] PATH_INFO: `/v3/projects/19af9178b4a041568bfaf826f00b5a2d/users/a1e684bdceac4204954840558a959258/roles/b46df176b0fe479da63c318db225bed4` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:55.959027 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb76f66-d522-4174-a35c-5a0553053242 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19af9178b4a041568bfaf826f00b5a2d, user_id=a1e684bdceac4204954840558a959258, role_id=b46df176b0fe479da63c318db225bed4)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:55.961709 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb76f66-d522-4174-a35c-5a0553053242 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:55.973168 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1419/2842] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jul 11 14:56:55 2022] PUT /identity/v3/projects/19af9178b4a041568bfaf826f00b5a2d/users/a1e684bdceac4204954840558a959258/roles/b46df176b0fe479da63c318db225bed4 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:56:56.590633 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce54828-cd57-48f9-97b6-5d916c61e33c None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:56.591170 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce54828-cd57-48f9-97b6-5d916c61e33c None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:56.591684 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce54828-cd57-48f9-97b6-5d916c61e33c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:56.619391 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-dce54828-cd57-48f9-97b6-5d916c61e33c None None] MFA Rules not processed for user `a1e684bdceac4204954840558a959258`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:56:56.620647 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-dce54828-cd57-48f9-97b6-5d916c61e33c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:56.694611 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1424/2843] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:56:56 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:56:56.706150 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32380e61-0afc-4641-8227-6fbe388559f4 None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:56.706684 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32380e61-0afc-4641-8227-6fbe388559f4 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:56.706845 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32380e61-0afc-4641-8227-6fbe388559f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:56.724738 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-32380e61-0afc-4641-8227-6fbe388559f4 None None] MFA Rules not processed for user `224c6c17944943deab7027a71c48d902`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:56:56.725953 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-32380e61-0afc-4641-8227-6fbe388559f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:56.787849 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1420/2844] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:56:56 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:56:56.799919 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce54828-cd57-48f9-97b6-5d916c61e33c None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:56.801334 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-dce54828-cd57-48f9-97b6-5d916c61e33c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:56.807532 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:56:56.881225 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce54828-cd57-48f9-97b6-5d916c61e33c None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:56.886868 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f259d68-c7fe-42e1-b829-9a6e6fec9a84 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4f8c0d696af4bd5a205ca8e9110b8cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:56.887591 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f259d68-c7fe-42e1-b829-9a6e6fec9a84 service nova] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:56.887876 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f259d68-c7fe-42e1-b829-9a6e6fec9a84 service nova] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:56.888155 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f259d68-c7fe-42e1-b829-9a6e6fec9a84 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:56.895924 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f259d68-c7fe-42e1-b829-9a6e6fec9a84 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:56.897549 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f259d68-c7fe-42e1-b829-9a6e6fec9a84 service nova] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:56.906513 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1425/2845] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:56:56 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:56:57.132615 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32380e61-0afc-4641-8227-6fbe388559f4 None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:57.134011 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-32380e61-0afc-4641-8227-6fbe388559f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:57.193068 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32380e61-0afc-4641-8227-6fbe388559f4 None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:57.196658 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9718445-a23e-479c-bd18-da364eeb1e24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20eede5ccd834862b00123310b5c3975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:57.197312 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9718445-a23e-479c-bd18-da364eeb1e24 service neutron] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:57.197598 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9718445-a23e-479c-bd18-da364eeb1e24 service neutron] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:57.197881 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9718445-a23e-479c-bd18-da364eeb1e24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:57.199894 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-b9718445-a23e-479c-bd18-da364eeb1e24 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:56:57.210310 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9718445-a23e-479c-bd18-da364eeb1e24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:56:57.211764 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9718445-a23e-479c-bd18-da364eeb1e24 service neutron] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:56:57.220793 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1421/2846] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:56:57 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:56:59.963075 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f259d68-c7fe-42e1-b829-9a6e6fec9a84 service nova] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:56:59.978579 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f259d68-c7fe-42e1-b829-9a6e6fec9a84 service nova] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:56:59.985276 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480f2e97-7d01-4bae-a57f-da2a8436103c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4f8c0d696af4bd5a205ca8e9110b8cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:56:59.985957 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480f2e97-7d01-4bae-a57f-da2a8436103c service nova] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:56:59.986239 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480f2e97-7d01-4bae-a57f-da2a8436103c service nova] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:56:59.986564 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480f2e97-7d01-4bae-a57f-da2a8436103c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:56:59.992805 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-480f2e97-7d01-4bae-a57f-da2a8436103c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:57:00.006178 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480f2e97-7d01-4bae-a57f-da2a8436103c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:00.007756 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480f2e97-7d01-4bae-a57f-da2a8436103c service nova] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:00.020861 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1426/2847] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:56:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:57:07.217088 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=94,keystone:INSERT=5 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:57:07.504613 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9718445-a23e-479c-bd18-da364eeb1e24 service neutron] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:07.514502 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9718445-a23e-479c-bd18-da364eeb1e24 service neutron] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:07.518621 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e46188-e25a-4dbf-b72c-9dfd1c9a2cd3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20eede5ccd834862b00123310b5c3975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:07.519631 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e46188-e25a-4dbf-b72c-9dfd1c9a2cd3 service neutron] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:07.519912 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e46188-e25a-4dbf-b72c-9dfd1c9a2cd3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:07.520189 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e46188-e25a-4dbf-b72c-9dfd1c9a2cd3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:07.522139 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-e9e46188-e25a-4dbf-b72c-9dfd1c9a2cd3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:57:07.533243 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e46188-e25a-4dbf-b72c-9dfd1c9a2cd3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:07.534713 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e46188-e25a-4dbf-b72c-9dfd1c9a2cd3 service neutron] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:07.544062 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1422/2848] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:57:07 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:57:10.015675 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=38 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:57:10.826781 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480f2e97-7d01-4bae-a57f-da2a8436103c service nova] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:10.828170 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-480f2e97-7d01-4bae-a57f-da2a8436103c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:57:10.885162 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480f2e97-7d01-4bae-a57f-da2a8436103c service nova] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:10.889432 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0454c688-ddb5-4431-aa88-aabca8b53010 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '868e7c2dec264512b972c8736d659c34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:10.890078 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0454c688-ddb5-4431-aa88-aabca8b53010 service cinder] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:10.890363 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0454c688-ddb5-4431-aa88-aabca8b53010 service cinder] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:10.890639 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0454c688-ddb5-4431-aa88-aabca8b53010 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:10.899540 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0454c688-ddb5-4431-aa88-aabca8b53010 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:10.900998 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0454c688-ddb5-4431-aa88-aabca8b53010 service cinder] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:10.911270 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1427/2849] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:57:10 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:57:17.539767 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=6 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:57:20.907139 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=26 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:57:30.209881 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e46188-e25a-4dbf-b72c-9dfd1c9a2cd3 service neutron] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:30.211311 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-e9e46188-e25a-4dbf-b72c-9dfd1c9a2cd3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:57:30.278552 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0454c688-ddb5-4431-aa88-aabca8b53010 service cinder] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:30.287316 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e46188-e25a-4dbf-b72c-9dfd1c9a2cd3 service neutron] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:30.295377 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2fad51-8a3b-4326-8150-b087c95e1a88 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bf25c7951dc4182996335ca1f0e56ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:30.296048 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2fad51-8a3b-4326-8150-b087c95e1a88 service placement] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:30.296370 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2fad51-8a3b-4326-8150-b087c95e1a88 service placement] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:30.296654 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2fad51-8a3b-4326-8150-b087c95e1a88 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:30.298495 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-0c2fad51-8a3b-4326-8150-b087c95e1a88 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:57:30.310838 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2fad51-8a3b-4326-8150-b087c95e1a88 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:30.312507 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2fad51-8a3b-4326-8150-b087c95e1a88 service placement] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:30.324151 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1423/2850] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:57:30 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:57:30.348667 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0454c688-ddb5-4431-aa88-aabca8b53010 service cinder] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:30.353429 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826cd368-89bf-4173-9676-bed22ea4c507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:30.354426 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826cd368-89bf-4173-9676-bed22ea4c507 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:30.354947 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826cd368-89bf-4173-9676-bed22ea4c507 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:30.355515 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826cd368-89bf-4173-9676-bed22ea4c507 admin admin] PATH_INFO: `/v3/users/224c6c17944943deab7027a71c48d902` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:30.357519 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826cd368-89bf-4173-9676-bed22ea4c507 admin admin] RBAC: Authorizing `identity:delete_user(user_id=224c6c17944943deab7027a71c48d902)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:30.359943 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826cd368-89bf-4173-9676-bed22ea4c507 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:30.407030 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-826cd368-89bf-4173-9676-bed22ea4c507 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '224c6c17944943deab7027a71c48d902'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:30.413842 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-826cd368-89bf-4173-9676-bed22ea4c507 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '224c6c17944943deab7027a71c48d902'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:30.421068 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-826cd368-89bf-4173-9676-bed22ea4c507 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '224c6c17944943deab7027a71c48d902'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:30.421686 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-826cd368-89bf-4173-9676-bed22ea4c507 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '224c6c17944943deab7027a71c48d902'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:30.422299 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-826cd368-89bf-4173-9676-bed22ea4c507 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '224c6c17944943deab7027a71c48d902'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:30.439622 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1428/2851] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jul 11 14:57:30 2022] DELETE /identity/v3/users/224c6c17944943deab7027a71c48d902 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:57:30.625344 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2fad51-8a3b-4326-8150-b087c95e1a88 service placement] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:30.638241 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2fad51-8a3b-4326-8150-b087c95e1a88 service placement] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:30.699982 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9182693-988e-4372-afe2-9a7f0faee714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:30.700800 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9182693-988e-4372-afe2-9a7f0faee714 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:30.701115 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9182693-988e-4372-afe2-9a7f0faee714 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:30.701392 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9182693-988e-4372-afe2-9a7f0faee714 admin admin] PATH_INFO: `/v3/projects/8ddc2f4255204f2297ca28f458855406` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:30.702604 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9182693-988e-4372-afe2-9a7f0faee714 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ddc2f4255204f2297ca28f458855406)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:30.704618 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9182693-988e-4372-afe2-9a7f0faee714 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:30.751045 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-e9182693-988e-4372-afe2-9a7f0faee714 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ddc2f4255204f2297ca28f458855406', 'request_id': 'req-e9182693-988e-4372-afe2-9a7f0faee714'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:30.757105 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-e9182693-988e-4372-afe2-9a7f0faee714 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ddc2f4255204f2297ca28f458855406', 'request_id': 'req-e9182693-988e-4372-afe2-9a7f0faee714'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:30.765363 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-e9182693-988e-4372-afe2-9a7f0faee714 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ddc2f4255204f2297ca28f458855406', 'request_id': 'req-e9182693-988e-4372-afe2-9a7f0faee714'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:30.775551 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-e9182693-988e-4372-afe2-9a7f0faee714 admin admin] The token cache is being invalidate because project 8ddc2f4255204f2297ca28f458855406 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80534) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:57:30.775837 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-e9182693-988e-4372-afe2-9a7f0faee714 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:30.777104 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-e9182693-988e-4372-afe2-9a7f0faee714 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:30.778675 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1424/2852] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jul 11 14:57:30 2022] DELETE /identity/v3/projects/8ddc2f4255204f2297ca28f458855406 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:57:30.782680 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826cd368-89bf-4173-9676-bed22ea4c507 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:30.784110 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-826cd368-89bf-4173-9676-bed22ea4c507 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:57:30.798510 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826cd368-89bf-4173-9676-bed22ea4c507 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:30.855006 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfc27eb-42ae-4896-9ff2-78025e211957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:30.856120 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfc27eb-42ae-4896-9ff2-78025e211957 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:30.856434 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfc27eb-42ae-4896-9ff2-78025e211957 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:30.856701 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfc27eb-42ae-4896-9ff2-78025e211957 admin admin] PATH_INFO: `/v3/users/a1e684bdceac4204954840558a959258` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:30.857937 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfc27eb-42ae-4896-9ff2-78025e211957 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1e684bdceac4204954840558a959258)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:30.859850 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfc27eb-42ae-4896-9ff2-78025e211957 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:30.882719 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:57:30.911435 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-1dfc27eb-42ae-4896-9ff2-78025e211957 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1e684bdceac4204954840558a959258'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:30.919626 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-1dfc27eb-42ae-4896-9ff2-78025e211957 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1e684bdceac4204954840558a959258'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:30.927036 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-1dfc27eb-42ae-4896-9ff2-78025e211957 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1e684bdceac4204954840558a959258'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:30.927676 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-1dfc27eb-42ae-4896-9ff2-78025e211957 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1e684bdceac4204954840558a959258'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:30.928367 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-1dfc27eb-42ae-4896-9ff2-78025e211957 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1e684bdceac4204954840558a959258'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:30.949892 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1429/2853] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jul 11 14:57:30 2022] DELETE /identity/v3/users/a1e684bdceac4204954840558a959258 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:57:31.123611 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9182693-988e-4372-afe2-9a7f0faee714 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:31.125426 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-e9182693-988e-4372-afe2-9a7f0faee714 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:57:31.139055 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9182693-988e-4372-afe2-9a7f0faee714 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:31.157916 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:57:31.199323 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb01414-d936-4e50-afae-f913dddc80f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:31.200171 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb01414-d936-4e50-afae-f913dddc80f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:31.200471 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb01414-d936-4e50-afae-f913dddc80f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:31.200743 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb01414-d936-4e50-afae-f913dddc80f9 admin admin] PATH_INFO: `/v3/projects/19af9178b4a041568bfaf826f00b5a2d` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:31.201905 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb01414-d936-4e50-afae-f913dddc80f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=19af9178b4a041568bfaf826f00b5a2d)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:31.203852 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb01414-d936-4e50-afae-f913dddc80f9 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:31.251645 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-7eb01414-d936-4e50-afae-f913dddc80f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19af9178b4a041568bfaf826f00b5a2d', 'request_id': 'req-7eb01414-d936-4e50-afae-f913dddc80f9'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:31.257852 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-7eb01414-d936-4e50-afae-f913dddc80f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19af9178b4a041568bfaf826f00b5a2d', 'request_id': 'req-7eb01414-d936-4e50-afae-f913dddc80f9'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:31.264950 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-7eb01414-d936-4e50-afae-f913dddc80f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19af9178b4a041568bfaf826f00b5a2d', 'request_id': 'req-7eb01414-d936-4e50-afae-f913dddc80f9'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:31.275978 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-7eb01414-d936-4e50-afae-f913dddc80f9 admin admin] The token cache is being invalidate because project 19af9178b4a041568bfaf826f00b5a2d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80534) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:57:31.277180 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-7eb01414-d936-4e50-afae-f913dddc80f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:31.277934 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-7eb01414-d936-4e50-afae-f913dddc80f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:31.282238 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1425/2854] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jul 11 14:57:31 2022] DELETE /identity/v3/projects/19af9178b4a041568bfaf826f00b5a2d => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:57:31.288109 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3745baec-c361-4104-a9e3-4238abe32818 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:31.288674 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3745baec-c361-4104-a9e3-4238abe32818 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:31.288958 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3745baec-c361-4104-a9e3-4238abe32818 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:31.308221 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-3745baec-c361-4104-a9e3-4238abe32818 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:57:31.309454 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-3745baec-c361-4104-a9e3-4238abe32818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:57:31.368139 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1430/2855] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:57:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:57:31.376046 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54f19fa-e0fe-4fb6-be50-6f7b0dd1e421 None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:31.376355 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54f19fa-e0fe-4fb6-be50-6f7b0dd1e421 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:31.376636 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54f19fa-e0fe-4fb6-be50-6f7b0dd1e421 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:31.395201 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-b54f19fa-e0fe-4fb6-be50-6f7b0dd1e421 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:57:31.396451 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-b54f19fa-e0fe-4fb6-be50-6f7b0dd1e421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:57:31.405426 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1426/2856] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:57:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:57:31.409578 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3745baec-c361-4104-a9e3-4238abe32818 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:31.419319 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3745baec-c361-4104-a9e3-4238abe32818 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:31.423830 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a66e88-fb0d-4fc8-a477-413a844f4cef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:31.424511 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a66e88-fb0d-4fc8-a477-413a844f4cef admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:31.424792 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a66e88-fb0d-4fc8-a477-413a844f4cef admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:31.425063 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a66e88-fb0d-4fc8-a477-413a844f4cef admin admin] PATH_INFO: `/v3/domains` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:31.425777 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a66e88-fb0d-4fc8-a477-413a844f4cef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:57:31.426080 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a66e88-fb0d-4fc8-a477-413a844f4cef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:31.427648 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a66e88-fb0d-4fc8-a477-413a844f4cef admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:31.440008 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1431/2857] 10.222.0.70 () {58 vars in 1152 bytes} [Mon Jul 11 14:57:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:57:31.444574 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54f19fa-e0fe-4fb6-be50-6f7b0dd1e421 None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:31.455372 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54f19fa-e0fe-4fb6-be50-6f7b0dd1e421 None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:31.459931 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547b0a32-9f99-4244-b98b-e403c4308148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:31.460619 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547b0a32-9f99-4244-b98b-e403c4308148 admin admin] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:31.460905 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547b0a32-9f99-4244-b98b-e403c4308148 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:31.461182 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547b0a32-9f99-4244-b98b-e403c4308148 admin admin] PATH_INFO: `/v3/projects` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:31.461881 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547b0a32-9f99-4244-b98b-e403c4308148 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:31.464258 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547b0a32-9f99-4244-b98b-e403c4308148 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:31.489229 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1427/2858] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jul 11 14:57:31 2022] POST /identity/v3/projects => generated 373 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:57:31.493635 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a66e88-fb0d-4fc8-a477-413a844f4cef admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:31.504261 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a66e88-fb0d-4fc8-a477-413a844f4cef admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:31.562876 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4092c819-500a-48e4-a395-b0387ea3b360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:31.563547 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4092c819-500a-48e4-a395-b0387ea3b360 admin admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:31.563833 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4092c819-500a-48e4-a395-b0387ea3b360 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:31.564114 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4092c819-500a-48e4-a395-b0387ea3b360 admin admin] PATH_INFO: `/v3/users` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:31.564847 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4092c819-500a-48e4-a395-b0387ea3b360 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:31.566757 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4092c819-500a-48e4-a395-b0387ea3b360 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:31.587028 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1432/2859] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jul 11 14:57:31 2022] POST /identity/v3/users => generated 287 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:57:31.591258 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547b0a32-9f99-4244-b98b-e403c4308148 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:31.601451 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547b0a32-9f99-4244-b98b-e403c4308148 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:31.606543 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1688883b-4252-4f7b-a1ec-3bd288cf6526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:31.607196 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1688883b-4252-4f7b-a1ec-3bd288cf6526 admin admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:31.607481 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1688883b-4252-4f7b-a1ec-3bd288cf6526 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:31.607757 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1688883b-4252-4f7b-a1ec-3bd288cf6526 admin admin] PATH_INFO: `/v3/roles` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:31.608529 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1688883b-4252-4f7b-a1ec-3bd288cf6526 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:31.610111 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1688883b-4252-4f7b-a1ec-3bd288cf6526 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:31.621517 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1428/2860] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:57:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:57:31.625313 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4092c819-500a-48e4-a395-b0387ea3b360 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:31.635052 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4092c819-500a-48e4-a395-b0387ea3b360 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:31.640635 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1175ba4c-50d7-47c7-a809-8b6934acdb71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:31.641285 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1175ba4c-50d7-47c7-a809-8b6934acdb71 admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:31.641571 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1175ba4c-50d7-47c7-a809-8b6934acdb71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:31.641891 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1175ba4c-50d7-47c7-a809-8b6934acdb71 admin admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:31.642593 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1175ba4c-50d7-47c7-a809-8b6934acdb71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:31.644161 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1175ba4c-50d7-47c7-a809-8b6934acdb71 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:31.654232 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1433/2861] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:57:31 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:57:31.658208 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1688883b-4252-4f7b-a1ec-3bd288cf6526 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:31.668123 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1688883b-4252-4f7b-a1ec-3bd288cf6526 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:31.672691 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817a0973-259f-4efa-8c3e-991e8a85db43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:31.673565 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817a0973-259f-4efa-8c3e-991e8a85db43 admin admin] REQUEST_METHOD: `PUT` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:31.673853 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817a0973-259f-4efa-8c3e-991e8a85db43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:31.674132 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817a0973-259f-4efa-8c3e-991e8a85db43 admin admin] PATH_INFO: `/v3/projects/51acbf8603054c3c83e1f25a9754f254/users/810ff74261d64386a007a3414931ca57/roles/8eff41f243c843ed95505a488ca6eada` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:31.689356 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817a0973-259f-4efa-8c3e-991e8a85db43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=51acbf8603054c3c83e1f25a9754f254, user_id=810ff74261d64386a007a3414931ca57, role_id=8eff41f243c843ed95505a488ca6eada)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:31.692263 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817a0973-259f-4efa-8c3e-991e8a85db43 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:31.705570 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1429/2862] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jul 11 14:57:31 2022] PUT /identity/v3/projects/51acbf8603054c3c83e1f25a9754f254/users/810ff74261d64386a007a3414931ca57/roles/8eff41f243c843ed95505a488ca6eada => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:57:31.715776 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e31936-ff64-4714-a64e-6c98e7e48708 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:31.716102 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e31936-ff64-4714-a64e-6c98e7e48708 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:31.716510 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e31936-ff64-4714-a64e-6c98e7e48708 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:31.723137 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:57:31.745499 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-44e31936-ff64-4714-a64e-6c98e7e48708 None None] MFA Rules not processed for user `810ff74261d64386a007a3414931ca57`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:57:31.746829 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-44e31936-ff64-4714-a64e-6c98e7e48708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:57:31.810669 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1434/2863] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:57:31 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:57:31.815313 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817a0973-259f-4efa-8c3e-991e8a85db43 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:31.864389 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:57:31.880618 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817a0973-259f-4efa-8c3e-991e8a85db43 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:31.885298 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d4c3e2-03c5-48ef-9657-5b153f79cd63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:31.886136 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d4c3e2-03c5-48ef-9657-5b153f79cd63 admin admin] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:31.886423 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d4c3e2-03c5-48ef-9657-5b153f79cd63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:31.886700 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d4c3e2-03c5-48ef-9657-5b153f79cd63 admin admin] PATH_INFO: `/v3/projects` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:31.887407 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d4c3e2-03c5-48ef-9657-5b153f79cd63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:31.889339 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d4c3e2-03c5-48ef-9657-5b153f79cd63 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:31.913222 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1430/2864] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jul 11 14:57:31 2022] POST /identity/v3/projects => generated 375 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:57:31.917863 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e31936-ff64-4714-a64e-6c98e7e48708 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:31.928549 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e31936-ff64-4714-a64e-6c98e7e48708 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:31.986144 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf757570-e3ac-4f5e-a5a0-a30da6e4127d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:31.986754 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf757570-e3ac-4f5e-a5a0-a30da6e4127d admin admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:31.987041 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf757570-e3ac-4f5e-a5a0-a30da6e4127d admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:31.987316 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf757570-e3ac-4f5e-a5a0-a30da6e4127d admin admin] PATH_INFO: `/v3/users` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:31.988014 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf757570-e3ac-4f5e-a5a0-a30da6e4127d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:31.989969 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf757570-e3ac-4f5e-a5a0-a30da6e4127d admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:32.010050 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1435/2865] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jul 11 14:57:31 2022] POST /identity/v3/users => generated 288 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:57:32.014516 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d4c3e2-03c5-48ef-9657-5b153f79cd63 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:32.025165 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d4c3e2-03c5-48ef-9657-5b153f79cd63 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:32.030032 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d4d2a7-47f1-4fea-bc70-2ff721201e1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:32.030698 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d4d2a7-47f1-4fea-bc70-2ff721201e1b admin admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:32.030985 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d4d2a7-47f1-4fea-bc70-2ff721201e1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:32.031263 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d4d2a7-47f1-4fea-bc70-2ff721201e1b admin admin] PATH_INFO: `/v3/roles` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:32.031990 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d4d2a7-47f1-4fea-bc70-2ff721201e1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:32.033618 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d4d2a7-47f1-4fea-bc70-2ff721201e1b admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:32.044825 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1431/2866] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:57:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:57:32.048840 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf757570-e3ac-4f5e-a5a0-a30da6e4127d admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:32.059622 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf757570-e3ac-4f5e-a5a0-a30da6e4127d admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:32.064298 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1370dd5-8a22-471c-9377-f5ae17bd52a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:32.064956 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1370dd5-8a22-471c-9377-f5ae17bd52a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:32.065243 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1370dd5-8a22-471c-9377-f5ae17bd52a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:32.065521 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1370dd5-8a22-471c-9377-f5ae17bd52a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:32.066243 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1370dd5-8a22-471c-9377-f5ae17bd52a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:32.068091 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1370dd5-8a22-471c-9377-f5ae17bd52a2 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:32.078101 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1436/2867] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:57:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 14:57:32.082319 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d4d2a7-47f1-4fea-bc70-2ff721201e1b admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:32.092356 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d4d2a7-47f1-4fea-bc70-2ff721201e1b admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:32.097045 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcea960-492c-4e72-af70-8ae38f0c3268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:32.097899 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcea960-492c-4e72-af70-8ae38f0c3268 admin admin] REQUEST_METHOD: `PUT` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:32.098192 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcea960-492c-4e72-af70-8ae38f0c3268 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:32.098472 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcea960-492c-4e72-af70-8ae38f0c3268 admin admin] PATH_INFO: `/v3/projects/f5a0d8b0175e4978a0759f5fab447132/users/1228fdca194f4383a04459ba68bd8784/roles/8eff41f243c843ed95505a488ca6eada` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:32.113882 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcea960-492c-4e72-af70-8ae38f0c3268 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5a0d8b0175e4978a0759f5fab447132, user_id=1228fdca194f4383a04459ba68bd8784, role_id=8eff41f243c843ed95505a488ca6eada)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:32.116604 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcea960-492c-4e72-af70-8ae38f0c3268 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:32.130581 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1432/2868] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jul 11 14:57:32 2022] PUT /identity/v3/projects/f5a0d8b0175e4978a0759f5fab447132/users/1228fdca194f4383a04459ba68bd8784/roles/8eff41f243c843ed95505a488ca6eada => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:57:32.142084 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b697679-1d32-4cf8-816f-9a1a9b71ca5b None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:32.142377 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b697679-1d32-4cf8-816f-9a1a9b71ca5b None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:32.142662 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b697679-1d32-4cf8-816f-9a1a9b71ca5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:32.169762 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-2b697679-1d32-4cf8-816f-9a1a9b71ca5b None None] MFA Rules not processed for user `1228fdca194f4383a04459ba68bd8784`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:57:32.171023 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-2b697679-1d32-4cf8-816f-9a1a9b71ca5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:57:32.239055 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1437/2869] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:57:32 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:57:32.243489 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcea960-492c-4e72-af70-8ae38f0c3268 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:32.305795 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcea960-492c-4e72-af70-8ae38f0c3268 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:32.310685 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c46d90-7fd8-4d5f-81ea-77f5cffad744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:32.311398 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c46d90-7fd8-4d5f-81ea-77f5cffad744 admin admin] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:32.311711 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c46d90-7fd8-4d5f-81ea-77f5cffad744 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:32.312023 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c46d90-7fd8-4d5f-81ea-77f5cffad744 admin admin] PATH_INFO: `/v3/projects` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:32.312761 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c46d90-7fd8-4d5f-81ea-77f5cffad744 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:32.314738 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c46d90-7fd8-4d5f-81ea-77f5cffad744 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:32.340721 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1433/2870] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jul 11 14:57:32 2022] POST /identity/v3/projects => generated 375 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:57:32.344904 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b697679-1d32-4cf8-816f-9a1a9b71ca5b None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:32.350337 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:57:32.358260 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b697679-1d32-4cf8-816f-9a1a9b71ca5b None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:32.415991 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f51f438-b225-4e94-a3bd-88edf34c1e8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:32.416795 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f51f438-b225-4e94-a3bd-88edf34c1e8c admin admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:32.418128 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f51f438-b225-4e94-a3bd-88edf34c1e8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:32.418413 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f51f438-b225-4e94-a3bd-88edf34c1e8c admin admin] PATH_INFO: `/v3/users` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:32.419100 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f51f438-b225-4e94-a3bd-88edf34c1e8c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:32.421042 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f51f438-b225-4e94-a3bd-88edf34c1e8c admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:32.439508 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1438/2871] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jul 11 14:57:32 2022] POST /identity/v3/users => generated 294 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:57:32.443958 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c46d90-7fd8-4d5f-81ea-77f5cffad744 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:32.454732 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c46d90-7fd8-4d5f-81ea-77f5cffad744 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:32.459335 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c22f5d-adb1-41db-b794-0b3b75d9cacd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:32.459989 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c22f5d-adb1-41db-b794-0b3b75d9cacd admin admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:32.460307 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c22f5d-adb1-41db-b794-0b3b75d9cacd admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:32.460589 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c22f5d-adb1-41db-b794-0b3b75d9cacd admin admin] PATH_INFO: `/v3/roles` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:32.461310 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c22f5d-adb1-41db-b794-0b3b75d9cacd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:32.462900 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c22f5d-adb1-41db-b794-0b3b75d9cacd admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:32.474513 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1434/2872] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:57:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:57:32.478519 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f51f438-b225-4e94-a3bd-88edf34c1e8c admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:32.489382 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f51f438-b225-4e94-a3bd-88edf34c1e8c admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:32.494000 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a2475d-a169-4081-a9ca-4bccaa76bada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:32.494904 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a2475d-a169-4081-a9ca-4bccaa76bada admin admin] REQUEST_METHOD: `PUT` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:32.495195 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a2475d-a169-4081-a9ca-4bccaa76bada admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:32.495482 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a2475d-a169-4081-a9ca-4bccaa76bada admin admin] PATH_INFO: `/v3/projects/a1937e1b19ba42d4a800cad493d78f56/users/5737fbc853284200ae2f1c514ec8075e/roles/b46df176b0fe479da63c318db225bed4` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:32.509970 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a2475d-a169-4081-a9ca-4bccaa76bada admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1937e1b19ba42d4a800cad493d78f56, user_id=5737fbc853284200ae2f1c514ec8075e, role_id=b46df176b0fe479da63c318db225bed4)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:32.512715 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a2475d-a169-4081-a9ca-4bccaa76bada admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:32.525289 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1439/2873] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jul 11 14:57:32 2022] PUT /identity/v3/projects/a1937e1b19ba42d4a800cad493d78f56/users/5737fbc853284200ae2f1c514ec8075e/roles/b46df176b0fe479da63c318db225bed4 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:57:32.529793 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c22f5d-adb1-41db-b794-0b3b75d9cacd admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:32.539760 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c22f5d-adb1-41db-b794-0b3b75d9cacd admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:32.597077 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344f1610-a86d-4bb3-9566-34324944997f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:32.597736 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344f1610-a86d-4bb3-9566-34324944997f admin admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:32.598019 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344f1610-a86d-4bb3-9566-34324944997f admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:32.598291 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344f1610-a86d-4bb3-9566-34324944997f admin admin] PATH_INFO: `/v3/roles` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:32.599007 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344f1610-a86d-4bb3-9566-34324944997f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:32.600686 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344f1610-a86d-4bb3-9566-34324944997f admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:32.610217 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1435/2874] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:57:32 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:57:32.614467 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a2475d-a169-4081-a9ca-4bccaa76bada admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:32.625292 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a2475d-a169-4081-a9ca-4bccaa76bada admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:32.629886 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53895fb9-5952-4cad-a33c-606bf9efc8f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:32.630764 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53895fb9-5952-4cad-a33c-606bf9efc8f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:32.631051 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53895fb9-5952-4cad-a33c-606bf9efc8f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:32.631323 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53895fb9-5952-4cad-a33c-606bf9efc8f0 admin admin] PATH_INFO: `/v3/projects/a1937e1b19ba42d4a800cad493d78f56/users/5737fbc853284200ae2f1c514ec8075e/roles/b46df176b0fe479da63c318db225bed4` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:32.634131 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53895fb9-5952-4cad-a33c-606bf9efc8f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1937e1b19ba42d4a800cad493d78f56, user_id=5737fbc853284200ae2f1c514ec8075e, role_id=b46df176b0fe479da63c318db225bed4)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:32.637828 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53895fb9-5952-4cad-a33c-606bf9efc8f0 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:32.654043 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1440/2875] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jul 11 14:57:32 2022] PUT /identity/v3/projects/a1937e1b19ba42d4a800cad493d78f56/users/5737fbc853284200ae2f1c514ec8075e/roles/b46df176b0fe479da63c318db225bed4 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:57:32.663602 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6660622-f9a3-4cdd-abce-9ff3dd24b5bd None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:32.663925 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6660622-f9a3-4cdd-abce-9ff3dd24b5bd None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:32.664287 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6660622-f9a3-4cdd-abce-9ff3dd24b5bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:32.676865 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:57:32.691214 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-a6660622-f9a3-4cdd-abce-9ff3dd24b5bd None None] MFA Rules not processed for user `5737fbc853284200ae2f1c514ec8075e`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:57:32.692725 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-a6660622-f9a3-4cdd-abce-9ff3dd24b5bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:57:32.763898 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1436/2876] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:57:32 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:57:32.778058 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53895fb9-5952-4cad-a33c-606bf9efc8f0 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:32.779808 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-53895fb9-5952-4cad-a33c-606bf9efc8f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:57:32.836814 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53895fb9-5952-4cad-a33c-606bf9efc8f0 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:32.840480 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7a4c68-e995-4037-87ff-0d5363d6c7bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '868e7c2dec264512b972c8736d659c34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:32.841116 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7a4c68-e995-4037-87ff-0d5363d6c7bc service cinder] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:32.841398 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7a4c68-e995-4037-87ff-0d5363d6c7bc service cinder] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:32.841673 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7a4c68-e995-4037-87ff-0d5363d6c7bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:32.897712 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7a4c68-e995-4037-87ff-0d5363d6c7bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:32.899152 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7a4c68-e995-4037-87ff-0d5363d6c7bc service cinder] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:32.908111 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1441/2877] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:57:32 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:57:34.380991 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6660622-f9a3-4cdd-abce-9ff3dd24b5bd None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:34.382400 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-a6660622-f9a3-4cdd-abce-9ff3dd24b5bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:57:34.395455 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6660622-f9a3-4cdd-abce-9ff3dd24b5bd None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:34.398962 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f300ae-dc1a-475c-971a-4446e804b4e3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '868e7c2dec264512b972c8736d659c34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:34.399607 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f300ae-dc1a-475c-971a-4446e804b4e3 service cinder] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:34.399888 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f300ae-dc1a-475c-971a-4446e804b4e3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:34.400162 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f300ae-dc1a-475c-971a-4446e804b4e3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:34.459292 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f300ae-dc1a-475c-971a-4446e804b4e3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:34.460693 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f300ae-dc1a-475c-971a-4446e804b4e3 service cinder] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:34.470236 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1437/2878] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:57:34 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:57:34.975198 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7a4c68-e995-4037-87ff-0d5363d6c7bc service cinder] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:34.984405 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7a4c68-e995-4037-87ff-0d5363d6c7bc service cinder] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:34.987957 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92a7a3f-f6c8-40f8-be1a-631f8703fe9a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '868e7c2dec264512b972c8736d659c34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:34.988683 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92a7a3f-f6c8-40f8-be1a-631f8703fe9a service cinder] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:34.988967 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92a7a3f-f6c8-40f8-be1a-631f8703fe9a service cinder] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:34.989240 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92a7a3f-f6c8-40f8-be1a-631f8703fe9a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:34.996630 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:57:34.998930 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92a7a3f-f6c8-40f8-be1a-631f8703fe9a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:35.000387 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92a7a3f-f6c8-40f8-be1a-631f8703fe9a service cinder] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:35.011654 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1442/2879] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:57:34 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:57:38.840646 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f300ae-dc1a-475c-971a-4446e804b4e3 service cinder] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:38.902940 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f300ae-dc1a-475c-971a-4446e804b4e3 service cinder] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:38.907486 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6aae864-9c68-42e2-9d05-b47d879891fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:38.908490 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aae864-9c68-42e2-9d05-b47d879891fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:38.908786 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aae864-9c68-42e2-9d05-b47d879891fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:38.909072 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aae864-9c68-42e2-9d05-b47d879891fa admin admin] PATH_INFO: `/v3/users/810ff74261d64386a007a3414931ca57` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:38.910287 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6aae864-9c68-42e2-9d05-b47d879891fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=810ff74261d64386a007a3414931ca57)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:38.912244 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6aae864-9c68-42e2-9d05-b47d879891fa admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:38.947021 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:57:38.960965 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-e6aae864-9c68-42e2-9d05-b47d879891fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '810ff74261d64386a007a3414931ca57'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:38.967841 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-e6aae864-9c68-42e2-9d05-b47d879891fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '810ff74261d64386a007a3414931ca57'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:38.974917 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-e6aae864-9c68-42e2-9d05-b47d879891fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '810ff74261d64386a007a3414931ca57'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:38.975534 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-e6aae864-9c68-42e2-9d05-b47d879891fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '810ff74261d64386a007a3414931ca57'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:38.976145 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-e6aae864-9c68-42e2-9d05-b47d879891fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '810ff74261d64386a007a3414931ca57'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:38.993179 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1438/2880] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jul 11 14:57:38 2022] DELETE /identity/v3/users/810ff74261d64386a007a3414931ca57 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:57:38.998836 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a87cf37-042c-4429-8f33-aef27f530a78 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:38.999330 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a87cf37-042c-4429-8f33-aef27f530a78 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:38.999460 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a87cf37-042c-4429-8f33-aef27f530a78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:39.016677 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-2a87cf37-042c-4429-8f33-aef27f530a78 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:57:39.017864 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-2a87cf37-042c-4429-8f33-aef27f530a78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:57:39.078169 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1443/2881] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:57:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:57:39.088378 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6aae864-9c68-42e2-9d05-b47d879891fa admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:39.090003 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-e6aae864-9c68-42e2-9d05-b47d879891fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:57:39.147397 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6aae864-9c68-42e2-9d05-b47d879891fa admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:39.151164 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2dffd8-7c65-4941-be93-a5c86c5194ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20eede5ccd834862b00123310b5c3975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:39.151808 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2dffd8-7c65-4941-be93-a5c86c5194ae service neutron] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:39.152088 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2dffd8-7c65-4941-be93-a5c86c5194ae service neutron] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:39.152409 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2dffd8-7c65-4941-be93-a5c86c5194ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:39.161416 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2dffd8-7c65-4941-be93-a5c86c5194ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:39.162830 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2dffd8-7c65-4941-be93-a5c86c5194ae service neutron] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:39.172191 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1439/2882] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:57:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:57:39.438513 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a87cf37-042c-4429-8f33-aef27f530a78 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:39.440020 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-2a87cf37-042c-4429-8f33-aef27f530a78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:57:39.455698 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a87cf37-042c-4429-8f33-aef27f530a78 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:39.460776 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fb22e6-768d-4219-9056-61dbc158e234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:39.461705 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fb22e6-768d-4219-9056-61dbc158e234 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:39.461988 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fb22e6-768d-4219-9056-61dbc158e234 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:39.462310 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fb22e6-768d-4219-9056-61dbc158e234 admin admin] PATH_INFO: `/v3/projects/51acbf8603054c3c83e1f25a9754f254` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:39.464285 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fb22e6-768d-4219-9056-61dbc158e234 admin admin] RBAC: Authorizing `identity:delete_project(project_id=51acbf8603054c3c83e1f25a9754f254)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:39.466508 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fb22e6-768d-4219-9056-61dbc158e234 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:39.513803 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-72fb22e6-768d-4219-9056-61dbc158e234 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51acbf8603054c3c83e1f25a9754f254', 'request_id': 'req-72fb22e6-768d-4219-9056-61dbc158e234'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:39.519296 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-72fb22e6-768d-4219-9056-61dbc158e234 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51acbf8603054c3c83e1f25a9754f254', 'request_id': 'req-72fb22e6-768d-4219-9056-61dbc158e234'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:39.525346 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-72fb22e6-768d-4219-9056-61dbc158e234 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51acbf8603054c3c83e1f25a9754f254', 'request_id': 'req-72fb22e6-768d-4219-9056-61dbc158e234'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:39.537479 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-72fb22e6-768d-4219-9056-61dbc158e234 admin admin] The token cache is being invalidate because project 51acbf8603054c3c83e1f25a9754f254 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:57:39.537766 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-72fb22e6-768d-4219-9056-61dbc158e234 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:39.538376 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-72fb22e6-768d-4219-9056-61dbc158e234 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:39.539941 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1444/2883] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jul 11 14:57:39 2022] DELETE /identity/v3/projects/51acbf8603054c3c83e1f25a9754f254 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:57:39.544677 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2dffd8-7c65-4941-be93-a5c86c5194ae service neutron] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:39.554300 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2dffd8-7c65-4941-be93-a5c86c5194ae service neutron] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:39.612658 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af17f7f-c560-4091-ab25-1f4d4461cc9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:39.613459 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af17f7f-c560-4091-ab25-1f4d4461cc9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:39.613752 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af17f7f-c560-4091-ab25-1f4d4461cc9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:39.614019 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af17f7f-c560-4091-ab25-1f4d4461cc9a admin admin] PATH_INFO: `/v3/users/1228fdca194f4383a04459ba68bd8784` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:39.615213 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af17f7f-c560-4091-ab25-1f4d4461cc9a admin admin] RBAC: Authorizing `identity:delete_user(user_id=1228fdca194f4383a04459ba68bd8784)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:39.617181 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af17f7f-c560-4091-ab25-1f4d4461cc9a admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:39.669666 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-7af17f7f-c560-4091-ab25-1f4d4461cc9a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1228fdca194f4383a04459ba68bd8784'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:39.674918 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:57:39.676995 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-7af17f7f-c560-4091-ab25-1f4d4461cc9a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1228fdca194f4383a04459ba68bd8784'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:39.686925 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-7af17f7f-c560-4091-ab25-1f4d4461cc9a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1228fdca194f4383a04459ba68bd8784'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:39.687587 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-7af17f7f-c560-4091-ab25-1f4d4461cc9a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1228fdca194f4383a04459ba68bd8784'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:39.688272 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-7af17f7f-c560-4091-ab25-1f4d4461cc9a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1228fdca194f4383a04459ba68bd8784'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:39.706506 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1440/2884] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jul 11 14:57:39 2022] DELETE /identity/v3/users/1228fdca194f4383a04459ba68bd8784 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:57:39.980243 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fb22e6-768d-4219-9056-61dbc158e234 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:39.981797 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-72fb22e6-768d-4219-9056-61dbc158e234 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:57:39.997627 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fb22e6-768d-4219-9056-61dbc158e234 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:40.056767 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef10c223-1783-4b14-947f-036242ef86d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:40.057720 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef10c223-1783-4b14-947f-036242ef86d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:40.058005 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef10c223-1783-4b14-947f-036242ef86d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:40.058285 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef10c223-1783-4b14-947f-036242ef86d3 admin admin] PATH_INFO: `/v3/projects/f5a0d8b0175e4978a0759f5fab447132` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:40.059484 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef10c223-1783-4b14-947f-036242ef86d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5a0d8b0175e4978a0759f5fab447132)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:40.061521 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef10c223-1783-4b14-947f-036242ef86d3 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:40.085305 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:57:40.112480 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-ef10c223-1783-4b14-947f-036242ef86d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5a0d8b0175e4978a0759f5fab447132', 'request_id': 'req-ef10c223-1783-4b14-947f-036242ef86d3'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:40.118181 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-ef10c223-1783-4b14-947f-036242ef86d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5a0d8b0175e4978a0759f5fab447132', 'request_id': 'req-ef10c223-1783-4b14-947f-036242ef86d3'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:40.124672 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-ef10c223-1783-4b14-947f-036242ef86d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5a0d8b0175e4978a0759f5fab447132', 'request_id': 'req-ef10c223-1783-4b14-947f-036242ef86d3'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:40.137692 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-ef10c223-1783-4b14-947f-036242ef86d3 admin admin] The token cache is being invalidate because project f5a0d8b0175e4978a0759f5fab447132 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:57:40.138022 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-ef10c223-1783-4b14-947f-036242ef86d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:40.138709 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-ef10c223-1783-4b14-947f-036242ef86d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:40.140359 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1445/2885] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jul 11 14:57:39 2022] DELETE /identity/v3/projects/f5a0d8b0175e4978a0759f5fab447132 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:57:40.144416 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af17f7f-c560-4091-ab25-1f4d4461cc9a admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:40.145835 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-7af17f7f-c560-4091-ab25-1f4d4461cc9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:57:40.159464 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af17f7f-c560-4091-ab25-1f4d4461cc9a admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:40.216330 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941ab79c-acf5-436f-9cb7-e5bc9f77ad01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:40.217195 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941ab79c-acf5-436f-9cb7-e5bc9f77ad01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:40.217471 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941ab79c-acf5-436f-9cb7-e5bc9f77ad01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:40.217744 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941ab79c-acf5-436f-9cb7-e5bc9f77ad01 admin admin] PATH_INFO: `/v3/users/5737fbc853284200ae2f1c514ec8075e` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:40.218915 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941ab79c-acf5-436f-9cb7-e5bc9f77ad01 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5737fbc853284200ae2f1c514ec8075e)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:40.220867 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941ab79c-acf5-436f-9cb7-e5bc9f77ad01 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:40.267567 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-941ab79c-acf5-436f-9cb7-e5bc9f77ad01 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5737fbc853284200ae2f1c514ec8075e'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:40.274370 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-941ab79c-acf5-436f-9cb7-e5bc9f77ad01 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5737fbc853284200ae2f1c514ec8075e'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:40.281661 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-941ab79c-acf5-436f-9cb7-e5bc9f77ad01 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5737fbc853284200ae2f1c514ec8075e'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:40.282269 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-941ab79c-acf5-436f-9cb7-e5bc9f77ad01 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5737fbc853284200ae2f1c514ec8075e'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:40.282864 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-941ab79c-acf5-436f-9cb7-e5bc9f77ad01 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5737fbc853284200ae2f1c514ec8075e'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:40.300613 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1441/2886] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jul 11 14:57:40 2022] DELETE /identity/v3/users/5737fbc853284200ae2f1c514ec8075e => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:57:40.570310 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef10c223-1783-4b14-947f-036242ef86d3 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:40.571902 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-ef10c223-1783-4b14-947f-036242ef86d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:57:40.585754 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef10c223-1783-4b14-947f-036242ef86d3 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:40.645328 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80092f06-18e7-4f87-8ee7-1f11776a42cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:40.646114 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80092f06-18e7-4f87-8ee7-1f11776a42cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:40.646393 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80092f06-18e7-4f87-8ee7-1f11776a42cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:40.646669 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80092f06-18e7-4f87-8ee7-1f11776a42cb admin admin] PATH_INFO: `/v3/projects/a1937e1b19ba42d4a800cad493d78f56` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:40.647830 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80092f06-18e7-4f87-8ee7-1f11776a42cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1937e1b19ba42d4a800cad493d78f56)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:40.649790 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80092f06-18e7-4f87-8ee7-1f11776a42cb admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:40.695344 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-80092f06-18e7-4f87-8ee7-1f11776a42cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1937e1b19ba42d4a800cad493d78f56', 'request_id': 'req-80092f06-18e7-4f87-8ee7-1f11776a42cb'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:40.702106 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-80092f06-18e7-4f87-8ee7-1f11776a42cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1937e1b19ba42d4a800cad493d78f56', 'request_id': 'req-80092f06-18e7-4f87-8ee7-1f11776a42cb'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:40.708141 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-80092f06-18e7-4f87-8ee7-1f11776a42cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1937e1b19ba42d4a800cad493d78f56', 'request_id': 'req-80092f06-18e7-4f87-8ee7-1f11776a42cb'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:40.720242 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-80092f06-18e7-4f87-8ee7-1f11776a42cb admin admin] The token cache is being invalidate because project a1937e1b19ba42d4a800cad493d78f56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:57:40.720531 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-80092f06-18e7-4f87-8ee7-1f11776a42cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:40.721164 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-80092f06-18e7-4f87-8ee7-1f11776a42cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:40.722688 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1446/2887] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jul 11 14:57:40 2022] DELETE /identity/v3/projects/a1937e1b19ba42d4a800cad493d78f56 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:57:40.727579 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ee1851-f0de-48df-90a3-7b1b1ee68e18 None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:40.727868 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ee1851-f0de-48df-90a3-7b1b1ee68e18 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:40.728142 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ee1851-f0de-48df-90a3-7b1b1ee68e18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:40.746207 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-a8ee1851-f0de-48df-90a3-7b1b1ee68e18 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:57:40.747388 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-a8ee1851-f0de-48df-90a3-7b1b1ee68e18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:57:40.792270 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:57:40.809981 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1442/2888] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:57:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:57:40.818601 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e466507-c387-41e3-acc2-82607f1b2d52 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:40.818888 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e466507-c387-41e3-acc2-82607f1b2d52 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:40.819165 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e466507-c387-41e3-acc2-82607f1b2d52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:40.837862 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-8e466507-c387-41e3-acc2-82607f1b2d52 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:57:40.839289 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-8e466507-c387-41e3-acc2-82607f1b2d52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:57:40.847169 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1447/2889] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:57:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:57:40.851286 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ee1851-f0de-48df-90a3-7b1b1ee68e18 None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:40.862152 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ee1851-f0de-48df-90a3-7b1b1ee68e18 None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:40.866776 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc067fa-1090-467f-ac09-e3f9c95323f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:40.867433 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc067fa-1090-467f-ac09-e3f9c95323f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:40.867720 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc067fa-1090-467f-ac09-e3f9c95323f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:40.868000 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc067fa-1090-467f-ac09-e3f9c95323f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:40.868773 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc067fa-1090-467f-ac09-e3f9c95323f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:57:40.869112 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc067fa-1090-467f-ac09-e3f9c95323f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:40.871569 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc067fa-1090-467f-ac09-e3f9c95323f0 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:40.884181 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1443/2890] 10.222.0.70 () {58 vars in 1152 bytes} [Mon Jul 11 14:57:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:57:40.888545 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e466507-c387-41e3-acc2-82607f1b2d52 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:40.897920 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e466507-c387-41e3-acc2-82607f1b2d52 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:40.902543 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677317ca-2306-4ae7-a671-8ff9f2b1bc52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:40.903194 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677317ca-2306-4ae7-a671-8ff9f2b1bc52 admin admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:40.903478 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677317ca-2306-4ae7-a671-8ff9f2b1bc52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:40.903754 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677317ca-2306-4ae7-a671-8ff9f2b1bc52 admin admin] PATH_INFO: `/v3/projects` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:40.904487 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677317ca-2306-4ae7-a671-8ff9f2b1bc52 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:40.906389 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677317ca-2306-4ae7-a671-8ff9f2b1bc52 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:40.932058 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1448/2891] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jul 11 14:57:40 2022] POST /identity/v3/projects => generated 373 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:57:40.936788 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc067fa-1090-467f-ac09-e3f9c95323f0 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:40.946959 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc067fa-1090-467f-ac09-e3f9c95323f0 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:41.007989 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a73e789-dddd-4ab1-90c9-a19d5f064bd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:41.008717 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a73e789-dddd-4ab1-90c9-a19d5f064bd2 admin admin] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:41.008999 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a73e789-dddd-4ab1-90c9-a19d5f064bd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:41.009276 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a73e789-dddd-4ab1-90c9-a19d5f064bd2 admin admin] PATH_INFO: `/v3/users` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:41.009964 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a73e789-dddd-4ab1-90c9-a19d5f064bd2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:41.012525 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a73e789-dddd-4ab1-90c9-a19d5f064bd2 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:41.032151 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1444/2892] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jul 11 14:57:40 2022] POST /identity/v3/users => generated 287 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:57:41.036441 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677317ca-2306-4ae7-a671-8ff9f2b1bc52 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:41.047445 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677317ca-2306-4ae7-a671-8ff9f2b1bc52 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:41.052100 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222707e7-020e-431c-8e97-3af112cbf43d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:41.052791 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222707e7-020e-431c-8e97-3af112cbf43d admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:41.053080 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222707e7-020e-431c-8e97-3af112cbf43d admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:41.053362 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222707e7-020e-431c-8e97-3af112cbf43d admin admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:41.054119 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222707e7-020e-431c-8e97-3af112cbf43d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:41.055773 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222707e7-020e-431c-8e97-3af112cbf43d admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:41.061667 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:DELETE=14,keystone:SELECT=83,keystone:INSERT=3 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:57:41.070391 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1449/2893] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:57:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:57:41.071959 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a73e789-dddd-4ab1-90c9-a19d5f064bd2 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:41.082217 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a73e789-dddd-4ab1-90c9-a19d5f064bd2 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:41.086932 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f7f798-38fb-4c59-8df6-07c96cf17951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:41.087591 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f7f798-38fb-4c59-8df6-07c96cf17951 admin admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:41.087877 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f7f798-38fb-4c59-8df6-07c96cf17951 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:41.088157 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f7f798-38fb-4c59-8df6-07c96cf17951 admin admin] PATH_INFO: `/v3/roles` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:41.088965 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f7f798-38fb-4c59-8df6-07c96cf17951 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:41.090660 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f7f798-38fb-4c59-8df6-07c96cf17951 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:41.100772 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1445/2894] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:57:41 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:57:41.105430 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222707e7-020e-431c-8e97-3af112cbf43d admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:41.115463 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222707e7-020e-431c-8e97-3af112cbf43d admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:41.120912 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11b197c-6400-4585-8dde-6f392a0ec6c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:41.121793 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11b197c-6400-4585-8dde-6f392a0ec6c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:41.122084 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11b197c-6400-4585-8dde-6f392a0ec6c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:41.122375 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11b197c-6400-4585-8dde-6f392a0ec6c9 admin admin] PATH_INFO: `/v3/projects/7cab7af837e64171bb5d9a515eb2df75/users/54dec4346c364fb2a9d2a39073daf6dc/roles/8eff41f243c843ed95505a488ca6eada` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:41.137986 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11b197c-6400-4585-8dde-6f392a0ec6c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7cab7af837e64171bb5d9a515eb2df75, user_id=54dec4346c364fb2a9d2a39073daf6dc, role_id=8eff41f243c843ed95505a488ca6eada)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:41.140665 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11b197c-6400-4585-8dde-6f392a0ec6c9 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:41.153568 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1450/2895] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jul 11 14:57:41 2022] PUT /identity/v3/projects/7cab7af837e64171bb5d9a515eb2df75/users/54dec4346c364fb2a9d2a39073daf6dc/roles/8eff41f243c843ed95505a488ca6eada => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:57:41.217325 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f52778-b3db-4879-8211-2fedba666e62 None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:41.217910 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f52778-b3db-4879-8211-2fedba666e62 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:41.217910 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f52778-b3db-4879-8211-2fedba666e62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:41.244210 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-03f52778-b3db-4879-8211-2fedba666e62 None None] MFA Rules not processed for user `54dec4346c364fb2a9d2a39073daf6dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:57:41.245495 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-03f52778-b3db-4879-8211-2fedba666e62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:57:41.310539 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1446/2896] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:57:41 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:57:41.321895 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11b197c-6400-4585-8dde-6f392a0ec6c9 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:41.324217 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-e11b197c-6400-4585-8dde-6f392a0ec6c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:57:41.381565 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11b197c-6400-4585-8dde-6f392a0ec6c9 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:41.385303 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd9d1d4-a365-4767-8212-b268040fa037 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '868e7c2dec264512b972c8736d659c34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:41.386180 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd9d1d4-a365-4767-8212-b268040fa037 service cinder] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:41.386469 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd9d1d4-a365-4767-8212-b268040fa037 service cinder] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:41.386747 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd9d1d4-a365-4767-8212-b268040fa037 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:41.395120 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd9d1d4-a365-4767-8212-b268040fa037 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:41.396587 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd9d1d4-a365-4767-8212-b268040fa037 service cinder] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:41.406047 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1451/2897] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:57:41 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:57:41.431646 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f52778-b3db-4879-8211-2fedba666e62 None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:41.478356 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:57:41.494141 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f52778-b3db-4879-8211-2fedba666e62 None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:41.498658 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8467a2-7d34-4386-be89-ec36780ad39c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:41.499509 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8467a2-7d34-4386-be89-ec36780ad39c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:41.499784 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8467a2-7d34-4386-be89-ec36780ad39c admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:41.500051 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8467a2-7d34-4386-be89-ec36780ad39c admin admin] PATH_INFO: `/v3/users/54dec4346c364fb2a9d2a39073daf6dc` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:41.501270 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8467a2-7d34-4386-be89-ec36780ad39c admin admin] RBAC: Authorizing `identity:delete_user(user_id=54dec4346c364fb2a9d2a39073daf6dc)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:41.503173 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8467a2-7d34-4386-be89-ec36780ad39c admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:41.547430 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-1f8467a2-7d34-4386-be89-ec36780ad39c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54dec4346c364fb2a9d2a39073daf6dc'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:41.554296 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-1f8467a2-7d34-4386-be89-ec36780ad39c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54dec4346c364fb2a9d2a39073daf6dc'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:41.562531 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-1f8467a2-7d34-4386-be89-ec36780ad39c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54dec4346c364fb2a9d2a39073daf6dc'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:41.563165 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-1f8467a2-7d34-4386-be89-ec36780ad39c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54dec4346c364fb2a9d2a39073daf6dc'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:41.563779 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-1f8467a2-7d34-4386-be89-ec36780ad39c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54dec4346c364fb2a9d2a39073daf6dc'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:41.582025 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1447/2898] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jul 11 14:57:41 2022] DELETE /identity/v3/users/54dec4346c364fb2a9d2a39073daf6dc => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:57:41.586548 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d06f7e-915d-4f37-a046-d193c7f4f307 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:41.586865 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d06f7e-915d-4f37-a046-d193c7f4f307 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:41.587167 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d06f7e-915d-4f37-a046-d193c7f4f307 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:41.606033 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-f8d06f7e-915d-4f37-a046-d193c7f4f307 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:57:41.607331 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-f8d06f7e-915d-4f37-a046-d193c7f4f307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:57:41.666706 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1452/2899] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:57:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:57:41.676079 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8467a2-7d34-4386-be89-ec36780ad39c admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:41.677509 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-1f8467a2-7d34-4386-be89-ec36780ad39c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:57:41.735009 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8467a2-7d34-4386-be89-ec36780ad39c admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:41.738544 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd52c6b0-2f6a-47a5-a16e-7b95452facaf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20eede5ccd834862b00123310b5c3975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:41.739179 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd52c6b0-2f6a-47a5-a16e-7b95452facaf service neutron] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:41.739459 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd52c6b0-2f6a-47a5-a16e-7b95452facaf service neutron] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:41.739732 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd52c6b0-2f6a-47a5-a16e-7b95452facaf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:41.748800 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd52c6b0-2f6a-47a5-a16e-7b95452facaf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:41.750212 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd52c6b0-2f6a-47a5-a16e-7b95452facaf service neutron] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:41.759508 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1448/2900] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:57:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:57:42.022401 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d06f7e-915d-4f37-a046-d193c7f4f307 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:42.023810 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-f8d06f7e-915d-4f37-a046-d193c7f4f307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:57:42.037001 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d06f7e-915d-4f37-a046-d193c7f4f307 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:42.041873 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c1640b-3855-42cb-8c90-8e4debd4f13b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:42.042871 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c1640b-3855-42cb-8c90-8e4debd4f13b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:42.043232 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c1640b-3855-42cb-8c90-8e4debd4f13b admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:42.043579 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c1640b-3855-42cb-8c90-8e4debd4f13b admin admin] PATH_INFO: `/v3/projects/7cab7af837e64171bb5d9a515eb2df75` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:42.044922 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c1640b-3855-42cb-8c90-8e4debd4f13b admin admin] RBAC: Authorizing `identity:delete_project(project_id=7cab7af837e64171bb5d9a515eb2df75)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:42.047143 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c1640b-3855-42cb-8c90-8e4debd4f13b admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:42.095258 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-c3c1640b-3855-42cb-8c90-8e4debd4f13b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7cab7af837e64171bb5d9a515eb2df75', 'request_id': 'req-c3c1640b-3855-42cb-8c90-8e4debd4f13b'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:42.100865 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-c3c1640b-3855-42cb-8c90-8e4debd4f13b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7cab7af837e64171bb5d9a515eb2df75', 'request_id': 'req-c3c1640b-3855-42cb-8c90-8e4debd4f13b'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:42.107193 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-c3c1640b-3855-42cb-8c90-8e4debd4f13b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7cab7af837e64171bb5d9a515eb2df75', 'request_id': 'req-c3c1640b-3855-42cb-8c90-8e4debd4f13b'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:42.120170 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-c3c1640b-3855-42cb-8c90-8e4debd4f13b admin admin] The token cache is being invalidate because project 7cab7af837e64171bb5d9a515eb2df75 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:57:42.120527 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-c3c1640b-3855-42cb-8c90-8e4debd4f13b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:42.121159 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-c3c1640b-3855-42cb-8c90-8e4debd4f13b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:57:42.122698 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1453/2901] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jul 11 14:57:42 2022] DELETE /identity/v3/projects/7cab7af837e64171bb5d9a515eb2df75 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:57:42.127816 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eefeb5-fe21-420b-9071-b3f4ce7e4be5 None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:42.128108 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eefeb5-fe21-420b-9071-b3f4ce7e4be5 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:42.128432 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eefeb5-fe21-420b-9071-b3f4ce7e4be5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:42.147620 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-52eefeb5-fe21-420b-9071-b3f4ce7e4be5 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:57:42.148884 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-52eefeb5-fe21-420b-9071-b3f4ce7e4be5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:57:42.210504 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1449/2902] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:57:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:57:42.218590 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4e4b13-f090-445b-96d4-d62c40bafcc1 None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:42.218875 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4e4b13-f090-445b-96d4-d62c40bafcc1 None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:42.219182 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4e4b13-f090-445b-96d4-d62c40bafcc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:42.225454 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:57:42.239997 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-0c4e4b13-f090-445b-96d4-d62c40bafcc1 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:57:42.241252 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-0c4e4b13-f090-445b-96d4-d62c40bafcc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:57:42.249380 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1454/2903] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:57:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:57:42.253669 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52eefeb5-fe21-420b-9071-b3f4ce7e4be5 None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:42.264072 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52eefeb5-fe21-420b-9071-b3f4ce7e4be5 None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:42.268671 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd55c3f8-3fb8-4285-b225-2efd7031a7e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:42.269328 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd55c3f8-3fb8-4285-b225-2efd7031a7e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:42.269614 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd55c3f8-3fb8-4285-b225-2efd7031a7e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:42.269893 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd55c3f8-3fb8-4285-b225-2efd7031a7e9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:42.270622 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd55c3f8-3fb8-4285-b225-2efd7031a7e9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:57:42.270928 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd55c3f8-3fb8-4285-b225-2efd7031a7e9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:42.272554 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd55c3f8-3fb8-4285-b225-2efd7031a7e9 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:42.274924 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:57:42.286836 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1450/2904] 10.222.0.70 () {58 vars in 1152 bytes} [Mon Jul 11 14:57:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:57:42.290961 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4e4b13-f090-445b-96d4-d62c40bafcc1 None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:42.301077 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4e4b13-f090-445b-96d4-d62c40bafcc1 None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:42.305720 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ed8560-7704-40d9-986a-4b327aba4148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:42.306365 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ed8560-7704-40d9-986a-4b327aba4148 admin admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:42.306646 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ed8560-7704-40d9-986a-4b327aba4148 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:42.306922 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ed8560-7704-40d9-986a-4b327aba4148 admin admin] PATH_INFO: `/v3/projects` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:42.307847 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ed8560-7704-40d9-986a-4b327aba4148 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:42.309762 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ed8560-7704-40d9-986a-4b327aba4148 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:42.335439 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1455/2905] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jul 11 14:57:42 2022] POST /identity/v3/projects => generated 373 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:57:42.339760 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd55c3f8-3fb8-4285-b225-2efd7031a7e9 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:42.349888 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd55c3f8-3fb8-4285-b225-2efd7031a7e9 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:42.407037 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11271ba9-af4f-4650-92a6-b126bf8d6140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:42.407714 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11271ba9-af4f-4650-92a6-b126bf8d6140 admin admin] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:42.408001 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11271ba9-af4f-4650-92a6-b126bf8d6140 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:42.408323 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11271ba9-af4f-4650-92a6-b126bf8d6140 admin admin] PATH_INFO: `/v3/users` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:42.409011 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11271ba9-af4f-4650-92a6-b126bf8d6140 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:42.410922 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11271ba9-af4f-4650-92a6-b126bf8d6140 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:42.431410 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1451/2906] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jul 11 14:57:42 2022] POST /identity/v3/users => generated 287 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:57:42.436622 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ed8560-7704-40d9-986a-4b327aba4148 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:42.447054 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ed8560-7704-40d9-986a-4b327aba4148 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:42.451699 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5a98d6-9ee6-47d7-b70e-0d5a498a5a71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:42.452382 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5a98d6-9ee6-47d7-b70e-0d5a498a5a71 admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:42.452664 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5a98d6-9ee6-47d7-b70e-0d5a498a5a71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:42.452962 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5a98d6-9ee6-47d7-b70e-0d5a498a5a71 admin admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:42.453679 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5a98d6-9ee6-47d7-b70e-0d5a498a5a71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:42.455269 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5a98d6-9ee6-47d7-b70e-0d5a498a5a71 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:42.465851 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1456/2907] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:57:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:57:42.469596 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11271ba9-af4f-4650-92a6-b126bf8d6140 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:42.480177 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11271ba9-af4f-4650-92a6-b126bf8d6140 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:42.484768 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16992338-de2f-44cc-9764-583d7aa9ef28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:42.485453 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16992338-de2f-44cc-9764-583d7aa9ef28 admin admin] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:42.485740 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16992338-de2f-44cc-9764-583d7aa9ef28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:42.486021 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16992338-de2f-44cc-9764-583d7aa9ef28 admin admin] PATH_INFO: `/v3/roles` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:42.486745 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16992338-de2f-44cc-9764-583d7aa9ef28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:42.488445 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16992338-de2f-44cc-9764-583d7aa9ef28 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:42.499010 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1452/2908] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:57:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:57:42.503112 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5a98d6-9ee6-47d7-b70e-0d5a498a5a71 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:42.513242 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5a98d6-9ee6-47d7-b70e-0d5a498a5a71 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:42.517785 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5770bc-a707-4e06-a65b-4e1f1668cc6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:42.518655 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5770bc-a707-4e06-a65b-4e1f1668cc6a admin admin] REQUEST_METHOD: `PUT` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:42.518935 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5770bc-a707-4e06-a65b-4e1f1668cc6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:42.519210 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5770bc-a707-4e06-a65b-4e1f1668cc6a admin admin] PATH_INFO: `/v3/projects/d060e0fbe0e041648c3f392738089aab/users/b6a06627a9594878b5e3cf42e105a657/roles/8eff41f243c843ed95505a488ca6eada` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:42.533601 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5770bc-a707-4e06-a65b-4e1f1668cc6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d060e0fbe0e041648c3f392738089aab, user_id=b6a06627a9594878b5e3cf42e105a657, role_id=8eff41f243c843ed95505a488ca6eada)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:42.536347 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5770bc-a707-4e06-a65b-4e1f1668cc6a admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:42.549269 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1457/2909] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jul 11 14:57:42 2022] PUT /identity/v3/projects/d060e0fbe0e041648c3f392738089aab/users/b6a06627a9594878b5e3cf42e105a657/roles/8eff41f243c843ed95505a488ca6eada => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:57:42.554782 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba44da41-55d1-4b13-a751-8e52165ef9c8 None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:42.555200 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba44da41-55d1-4b13-a751-8e52165ef9c8 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:42.555522 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba44da41-55d1-4b13-a751-8e52165ef9c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:42.574375 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-ba44da41-55d1-4b13-a751-8e52165ef9c8 None None] MFA Rules not processed for user `c2bda2fc12a24c48ba42c84873d8bfa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:57:42.575587 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-ba44da41-55d1-4b13-a751-8e52165ef9c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:57:42.637073 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1453/2910] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:57:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:57:42.646764 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5770bc-a707-4e06-a65b-4e1f1668cc6a admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:42.648584 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-0c5770bc-a707-4e06-a65b-4e1f1668cc6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:57:42.708583 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5770bc-a707-4e06-a65b-4e1f1668cc6a admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:42.712224 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033bfac6-1453-46c2-9a1c-29966fb83cf8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20eede5ccd834862b00123310b5c3975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:42.712866 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033bfac6-1453-46c2-9a1c-29966fb83cf8 service neutron] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:42.713150 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033bfac6-1453-46c2-9a1c-29966fb83cf8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:42.713909 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033bfac6-1453-46c2-9a1c-29966fb83cf8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:42.722914 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033bfac6-1453-46c2-9a1c-29966fb83cf8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:42.724355 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033bfac6-1453-46c2-9a1c-29966fb83cf8 service neutron] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:42.734268 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1458/2911] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:57:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:57:46.983031 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bf17f8-47b0-4fec-af79-170f538b32b8 None None] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:46.983031 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bf17f8-47b0-4fec-af79-170f538b32b8 None None] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:46.983685 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bf17f8-47b0-4fec-af79-170f538b32b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:47.018345 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.auth.core [None req-d9bf17f8-47b0-4fec-af79-170f538b32b8 None None] MFA Rules not processed for user `b6a06627a9594878b5e3cf42e105a657`. Rule list: `[]` (Enabled: `True`). {{(pid=80534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:57:47.019894 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-d9bf17f8-47b0-4fec-af79-170f538b32b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:57:47.113751 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1454/2912] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:57:46 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:57:47.118440 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033bfac6-1453-46c2-9a1c-29966fb83cf8 service neutron] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:47.130754 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033bfac6-1453-46c2-9a1c-29966fb83cf8 service neutron] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:47.136747 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334982a3-7105-40c0-bfe9-f8d34e838de0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:47.137746 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334982a3-7105-40c0-bfe9-f8d34e838de0 admin admin] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:47.138106 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334982a3-7105-40c0-bfe9-f8d34e838de0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:47.138455 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334982a3-7105-40c0-bfe9-f8d34e838de0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:47.139258 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334982a3-7105-40c0-bfe9-f8d34e838de0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:47.141472 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334982a3-7105-40c0-bfe9-f8d34e838de0 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:47.180473 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1459/2913] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jul 11 14:57:47 2022] POST /identity/v3/projects => generated 373 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:57:47.185479 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bf17f8-47b0-4fec-af79-170f538b32b8 None None] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:47.193392 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:57:47.199551 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bf17f8-47b0-4fec-af79-170f538b32b8 None None] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:47.271923 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ea78f3-82f6-4650-b058-0f75ab25d4ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:47.272638 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ea78f3-82f6-4650-b058-0f75ab25d4ea admin admin] REQUEST_METHOD: `POST` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:47.272928 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ea78f3-82f6-4650-b058-0f75ab25d4ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:47.273196 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ea78f3-82f6-4650-b058-0f75ab25d4ea admin admin] PATH_INFO: `/v3/users` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:47.273903 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ea78f3-82f6-4650-b058-0f75ab25d4ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:47.276471 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ea78f3-82f6-4650-b058-0f75ab25d4ea admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:47.299257 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1455/2914] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jul 11 14:57:47 2022] POST /identity/v3/users => generated 293 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:57:47.303355 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334982a3-7105-40c0-bfe9-f8d34e838de0 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:47.314678 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334982a3-7105-40c0-bfe9-f8d34e838de0 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:47.320219 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44aeaee-7c32-47d0-b807-ce23a5c6cd5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:47.321355 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44aeaee-7c32-47d0-b807-ce23a5c6cd5a admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:47.321706 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44aeaee-7c32-47d0-b807-ce23a5c6cd5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:47.322050 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44aeaee-7c32-47d0-b807-ce23a5c6cd5a admin admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:47.324039 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44aeaee-7c32-47d0-b807-ce23a5c6cd5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:47.325779 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44aeaee-7c32-47d0-b807-ce23a5c6cd5a admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:47.344071 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1460/2915] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:57:47 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:57:47.344626 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ea78f3-82f6-4650-b058-0f75ab25d4ea admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:47.356692 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ea78f3-82f6-4650-b058-0f75ab25d4ea admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:47.362311 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1014776-32e2-4908-afba-9907adc86a23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:47.363391 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1014776-32e2-4908-afba-9907adc86a23 admin admin] REQUEST_METHOD: `PUT` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:47.363701 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1014776-32e2-4908-afba-9907adc86a23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:47.364223 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1014776-32e2-4908-afba-9907adc86a23 admin admin] PATH_INFO: `/v3/projects/c160d79fb93a4898b36df1d16f207536/users/efb0143eb905428dbc72b281c9c87510/roles/b46df176b0fe479da63c318db225bed4` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:47.383106 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1014776-32e2-4908-afba-9907adc86a23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c160d79fb93a4898b36df1d16f207536, user_id=efb0143eb905428dbc72b281c9c87510, role_id=b46df176b0fe479da63c318db225bed4)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:47.387539 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1014776-32e2-4908-afba-9907adc86a23 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:47.404934 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1456/2916] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jul 11 14:57:47 2022] PUT /identity/v3/projects/c160d79fb93a4898b36df1d16f207536/users/efb0143eb905428dbc72b281c9c87510/roles/b46df176b0fe479da63c318db225bed4 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:57:47.409356 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44aeaee-7c32-47d0-b807-ce23a5c6cd5a admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:47.421046 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44aeaee-7c32-47d0-b807-ce23a5c6cd5a admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:47.497271 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61850299-8ba3-49c2-9d0c-a18f276fa60d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:47.499098 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61850299-8ba3-49c2-9d0c-a18f276fa60d admin admin] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:47.499376 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61850299-8ba3-49c2-9d0c-a18f276fa60d admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:47.499650 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61850299-8ba3-49c2-9d0c-a18f276fa60d admin admin] PATH_INFO: `/v3/roles` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:47.500426 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61850299-8ba3-49c2-9d0c-a18f276fa60d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:47.502119 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61850299-8ba3-49c2-9d0c-a18f276fa60d admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:47.516630 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1461/2917] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jul 11 14:57:47 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:57:47.522556 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1014776-32e2-4908-afba-9907adc86a23 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:47.535628 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1014776-32e2-4908-afba-9907adc86a23 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:47.542872 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef588836-178d-4bc7-b7a1-4b141a1ff4f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:47.543831 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef588836-178d-4bc7-b7a1-4b141a1ff4f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:47.544068 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef588836-178d-4bc7-b7a1-4b141a1ff4f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:47.544379 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef588836-178d-4bc7-b7a1-4b141a1ff4f5 admin admin] PATH_INFO: `/v3/projects/c160d79fb93a4898b36df1d16f207536/users/efb0143eb905428dbc72b281c9c87510/roles/b46df176b0fe479da63c318db225bed4` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:47.546422 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef588836-178d-4bc7-b7a1-4b141a1ff4f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c160d79fb93a4898b36df1d16f207536, user_id=efb0143eb905428dbc72b281c9c87510, role_id=b46df176b0fe479da63c318db225bed4)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:47.549981 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef588836-178d-4bc7-b7a1-4b141a1ff4f5 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:47.562298 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1457/2918] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jul 11 14:57:47 2022] PUT /identity/v3/projects/c160d79fb93a4898b36df1d16f207536/users/efb0143eb905428dbc72b281c9c87510/roles/b46df176b0fe479da63c318db225bed4 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:57:52.067883 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca0082f-9720-462c-a24a-01b2bf7042bb None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:52.068455 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca0082f-9720-462c-a24a-01b2bf7042bb None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:52.068553 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca0082f-9720-462c-a24a-01b2bf7042bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:52.076758 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:57:52.107076 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-6ca0082f-9720-462c-a24a-01b2bf7042bb None None] MFA Rules not processed for user `efb0143eb905428dbc72b281c9c87510`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:57:52.108422 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-6ca0082f-9720-462c-a24a-01b2bf7042bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:57:52.179223 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1462/2919] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:57:52 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:57:52.195639 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef588836-178d-4bc7-b7a1-4b141a1ff4f5 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:57:52.199257 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-ef588836-178d-4bc7-b7a1-4b141a1ff4f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:57:52.288859 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef588836-178d-4bc7-b7a1-4b141a1ff4f5 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:57:52.294614 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded54078-509e-4e7d-af91-b915efb67878 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4f8c0d696af4bd5a205ca8e9110b8cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:57:52.295272 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded54078-509e-4e7d-af91-b915efb67878 service nova] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:52.295557 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded54078-509e-4e7d-af91-b915efb67878 service nova] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:52.295828 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded54078-509e-4e7d-af91-b915efb67878 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:52.352841 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:57:52.357591 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded54078-509e-4e7d-af91-b915efb67878 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:57:52.359923 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded54078-509e-4e7d-af91-b915efb67878 service nova] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:57:52.370645 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1458/2920] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:57:52 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:57:53.364217 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3862511-89ff-4c3c-bf7b-937104071dcb None None] REQUEST_METHOD: `POST` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:57:53.364736 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3862511-89ff-4c3c-bf7b-937104071dcb None None] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:57:53.364864 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3862511-89ff-4c3c-bf7b-937104071dcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:57:53.383207 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.auth.core [None req-d3862511-89ff-4c3c-bf7b-937104071dcb None None] MFA Rules not processed for user `b6a06627a9594878b5e3cf42e105a657`. Rule list: `[]` (Enabled: `True`). {{(pid=80535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:57:53.384454 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-d3862511-89ff-4c3c-bf7b-937104071dcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:57:53.391982 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1463/2921] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jul 11 14:57:53 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:58:02.365792 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=3 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:58:03.377014 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=35 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:58:24.275880 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded54078-509e-4e7d-af91-b915efb67878 service nova] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:58:24.330754 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded54078-509e-4e7d-af91-b915efb67878 service nova] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:58:24.334568 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0542397-8fd7-4803-9da5-64a1b7d66a26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20eede5ccd834862b00123310b5c3975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:58:24.335218 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0542397-8fd7-4803-9da5-64a1b7d66a26 service neutron] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:58:24.335502 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0542397-8fd7-4803-9da5-64a1b7d66a26 service neutron] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:58:24.335780 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0542397-8fd7-4803-9da5-64a1b7d66a26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:58:24.345145 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0542397-8fd7-4803-9da5-64a1b7d66a26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:58:24.346568 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0542397-8fd7-4803-9da5-64a1b7d66a26 service neutron] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:58:24.356410 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1459/2922] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:58:24 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:58:34.351892 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=26 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:59:11.365240 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3862511-89ff-4c3c-bf7b-937104071dcb None None] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:59:11.367139 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-d3862511-89ff-4c3c-bf7b-937104071dcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:59:11.500844 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3862511-89ff-4c3c-bf7b-937104071dcb None None] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:59:11.505845 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7a48a4-40b7-4ddc-9a24-a49e745caaa3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bf25c7951dc4182996335ca1f0e56ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:59:11.506484 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7a48a4-40b7-4ddc-9a24-a49e745caaa3 service placement] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:59:11.506767 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7a48a4-40b7-4ddc-9a24-a49e745caaa3 service placement] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:59:11.507074 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7a48a4-40b7-4ddc-9a24-a49e745caaa3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:59:11.508920 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-7b7a48a4-40b7-4ddc-9a24-a49e745caaa3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:59:11.520022 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7a48a4-40b7-4ddc-9a24-a49e745caaa3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:59:11.521612 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7a48a4-40b7-4ddc-9a24-a49e745caaa3 service placement] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:59:11.532495 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1464/2923] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 14:59:11 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:59:21.528169 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=63 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:01:06.373139 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0542397-8fd7-4803-9da5-64a1b7d66a26 service neutron] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:01:06.413038 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0542397-8fd7-4803-9da5-64a1b7d66a26 service neutron] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:01:06.419098 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081cdb1a-b6a2-42c8-8b23-acdb2ac2ed7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20eede5ccd834862b00123310b5c3975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:01:06.420277 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081cdb1a-b6a2-42c8-8b23-acdb2ac2ed7a service neutron] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:01:06.420810 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081cdb1a-b6a2-42c8-8b23-acdb2ac2ed7a service neutron] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:01:06.421337 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081cdb1a-b6a2-42c8-8b23-acdb2ac2ed7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:01:06.424612 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-081cdb1a-b6a2-42c8-8b23-acdb2ac2ed7a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:01:06.468853 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081cdb1a-b6a2-42c8-8b23-acdb2ac2ed7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:01:06.470771 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081cdb1a-b6a2-42c8-8b23-acdb2ac2ed7a service neutron] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:01:06.480662 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1460/2924] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 15:01:06 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:01:06.589350 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7a48a4-40b7-4ddc-9a24-a49e745caaa3 service placement] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:01:06.599953 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7a48a4-40b7-4ddc-9a24-a49e745caaa3 service placement] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:01:06.603493 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cd031a-bb83-420b-ad68-49f20b449036 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20eede5ccd834862b00123310b5c3975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:01:06.604127 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cd031a-bb83-420b-ad68-49f20b449036 service neutron] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:01:06.604443 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cd031a-bb83-420b-ad68-49f20b449036 service neutron] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:01:06.604721 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cd031a-bb83-420b-ad68-49f20b449036 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:01:06.606458 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-69cd031a-bb83-420b-ad68-49f20b449036 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:01:06.639466 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cd031a-bb83-420b-ad68-49f20b449036 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:01:06.640942 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cd031a-bb83-420b-ad68-49f20b449036 service neutron] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:01:06.662907 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1465/2925] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 15:01:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:01:06.726404 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081cdb1a-b6a2-42c8-8b23-acdb2ac2ed7a service neutron] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:01:06.727828 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-081cdb1a-b6a2-42c8-8b23-acdb2ac2ed7a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:01:06.742836 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081cdb1a-b6a2-42c8-8b23-acdb2ac2ed7a service neutron] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:01:06.747712 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d165596-a642-4010-8c2d-d6579e4ae76e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bf25c7951dc4182996335ca1f0e56ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:01:06.748454 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d165596-a642-4010-8c2d-d6579e4ae76e service placement] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:01:06.748742 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d165596-a642-4010-8c2d-d6579e4ae76e service placement] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:01:06.749020 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d165596-a642-4010-8c2d-d6579e4ae76e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:01:06.750732 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-3d165596-a642-4010-8c2d-d6579e4ae76e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:01:06.762387 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d165596-a642-4010-8c2d-d6579e4ae76e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:01:06.763945 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d165596-a642-4010-8c2d-d6579e4ae76e service placement] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:01:06.774815 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1461/2926] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 15:01:06 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:01:08.453226 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cd031a-bb83-420b-ad68-49f20b449036 service neutron] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:01:08.454659 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-69cd031a-bb83-420b-ad68-49f20b449036 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:01:08.470142 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cd031a-bb83-420b-ad68-49f20b449036 service neutron] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:01:08.475807 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f506c196-f4a3-4112-9653-9903bcd44078 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4f8c0d696af4bd5a205ca8e9110b8cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:01:08.476531 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f506c196-f4a3-4112-9653-9903bcd44078 service nova] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:01:08.476819 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f506c196-f4a3-4112-9653-9903bcd44078 service nova] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:01:08.477097 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f506c196-f4a3-4112-9653-9903bcd44078 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:01:08.478921 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-f506c196-f4a3-4112-9653-9903bcd44078 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:01:08.492710 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f506c196-f4a3-4112-9653-9903bcd44078 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:01:08.494298 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f506c196-f4a3-4112-9653-9903bcd44078 service nova] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:01:08.506405 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1466/2927] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 15:01:08 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:01:16.770503 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=26 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:01:18.500687 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=24 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:02:14.100219 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d165596-a642-4010-8c2d-d6579e4ae76e service placement] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:14.101793 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-3d165596-a642-4010-8c2d-d6579e4ae76e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:02:14.113615 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d165596-a642-4010-8c2d-d6579e4ae76e service placement] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:14.117160 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd0a170-8aa8-4350-9441-1101f6caddb1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20eede5ccd834862b00123310b5c3975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:14.117825 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd0a170-8aa8-4350-9441-1101f6caddb1 service neutron] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:14.118109 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd0a170-8aa8-4350-9441-1101f6caddb1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:14.118389 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd0a170-8aa8-4350-9441-1101f6caddb1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:14.120107 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-2fd0a170-8aa8-4350-9441-1101f6caddb1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:02:14.129804 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd0a170-8aa8-4350-9441-1101f6caddb1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:14.131221 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd0a170-8aa8-4350-9441-1101f6caddb1 service neutron] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:14.139258 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1462/2928] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 15:02:14 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:02:24.135612 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=6 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:02:55.853231 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f506c196-f4a3-4112-9653-9903bcd44078 service nova] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:55.862793 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f506c196-f4a3-4112-9653-9903bcd44078 service nova] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:55.866625 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783c94cc-592f-4906-9f80-9168690a1284 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20eede5ccd834862b00123310b5c3975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:55.867267 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783c94cc-592f-4906-9f80-9168690a1284 service neutron] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:55.867551 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783c94cc-592f-4906-9f80-9168690a1284 service neutron] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:55.867827 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783c94cc-592f-4906-9f80-9168690a1284 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:55.876385 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783c94cc-592f-4906-9f80-9168690a1284 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:55.877806 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783c94cc-592f-4906-9f80-9168690a1284 service neutron] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:55.886727 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1467/2929] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 15:02:55 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:02:57.043354 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd0a170-8aa8-4350-9441-1101f6caddb1 service neutron] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:57.058299 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd0a170-8aa8-4350-9441-1101f6caddb1 service neutron] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:57.064845 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da15e0e-0c43-46d4-8d2f-057325acb003 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4f8c0d696af4bd5a205ca8e9110b8cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:57.065610 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da15e0e-0c43-46d4-8d2f-057325acb003 service nova] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:57.065896 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da15e0e-0c43-46d4-8d2f-057325acb003 service nova] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:57.066177 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da15e0e-0c43-46d4-8d2f-057325acb003 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:57.068243 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-7da15e0e-0c43-46d4-8d2f-057325acb003 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:02:57.081329 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da15e0e-0c43-46d4-8d2f-057325acb003 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:57.082570 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da15e0e-0c43-46d4-8d2f-057325acb003 service nova] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:57.094485 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1463/2930] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 15:02:57 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 15:02:57.249874 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783c94cc-592f-4906-9f80-9168690a1284 service neutron] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:57.258857 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783c94cc-592f-4906-9f80-9168690a1284 service neutron] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:57.262523 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672e3dd0-33b6-4ba7-833d-7f3d862b0c3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20eede5ccd834862b00123310b5c3975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:57.263166 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672e3dd0-33b6-4ba7-833d-7f3d862b0c3f service neutron] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:57.263731 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672e3dd0-33b6-4ba7-833d-7f3d862b0c3f service neutron] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:57.264175 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672e3dd0-33b6-4ba7-833d-7f3d862b0c3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:57.266022 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-672e3dd0-33b6-4ba7-833d-7f3d862b0c3f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:02:57.280305 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672e3dd0-33b6-4ba7-833d-7f3d862b0c3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:57.281784 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672e3dd0-33b6-4ba7-833d-7f3d862b0c3f service neutron] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:57.293390 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1468/2931] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 15:02:57 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:02:58.471108 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da15e0e-0c43-46d4-8d2f-057325acb003 service nova] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:02:58.480570 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da15e0e-0c43-46d4-8d2f-057325acb003 service nova] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:02:58.484699 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79f29ff-ec87-4308-b620-c0b450868791 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20eede5ccd834862b00123310b5c3975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:02:58.485396 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79f29ff-ec87-4308-b620-c0b450868791 service neutron] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:02:58.485707 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79f29ff-ec87-4308-b620-c0b450868791 service neutron] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:02:58.486017 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79f29ff-ec87-4308-b620-c0b450868791 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:02:58.487864 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-f79f29ff-ec87-4308-b620-c0b450868791 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:02:58.505076 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79f29ff-ec87-4308-b620-c0b450868791 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:02:58.507913 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79f29ff-ec87-4308-b620-c0b450868791 service neutron] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:02:58.521261 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1464/2932] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 15:02:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:03:02.013080 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672e3dd0-33b6-4ba7-833d-7f3d862b0c3f service neutron] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:02.022837 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672e3dd0-33b6-4ba7-833d-7f3d862b0c3f service neutron] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:02.026589 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe08ded3-e87a-4164-84f9-abf0ae451aa7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20eede5ccd834862b00123310b5c3975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:02.027270 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe08ded3-e87a-4164-84f9-abf0ae451aa7 service neutron] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:02.027558 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe08ded3-e87a-4164-84f9-abf0ae451aa7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:02.027855 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe08ded3-e87a-4164-84f9-abf0ae451aa7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:02.098132 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe08ded3-e87a-4164-84f9-abf0ae451aa7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:02.099567 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe08ded3-e87a-4164-84f9-abf0ae451aa7 service neutron] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:02.118496 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1469/2933] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 15:03:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:03:05.178783 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79f29ff-ec87-4308-b620-c0b450868791 service neutron] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:05.193573 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79f29ff-ec87-4308-b620-c0b450868791 service neutron] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:05.202365 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26741341-dd67-44d6-82f4-89050695ccd0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bf25c7951dc4182996335ca1f0e56ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:05.202365 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26741341-dd67-44d6-82f4-89050695ccd0 service placement] REQUEST_METHOD: `GET` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:05.202365 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26741341-dd67-44d6-82f4-89050695ccd0 service placement] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:05.202831 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26741341-dd67-44d6-82f4-89050695ccd0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:05.204389 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-26741341-dd67-44d6-82f4-89050695ccd0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:03:05.216844 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26741341-dd67-44d6-82f4-89050695ccd0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:05.218552 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26741341-dd67-44d6-82f4-89050695ccd0 service placement] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:05.229484 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1465/2934] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 15:03:05 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:03:08.178989 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe08ded3-e87a-4164-84f9-abf0ae451aa7 service neutron] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:08.189860 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe08ded3-e87a-4164-84f9-abf0ae451aa7 service neutron] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:08.197872 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced3ce73-d6d1-4af9-a363-75c11fdd646f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:08.198857 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced3ce73-d6d1-4af9-a363-75c11fdd646f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:08.199263 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced3ce73-d6d1-4af9-a363-75c11fdd646f admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:08.199649 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced3ce73-d6d1-4af9-a363-75c11fdd646f admin admin] PATH_INFO: `/v3/users/b6a06627a9594878b5e3cf42e105a657` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:08.201363 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced3ce73-d6d1-4af9-a363-75c11fdd646f admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6a06627a9594878b5e3cf42e105a657)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:08.203304 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced3ce73-d6d1-4af9-a363-75c11fdd646f admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:08.260409 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-ced3ce73-d6d1-4af9-a363-75c11fdd646f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6a06627a9594878b5e3cf42e105a657'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:03:08.268676 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-ced3ce73-d6d1-4af9-a363-75c11fdd646f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6a06627a9594878b5e3cf42e105a657'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:03:08.276436 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-ced3ce73-d6d1-4af9-a363-75c11fdd646f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6a06627a9594878b5e3cf42e105a657'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:03:08.277053 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-ced3ce73-d6d1-4af9-a363-75c11fdd646f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6a06627a9594878b5e3cf42e105a657'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:03:08.277652 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-ced3ce73-d6d1-4af9-a363-75c11fdd646f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6a06627a9594878b5e3cf42e105a657'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:03:08.296033 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1470/2935] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jul 11 15:03:08 2022] DELETE /identity/v3/users/b6a06627a9594878b5e3cf42e105a657 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:03:08.475612 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26741341-dd67-44d6-82f4-89050695ccd0 service placement] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:08.491050 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26741341-dd67-44d6-82f4-89050695ccd0 service placement] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:08.549058 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c378bec8-5ef7-4ff8-a3f6-b065d722aff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:08.549932 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c378bec8-5ef7-4ff8-a3f6-b065d722aff9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:08.550218 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c378bec8-5ef7-4ff8-a3f6-b065d722aff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:08.550496 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c378bec8-5ef7-4ff8-a3f6-b065d722aff9 admin admin] PATH_INFO: `/v3/projects/d060e0fbe0e041648c3f392738089aab` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:08.551665 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c378bec8-5ef7-4ff8-a3f6-b065d722aff9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d060e0fbe0e041648c3f392738089aab)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:08.553605 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c378bec8-5ef7-4ff8-a3f6-b065d722aff9 admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:08.605721 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-c378bec8-5ef7-4ff8-a3f6-b065d722aff9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd060e0fbe0e041648c3f392738089aab', 'request_id': 'req-c378bec8-5ef7-4ff8-a3f6-b065d722aff9'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:03:08.615575 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-c378bec8-5ef7-4ff8-a3f6-b065d722aff9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd060e0fbe0e041648c3f392738089aab', 'request_id': 'req-c378bec8-5ef7-4ff8-a3f6-b065d722aff9'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:03:08.625149 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-c378bec8-5ef7-4ff8-a3f6-b065d722aff9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd060e0fbe0e041648c3f392738089aab', 'request_id': 'req-c378bec8-5ef7-4ff8-a3f6-b065d722aff9'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:03:08.648623 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-c378bec8-5ef7-4ff8-a3f6-b065d722aff9 admin admin] The token cache is being invalidate because project d060e0fbe0e041648c3f392738089aab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80534) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:03:08.648838 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-c378bec8-5ef7-4ff8-a3f6-b065d722aff9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:03:08.649461 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-c378bec8-5ef7-4ff8-a3f6-b065d722aff9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:03:08.650994 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1466/2936] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jul 11 15:03:08 2022] DELETE /identity/v3/projects/d060e0fbe0e041648c3f392738089aab => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:03:08.655869 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced3ce73-d6d1-4af9-a363-75c11fdd646f admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:08.657345 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-ced3ce73-d6d1-4af9-a363-75c11fdd646f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:03:08.670614 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced3ce73-d6d1-4af9-a363-75c11fdd646f admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:08.689161 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:03:08.730276 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81493af9-cbb9-4cd7-bc38-b117a8e62fd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:08.731149 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81493af9-cbb9-4cd7-bc38-b117a8e62fd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:08.731436 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81493af9-cbb9-4cd7-bc38-b117a8e62fd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:08.731721 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81493af9-cbb9-4cd7-bc38-b117a8e62fd5 admin admin] PATH_INFO: `/v3/users/efb0143eb905428dbc72b281c9c87510` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:08.733078 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81493af9-cbb9-4cd7-bc38-b117a8e62fd5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=efb0143eb905428dbc72b281c9c87510)` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:08.734993 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81493af9-cbb9-4cd7-bc38-b117a8e62fd5 admin admin] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:08.780638 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-81493af9-cbb9-4cd7-bc38-b117a8e62fd5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'efb0143eb905428dbc72b281c9c87510'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:03:08.787366 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-81493af9-cbb9-4cd7-bc38-b117a8e62fd5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'efb0143eb905428dbc72b281c9c87510'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:03:08.794118 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-81493af9-cbb9-4cd7-bc38-b117a8e62fd5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'efb0143eb905428dbc72b281c9c87510'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:03:08.794791 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-81493af9-cbb9-4cd7-bc38-b117a8e62fd5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'efb0143eb905428dbc72b281c9c87510'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:03:08.795396 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.notifications [None req-81493af9-cbb9-4cd7-bc38-b117a8e62fd5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'efb0143eb905428dbc72b281c9c87510'} {{(pid=80535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:03:08.814283 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1471/2937] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jul 11 15:03:08 2022] DELETE /identity/v3/users/efb0143eb905428dbc72b281c9c87510 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:03:08.989468 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c378bec8-5ef7-4ff8-a3f6-b065d722aff9 admin admin] Authenticating user token {{(pid=80534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:03:08.990982 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.fernet_utils [None req-c378bec8-5ef7-4ff8-a3f6-b065d722aff9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:03:09.004594 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c378bec8-5ef7-4ff8-a3f6-b065d722aff9 admin admin] Validating token access rules against request {{(pid=80534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:03:09.051638 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:03:09.071654 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a06d18e-3461-4a11-97dc-3cb67e51f72c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bda2fc12a24c48ba42c84873d8bfa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a62c198ecd94c498e9bd153b3d4226c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:03:09.072540 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a06d18e-3461-4a11-97dc-3cb67e51f72c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:03:09.072822 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a06d18e-3461-4a11-97dc-3cb67e51f72c admin admin] SCRIPT_NAME: `/identity` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:03:09.073094 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a06d18e-3461-4a11-97dc-3cb67e51f72c admin admin] PATH_INFO: `/v3/projects/c160d79fb93a4898b36df1d16f207536` {{(pid=80534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:03:09.074260 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a06d18e-3461-4a11-97dc-3cb67e51f72c admin admin] RBAC: Authorizing `identity:delete_project(project_id=c160d79fb93a4898b36df1d16f207536)` {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:03:09.076811 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a06d18e-3461-4a11-97dc-3cb67e51f72c admin admin] RBAC: Authorization granted {{(pid=80534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:03:09.126809 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-3a06d18e-3461-4a11-97dc-3cb67e51f72c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c160d79fb93a4898b36df1d16f207536', 'request_id': 'req-3a06d18e-3461-4a11-97dc-3cb67e51f72c'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:03:09.134820 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-3a06d18e-3461-4a11-97dc-3cb67e51f72c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c160d79fb93a4898b36df1d16f207536', 'request_id': 'req-3a06d18e-3461-4a11-97dc-3cb67e51f72c'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:03:09.145981 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-3a06d18e-3461-4a11-97dc-3cb67e51f72c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c160d79fb93a4898b36df1d16f207536', 'request_id': 'req-3a06d18e-3461-4a11-97dc-3cb67e51f72c'} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:03:09.159786 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-3a06d18e-3461-4a11-97dc-3cb67e51f72c admin admin] The token cache is being invalidate because project c160d79fb93a4898b36df1d16f207536 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80534) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:03:09.160079 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-3a06d18e-3461-4a11-97dc-3cb67e51f72c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:03:09.160791 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG keystone.notifications [None req-3a06d18e-3461-4a11-97dc-3cb67e51f72c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:03:09.162420 dv-cinder-master-3-smb devstack@keystone.service[80534]: [pid: 80534|app: 0|req: 1467/2938] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jul 11 15:03:08 2022] DELETE /identity/v3/projects/c160d79fb93a4898b36df1d16f207536 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:03:18.808724 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=43,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:03:19.156594 dv-cinder-master-3-smb devstack@keystone.service[80534]: DEBUG dbcounter [-] [80534] Writing DB stats keystone:SELECT=33,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:04:17.302859 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81493af9-cbb9-4cd7-bc38-b117a8e62fd5 admin admin] Authenticating user token {{(pid=80535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:04:17.304297 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-81493af9-cbb9-4cd7-bc38-b117a8e62fd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:04:17.378992 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81493af9-cbb9-4cd7-bc38-b117a8e62fd5 admin admin] Validating token access rules against request {{(pid=80535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:04:17.439715 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdfbd2c-8323-42da-bbd1-c6cae06cc186 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bf25c7951dc4182996335ca1f0e56ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd34295bf7b435a96b37487c8e89fc3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:04:17.440405 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdfbd2c-8323-42da-bbd1-c6cae06cc186 service placement] REQUEST_METHOD: `GET` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:04:17.440691 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdfbd2c-8323-42da-bbd1-c6cae06cc186 service placement] SCRIPT_NAME: `/identity` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:04:17.441237 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdfbd2c-8323-42da-bbd1-c6cae06cc186 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:04:17.443141 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.fernet_utils [None req-9bdfbd2c-8323-42da-bbd1-c6cae06cc186 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:04:17.455340 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdfbd2c-8323-42da-bbd1-c6cae06cc186 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:04:17.456954 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdfbd2c-8323-42da-bbd1-c6cae06cc186 service placement] RBAC: Authorization granted {{(pid=80535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:04:17.467836 dv-cinder-master-3-smb devstack@keystone.service[80535]: [pid: 80535|app: 0|req: 1472/2939] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 11 15:04:17 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:04:27.462551 dv-cinder-master-3-smb devstack@keystone.service[80535]: DEBUG dbcounter [-] [80535] Writing DB stats keystone:SELECT=58 {{(pid=80535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}